mirror of
https://github.com/wagtail/wagtail.git
synced 2024-11-30 11:10:43 +01:00
ab656424b7
These are now returning the correct canonical URL (thanks to a Cloudflare worker script), and letting search engines spider them again will hopefully boost visibility of that canonical URL.
6 lines
79 B
Plaintext
6 lines
79 B
Plaintext
User-agent: *
|
|
|
|
Disallow: /*/pdf/
|
|
|
|
Sitemap: https://docs.wagtail.io/sitemap.xml
|