Skip to content

ask Google, etc. not to index useless or poor pages

Administrator requested to merge sg/seo-bad-pages into main

Created by: slimsag

Introduces per-route tagging of either index or noIndex. When noIndex is specified, we respond with a X-Robots-Tag: noindex header instructing Google etc. not to index the page.

I have manually vetted / tagged each route with what I think is most appropriate, leaning on the side of not indexing in general (because indexing bad content is really bad for us, much worse than erring on the side of indexing.)

We can continue to revise individual routes, etc. as needed.

Fixes #24696 (closed)

Signed-off-by: Stephen Gutekanst [email protected]

Merge request reports