Skip to content

docs: add nofollow to View as Markdown links. - #38411

Open
nisarhassan12 wants to merge 1 commit into
MaterializeInc:mainfrom
nisarhassan12:nh12/hide-markdown-docs-from-search
Open

docs: add nofollow to View as Markdown links.#38411
nisarhassan12 wants to merge 1 commit into
MaterializeInc:mainfrom
nisarhassan12:nh12/hide-markdown-docs-from-search

Conversation

@nisarhassan12

@nisarhassan12 nisarhassan12 commented Aug 21, 2026

Copy link
Copy Markdown
Member

Summary

  • Adds rel="nofollow" to the "View as Markdown" links so HTML docs stop advertising /docs/markdown-docs/ URLs to crawlers.
  • Crawl blocking lives in www-temporary, which owns https://materialize.com/robots.txt the remainder of the changes are made there.

Raw Markdown copies under /docs/markdown-docs/ are duplicate content.
Crawl blocking for those URLs is owned by the marketing site robots.txt.

Co-authored-by: Cursor <cursoragent@cursor.com>
@nisarhassan12
nisarhassan12 requested a review from a team as a code owner August 21, 2026 19:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant