Exclude `/dart/` from crawling#475

Merged

armiol merged 3 commits intomasterfrom

exclude-dart-docs-from-crawling

Mar 18, 2024

Commits on Mar 18, 2024

Exclude `/dart/` subtree from crawling.
armiol
committed
Remove the default `Disallow: <empty>` entry to avoid any confusion, as we now have an explicit `Disallow: /dart/`.
armiol
committed
Move `Disallow: /dart/` right under the user-agent.
armiol
committed