Skip to content

robots.txt: block AI training crawlers; noindex the pages.dev addresses - #11

Merged
Deityhub merged 1 commit into
devfrom
chore/robot
Oct 29, 2026
Merged

Deityhub merged 1 commit into
devfrom
chore/robot

robots.txt: allow search, block AI training crawlers; noindex the pag…

22f9227
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar