From 0628bb12724a68ef30eff29ecdd36e69423c52a7 Mon Sep 17 00:00:00 2001 From: LeonTing1010 Date: Sat, 23 May 2026 16:43:01 +0800 Subject: [PATCH] docs(robots): disallow /cdn-cgi/ to stop Ahrefs flagging Cloudflare email-protection 404s Cloudflare Email Address Obfuscation rewrites contact emails into /cdn-cgi/l/email-protection# links. Crawlers strip the fragment and hit the bare URL (404), which Ahrefs Site Audit reported as ~18 broken-link errors across page variants. Root cause already fixed by disabling email_obfuscation on the zone; this Disallow is belt-and-suspenders hygiene (everything under /cdn-cgi/ is Cloudflare-internal). Co-Authored-By: Claude Opus 4.7 (1M context) --- docs/robots.txt | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/robots.txt b/docs/robots.txt index 405413e..d7d2c18 100644 --- a/docs/robots.txt +++ b/docs/robots.txt @@ -1,4 +1,5 @@ User-agent: * Allow: / +Disallow: /cdn-cgi/ Sitemap: https://taprun.dev/sitemap.xml