Serve clean Markdown to AI agents in Laravel: Accept: text/markdown gets the page's main content as Markdown, browsers keep the HTML. Origin-side Markdown for Agents with Content-Signal support.
-
Updated
Nov 15, 2026 - PHP
Serve clean Markdown to AI agents in Laravel: Accept: text/markdown gets the page's main content as Markdown, browsers keep the HTML. Origin-side Markdown for Agents with Content-Signal support.
Define AI permissions once. Emit the rules today's AI web actually uses. One manifest → robots.txt, AIPREF headers, X-Robots-Tag, Google-Extended, TDMRep.
Machine-readable AI usage preferences for an API: training, inference, agent onboarding/actions/purchases. Aligned with IETF AIPREF.
Parse and test robots.txt per RFC 9309, lint it, and check AI-crawler policy including Content-Signal and RSL License lines (Python, stdlib only)
Customs-house auditor for AI agents. Scores 8 dimensions covering crawler policy, MCP/ACP exposure, agent-actionable Product/Offer, brand identity corroboration; generates drop-in robots.txt + .well-known manifests. MIT, a gift to the Algorand ecosystem.
Flag contradictions across the AI-control signals on a domain (robots.txt, Content-Signal, AIPREF Content-Usage, X-Robots-Tag, RSL, llms.txt). npm CLI + GitHub Action that fails CI when your AI rules disagree.
Zie welke AI-crawlers je WordPress-pagina's ophalen en zet in robots.txt wat ze met je content mogen. Zelf gehost, geen uitgaand verzoek, geen IP-adres. Gratis GPL-plugin van theseo.nl.
Agent-readiness toolkit for WordPress: markdown negotiation, llms.txt, content signals, and well-known JSON endpoints for AI agents.
Channel-aware robots.txt for Sylius with explicit AI crawler rules and Content Signals (RFC 9309).
To associate your repository with the content-signals topic, visit your repo's landing page and select "manage topics."