Generate robots.txt from the command line or code: presets for WordPress, WooCommerce, Shopify, Magento, Next.js, Laravel and staging sites, custom Allow/Disallow rules, sitemaps, crawl-delay, one-flag blocking of 20 AI crawlers (GPTBot, ClaudeBot, Google-Extended, CCBot…) and SEO bots, with built-in lint. Zero-dependency Node.
-
Updated
Oct 27, 2026 - JavaScript