Generate robots.txt with smart defaults. Allow or block AI crawlers (GPTBot, ClaudeBot) based on your strategy. Framework presets for Next.js and Gatsby. Staging lockdown. Zero dependencies.
-
Updated
Feb 10, 2026 - JavaScript
Generate robots.txt with smart defaults. Allow or block AI crawlers (GPTBot, ClaudeBot) based on your strategy. Framework presets for Next.js and Gatsby. Staging lockdown. Zero dependencies.
Add a description, image, and links to the gptbot topic page so that developers can more easily learn about it.
To associate your repository with the gptbot topic, visit your repo's landing page and select "manage topics."