io.github.sharozdawa
robotstxt-ai
Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
stdiocommunityapplication
Package Details
robotstxt-ai-mcp
Transportstdio
Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.