robots.txt4 skills

Robots.txt Skills

Marketing skills tagged with “robots.txt”. Install any skill into Claude, Cursor, or your favorite AI agent.

#SkillScore
1
Analyze AI crawler access and robots.txt configurationSEO

Audit which AI crawlers can access your site and optimize robots.txt for maximum AI search visibility.

4.5
2
Audit AI crawler robots.txt policiesSEO

Analyze robots.txt for AI crawler access: GPTBot, ClaudeBot, PerplexityBot, Google-Extended. Audit policies and get recommendations.

4.0
3
Audit robots.txt for AI crawler policiesSEO

Check how your robots.txt handles AI crawlers like GPTBot, ClaudeBot, and PerplexityBot. Get an access matrix, openness score, and ready-to-use policy templates

4.0
4
Configure and audit robots.txt for search and AI crawler controlSEO

Guide agents to configure robots.txt directives, audit crawler access, and block AI training bots while enabling search indexing.

4.0