crawler-control1 skill

Crawler Control Skills

Marketing skills tagged with “crawler-control”. Install any skill into Claude, Cursor, or your favorite AI agent.

#SkillScore
1
Configure and audit robots.txt for search and AI crawler controlSEO

Guide agents to configure robots.txt directives, audit crawler access, and block AI training bots while enabling search indexing.

4.0