Use Case
Robots Ai is a powerful AI agent skill that extends your assistant with new capabilities. Analyze and generate robots.txt files with AI crawler awareness. Detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.) are blocked o... This guide walks you through installing Robots Ai, configuring it for your setup, and running your first commands β so you can start getting value in minutes.
Install Robots Ai: npx clawhub@latest --dir ~/.claude/skills install robotstxt-ai
Restart your AI client (Claude Code, Cursor, Gemini CLI, or OpenClaw)
Type a natural language request related to data & analytics to trigger Robots Ai
Review the output and refine your prompt for better results
Combine Robots Ai with other skills to build multi-step workflows
Copy these prompts and use them with your AI agent after installing Robots Ai
Help me get started with Robots Ai
What can Robots Ai do for my data & analytics workflow?
Show me an example of using Robots Ai
Select your agent
Option 1: Install via CLI (recommended)
Recommended (no pre-install needed)
npx clawhub@latest --dir ~/.claude/skills install robotstxt-aiOr via clawhub CLI (if already installed)
clawhub --dir ~/.claude/skills install robotstxt-aiβ οΈ Requires Node.js 18+. No Node? Use Option 2 below to download the ZIP instead. Install Node.js β
Option 2: Manual install (no Node required)
Download the ZIP, extract it, and place the folder at the path below. Restart your agent to activate.
Install path
~/.claude/skills/robotstxt-ai/π‘Extract and place the folder at the path above, then restart your agent.