Use Case
Robots.txt Generator is a powerful AI agent skill that extends your assistant with new capabilities. Generate, validate, and analyze robots.txt files for websites. Use when creating robots.txt from scratch, validating existing robots.txt syntax, checking if... This guide walks you through installing Robots.txt Generator, configuring it for your setup, and running your first commands β so you can start getting value in minutes.
Install Robots.txt Generator: npx clawhub@latest --dir ~/.claude/skills install robots-txt-gen
Restart your AI client (Claude Code, Cursor, Gemini CLI, or OpenClaw)
Type a natural language request related to finance & investment to trigger Robots.txt Generator
Review the output and refine your prompt for better results
Combine Robots.txt Generator with other skills to build multi-step workflows
Copy these prompts and use them with your AI agent after installing Robots.txt Generator
Help me get started with Robots.txt Generator
What can Robots.txt Generator do for my finance & investment workflow?
Show me an example of using Robots.txt Generator
Select your agent
Option 1: Install via CLI (recommended)
Recommended (no pre-install needed)
npx clawhub@latest --dir ~/.claude/skills install robots-txt-genOr via clawhub CLI (if already installed)
clawhub --dir ~/.claude/skills install robots-txt-genβ οΈ Requires Node.js 18+. No Node? Use Option 2 below to download the ZIP instead. Install Node.js β
Option 2: Manual install (no Node required)
Download the ZIP, extract it, and place the folder at the path below. Restart your agent to activate.
Install path
~/.claude/skills/robots-txt-gen/π‘Extract and place the folder at the path above, then restart your agent.