Use Case
Crawl4ai is a powerful AI agent skill that extends your assistant with new capabilities. AI-powered web scraping framework for extracting structured data from websites. Use when Codex needs to crawl, scrape, or extract data from web pages using AI-powered parsing, handle dynamic content, or work with complex HTML structures. This guide walks you through installing Crawl4ai, configuring it for your setup, and running your first commands β so you can start getting value in minutes.
Install Crawl4ai: npx clawhub@latest --dir ~/.claude/skills install crawl4ai
Restart your AI client (Claude Code, Cursor, Gemini CLI, or OpenClaw)
Type a natural language request related to data & analytics to trigger Crawl4ai
Review the output and refine your prompt for better results
Combine Crawl4ai with other skills to build multi-step workflows
Copy these prompts and use them with your AI agent after installing Crawl4ai
Help me get started with Crawl4ai
What can Crawl4ai do for my data & analytics workflow?
Show me an example of using Crawl4ai
Select your agent
Option 1: Install via CLI (recommended)
Recommended (no pre-install needed)
npx clawhub@latest --dir ~/.claude/skills install crawl4aiOr via clawhub CLI (if already installed)
clawhub --dir ~/.claude/skills install crawl4aiβ οΈ Requires Node.js 18+. No Node? Use Option 2 below to download the ZIP instead. Install Node.js β
Option 2: Manual install (no Node required)
Download the ZIP, extract it, and place the folder at the path below. Restart your agent to activate.
Install path
~/.claude/skills/crawl4ai/π‘Extract and place the folder at the path above, then restart your agent.