Use Case
Crawl4AI Web Scraper is a powerful AI agent skill that extends your assistant with new capabilities. Full web page scraping with JavaScript rendering via local Crawl4AI instance, delivering clean markdown or detailed JSON including links and media. This guide walks you through installing Crawl4AI Web Scraper, configuring it for your setup, and running your first commands β so you can start getting value in minutes.
Install Crawl4AI Web Scraper: npx clawhub@latest --dir ~/.claude/skills install crawl-for-ai
Restart your AI client (Claude Code, Cursor, Gemini CLI, or OpenClaw)
Type a natural language request related to developer & devops to trigger Crawl4AI Web Scraper
Review the output and refine your prompt for better results
Combine Crawl4AI Web Scraper with other skills to build multi-step workflows
Copy these prompts and use them with your AI agent after installing Crawl4AI Web Scraper
Help me get started with Crawl4AI Web Scraper
What can Crawl4AI Web Scraper do for my developer & devops workflow?
Show me an example of using Crawl4AI Web Scraper
Select your agent
Option 1: Install via CLI (recommended)
Recommended (no pre-install needed)
npx clawhub@latest --dir ~/.claude/skills install crawl-for-aiOr via clawhub CLI (if already installed)
clawhub --dir ~/.claude/skills install crawl-for-aiβ οΈ Requires Node.js 18+. No Node? Use Option 2 below to download the ZIP instead. Install Node.js β
Option 2: Manual install (no Node required)
Download the ZIP, extract it, and place the folder at the path below. Restart your agent to activate.
Install path
~/.claude/skills/crawl-for-ai/π‘Extract and place the folder at the path above, then restart your agent.