Use Case
Web Scraping is a powerful AI agent skill that extends your assistant with new capabilities. Extract structured information from websites using web_fetch for simple pages and browser automation for dynamic sites, login-gated flows, pagination, infini... This guide walks you through installing Web Scraping, configuring it for your setup, and running your first commands β so you can start getting value in minutes.
Install Web Scraping: npx clawhub@latest --dir ~/.claude/skills install web-scraping
Restart your AI client (Claude Code, Cursor, Gemini CLI, or OpenClaw)
Type a natural language request related to developer & devops to trigger Web Scraping
Review the output and refine your prompt for better results
Combine Web Scraping with other skills to build multi-step workflows
Copy these prompts and use them with your AI agent after installing Web Scraping
Help me get started with Web Scraping
What can Web Scraping do for my developer & devops workflow?
Show me an example of using Web Scraping
Select your agent
Option 1: Install via CLI (recommended)
Recommended (no pre-install needed)
npx clawhub@latest --dir ~/.claude/skills install web-scrapingOr via clawhub CLI (if already installed)
clawhub --dir ~/.claude/skills install web-scrapingβ οΈ Requires Node.js 18+. No Node? Use Option 2 below to download the ZIP instead. Install Node.js β
Option 2: Manual install (no Node required)
Download the ZIP, extract it, and place the folder at the path below. Restart your agent to activate.
Install path
~/.claude/skills/web-scraping/π‘Extract and place the folder at the path above, then restart your agent.