Crawl/scrape and extract content from any webpage URL. Returns the page content as clean text or raw HTML. Use this when you need to read the full contents o...
Data sourced from ClawHub. View on ClawSkills
Select your agent
Option 1: Install via CLI (recommended)
Recommended (no pre-install needed)
npx clawhub@latest --dir ~/.claude/skills install desearch-crawlOr via clawhub CLI (if already installed)
clawhub --dir ~/.claude/skills install desearch-crawlβ οΈ Requires Node.js 18+. No Node? Use Option 2 below to download the ZIP instead. Install Node.js β
Option 2: Manual install (no Node required)
Download the ZIP, extract it, and place the folder at the path below. Restart your agent to activate.
Install path
~/.claude/skills/desearch-crawl/π‘Extract and place the folder at the path above, then restart your agent.
Category
πDocuments & NotesPlatforms
What Crawl By Desearch can do for your AI workflow
Crawl/scrape and extract directly from your Claude conversation
Works across Claude, Cursor, OpenClaw β install once, use everywhere
One-command installation β no complex setup required
Combine with other skills to build powerful multi-step AI workflows
Try these prompts with your AI agent after installing Crawl By Desearch
Help me get started with Crawl By Desearch
Explains what Crawl By Desearch does, walks through the setup, and runs a quick demo based on your current project
Use Crawl By Desearch to crawl/scrape and extract content from any webpage URL
Invokes Crawl By Desearch with the right parameters and returns the result directly in the conversation
What can I do with Crawl By Desearch in my documents & notes workflow?
Lists the top use cases for Crawl By Desearch, with example commands for each scenario
Guides & tutorials for AI skills
The 7 AI Skills Every Software Developer Should Have Installed in 2026
After testing dozens of developer-focused AI skills, these are the seven that have proven genuinely useful across different tech stacks and workflows β not just impressive demos, but tools that hold up under daily use.
MCP Skills vs Native Claude Tools: What's the Difference and When to Use Each
Claude comes with built-in capabilities, but MCP skills extend it in ways the base model can't. Here's a clear breakdown of what each type of tool is good for, with real examples of when to reach for a skill versus relying on Claude's native abilities.
Crawl By Desearch extends your AI assistant with the ability to crawl/scrape and extract content from any webpage URL. Returns the page content as clean text or raw HTML. Use this when you need to read the full contents o... Rather than leaving your conversation to handle this manually, you can ask your Claude agent directly β and it will take care of the task end-to-end, using Crawl By Desearch as its underlying capability.
Crawl By Desearch works across Claude, Cursor, OpenClaw through the Model Context Protocol (MCP) β an open standard that lets AI clients share tools and skills without lock-in. Because MCP is platform-agnostic by design, you install Crawl By Desearch once and it becomes available across all your AI clients. Whether you're working in Claude for focused sessions or Cursor for integrated workflows, the skill behaves consistently.
Crawl By Desearch installs like any other MCP skill: drop the folder into `~/.claude/skills/desearch-crawl/` for global access, or `.claude/skills/desearch-crawl/` to keep it scoped to one project. After a quick restart of Claude, you can trigger it explicitly with `/desearch-crawl`, or let the AI decide when it's the right tool for your request.
Crawl By Desearch has 823 installs and is part of the growing Documents & Notes skill ecosystem on DiscoverAISkills. Like all skills on DiscoverAISkills, it is free to install and use. The broader AI skills ecosystem continues to expand as developers contribute new capabilities across categories like developer tools, data analysis, writing, automation, and more.
Place the skill folder at ~/.claude/skills/desearch-crawl/ for personal use (all projects), or .claude/skills/desearch-crawl/ for project-specific use. Restart your AI client, then invoke with /desearch-crawl or let the AI discover it automatically.
Crawl By Desearch supports Claude, Cursor, OpenClaw. It integrates seamlessly with these AI platforms to extend their capabilities.
Crawl By Desearch is free to install. Check the repository for licensing information.
Crawl/scrape and extract content from any webpage URL. Returns the page content as clean text or raw HTML. Use this when you need to read the full contents o...
Web Search by Desearch
CuratedSearch the web and get real-time SERP-style results with titles, URLs, and snippets. Use this for general web queries when you need current links and informa...
Crawl4AI Web Scraper
Full web page scraping with JavaScript rendering via local Crawl4AI instance, delivering clean markdown or detailed JSON including links and media.
Automate my documents & notes tasks using Crawl By Desearch
Identifies repetitive steps in your workflow and sets up Crawl By Desearch to handle them automatically
Crawl By Desearch is categorized under Documents & Notes. These skills help AI agents perform specialized tasks in this domain.
Crawl4ai Skill
Web crawling and scraping tool with LLM-optimized output. η½ι‘΅η¬θ«η¬εε·₯ε · | Web crawler, web scraper, spider. DuckDuckGo search, site crawling, dynamic page scrapin...