M

MrScraper

mrscraper

🌐 English

Run AI-powered, unblockable web scraping, data extraction with natural language via the MrScraper API

数据来源：ClawHub。在 ClawSkills 查看

617下载量

2收藏数

0浏览量

安装

选择你使用的 Agent

方法一：命令行安装（推荐）

关于 MrScraper

--- name: mrscraper description: Run AI-powered, unblockable web scraping, data extraction with natural language via the MrScraper API tags: [scraping, data-extraction, web-crawling, stealth-browser, web-automation]

homepage: https://mrscraper.com/ vendor: MrScraper support_email: [email protected]

required_env_vars: [MRSCRAPER_API_TOKEN] primary_credential: MRSCRAPER_API_TOKEN

metadata: {"openclaw":{"requires":{"env":["MRSCRAPER_API_TOKEN"]},"primaryEnv":"MRSCRAPER_API_TOKEN"}}

network: {"allowed_hosts":["api.mrscraper.com","api.app.mrscraper.com","sync.scraper.mrscraper.com"]} ---

MrScraper

Run AI-powered, unblockable web scraping, data extraction with natural language via the MrScraper API

Actions

This skill supports:

Opening blocked pages through unblocker (stealth browser + IP rotation)
Starting AI scraper runs from natural-language instructions
Rerunning existing scraper configurations on one or multiple URLs
Running manual workflow-based reruns
Fetching paginated results and detailed results by ID

This skill is API-only and does not depend on bundled local scripts.

Base URLs

Unblocker API: https://api.mrscraper.com
Platform API: https://api.app.mrscraper.com

Authentication

Unblocker API auth

Use query-param auth on unblocker endpoint:

token=

Platform API auth

Use header-based auth on platform endpoints:

x-api-token: <MRSCRAPER_API_TOKEN>
accept: application/json
content-type: application/json

How to get `MRSCRAPER_API_TOKEN`?

An API token lets your applications securely interact with MrScraper APIs and rerun scrapers created in the dashboard.

Follow these steps in the dashboard:

Click your User Profile at the top-right corner.
Select API Tokens.
Click New Token.
Enter a name and set an expiration date.
Click Create.
Copy the new token and store it securely as MRSCRAPER_API_TOKEN.
Use it in requests through the x-api-token header.

Security rule:

Never expose tokens in client-side code (browser/mobile app bundles).
Store tokens in environment variables or server-side secret managers.

Notes from the auth docs:

The API key works for all V3 Platform endpoints.
The same key can be used for endpoints on sync.scraper.mrscraper.com.
For access to endpoints on other hosts, contact [email protected].

Install and Runtime

No local install step is required by this skill document.
No bundled scripts/ are required.
Calls are direct HTTPS requests to the two base URLs above.

Data and Scope

Data is sent only to api.app.mrscraper.com and api.mrscraper.com.
Responses may contain extracted page content and scrape metadata.
This skill does not define hidden persistence or background jobs.
Never expose tokens in logs, commits, or output.

Endpoints

1. Unblocker

Method: GET
URL: https://api.mrscraper.com
Auth: token query parameter

Opens a target URL through stealth browsing and IP rotation, then returns HTML. Use this when direct access is blocked by captcha or anti-bot protections.

Query parameters:

| Field | Type | Required | Default | Description | | ---------------- | --------- | -------- | ------- | --------------------------------------- | | token | string | Yes | — | Unblocker token (MRSCRAPER_API_TOKEN) | | url | string | Yes | — | URL-encoded target URL | | timeout | number | No | 60 | Max wait in seconds (example 120) | | geoCode | string | No | None | Geographic routing code (example SG) | | blockResources | boolean | No | false | Block non-essential resources |

Request example:

curl --location 'https://api.mrscraper.com?token=<MRSCRAPER_API_TOKEN>&timeout=120&geoCode=SG&url=https%3A%2F%2Fwww.lazada.sg%2Fproducts%2Fpdp-i111650098-s23209659764.html&blockResources=false'

Response example:

<!doctype html>
<html>
  <head>...</head>
  <body>...</body>
</html>

Notes:

Prefer explicit geoCode and practical timeouts for repeatable behavior.
Only pass cookies when session-specific content is required.

2. Create AI Scraper

Method: POST
Host: https://api.app.mrscraper.com
Path: /api/v1/scrapers-ai
Auth: x-api-token

Create a new AI scraper run from natural-language instructions.

Payload parameters (for `agent`: `general` or `agent`: `listing`):

| Field | Type | Required | Default | Description | | -------------- | -------- | -------- | -------- | ---------------------------------------------------------- | | url | string | Yes | — | Target URL | | message | string | Yes | — | Extraction instruction | | agent | string | No | general | The AI agent type to use for scraping: general, listing, or map | | proxyCountry | string | No | None | ISO country code for proxy-based scraping |

Payload parameters (for `agent`: `map`):

| Field | Type | Required | Default | Description | | ----------------- | -------- | -------- | --------- | ------------------------------------------------------------------------------------------------------------- | | url | string | Yes | — | Target URL | | agent | string | No | map | The AI agent type to use for scraping (for this case it is map) | | maxDepth | number | No | 2 | Maximum depth level for crawling links from the starting URL.
0 = only the starting URL, 1 = +direct links | | maxPages | number | No | 50 | Maximum number of pages to scrape during the crawling process. | | limit | number | No | 1000 | Maximum number of data records to extract across all pages. Scraping stops when this limit is reached. | | includePatterns | string | No | "" | Regex patterns to include (separate multiple with \|\|) | | excludePatterns | string | No | "" | Regex patterns to exclude (separate multiple with \|\|) |

Request example:

curl -X POST "https://api.app.mrscraper.com/api/v1/scrapers-ai" \
  -H "x-api-token: <MRSCRAPER_API_TOKEN>" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html",
    "message": "Extract title, price, stocks, and rating",
    "agent": "general"
  }'

Response example:

{
  "id": "497f6eca-6276-4993-bfeb-53cbbbba6f08",
  "createdAt": "2019-08-24T14:15:22Z",
  "createdById": "e13e432a-5323-4484-a91d-b5969bc564d9",
  "updatedAt": "2019-08-24T14:15:22Z",
  "updatedById": "d8bc6076-4141-4a88-80b9-0eb31643066f",
  "deletedAt": "2019-08-24T14:15:22Z",
  "deletedById": "8ef578ad-7f1e-4656-b48b-b1b4a9aaa1cb",
  "userId": "2c4a230c-5085-4924-a3e1-25fb4fc5965b",
  "scraperId": "6695bf87-aaa6-46b0-b1ee-88586b222b0b",
  "type": "AI",
  "url": "http://example.com",
  "status": "Finished",
  "error": "string",
  "tokenUsage": 0,
  "runtime": 0,
  "data": {}, // MAIN SCRAPED DATA
  "htmlPath": "string",
  "recordingPath": "string",
  "screenshotPath": "string",
  "dataPath": "string"
}

Notes:

...

Prompt 示例

安装 MrScraper 后，可以对 AI 说这些话来触发它

U

Help me get started with MrScraper

A

Explains what MrScraper does, walks through the setup, and runs a quick demo based on your current project

U

Use MrScraper to run AI-powered, unblockable web scraping, data extraction with natu...

A

Invokes MrScraper with the right parameters and returns the result directly in the conversation

U

What can I do with MrScraper in my data & analytics workflow?

A

Lists the top use cases for MrScraper, with example commands for each scenario

常见问题

如何安装 MrScraper？▾

将技能文件夹放到 ~/.claude/skills/mrscraper/ 目录（个人级，所有项目可用），或 .claude/skills/mrscraper/（项目级）。重启 AI 客户端后，用 /mrscraper 主动调用，或让 AI 根据上下文自动发现并使用。

MrScraper 支持哪些 AI 平台？▾

MrScraper 支持 Claude、Cursor、OpenClaw，可与这些 AI 平台无缝集成，扩展其能力。

MrScraper 是免费的吗？▾

MrScraper 可免费安装使用。请查阅仓库了解许可证信息。

MrScraper 有什么功能？▾

Run AI-powered, unblockable web scraping, data extraction with natural language via the MrScraper API

MrScraper 属于哪个分类？▾

MrScraper 属于「Data & Analytics」分类，该分类的技能帮助 AI 智能体在此领域执行专业任务。

使用场景

Getting Started with MrScraper→Automate Data & Analytics Workflows with MrScraper→Team Collaboration with MrScraper→

MrScraper

安装

关于 MrScraper

MrScraper

Actions

Base URLs

Authentication

Unblocker API auth

Platform API auth

How to get `MRSCRAPER_API_TOKEN`?

Install and Runtime

Data and Scope

Endpoints

1. Unblocker

Query parameters:

Request example:

Response example:

Notes:

2. Create AI Scraper

Payload parameters (for `agent`: `general` or `agent`: `listing`):

Payload parameters (for `agent`: `map`):

Request example:

Response example:

Notes:

Prompt 示例

常见问题

使用场景

同类技能推荐

Weather

Multi Search Engine

Tavily 搜索

Baidu web search

MrScraper

安装

关于 MrScraper

MrScraper

Actions

Base URLs

Authentication

Unblocker API auth

Platform API auth

How to get MRSCRAPER_API_TOKEN?

Install and Runtime

Data and Scope

Endpoints

1. Unblocker

Query parameters:

Request example:

Response example:

Notes:

2. Create AI Scraper

Payload parameters (for agent: general or agent: listing):

Payload parameters (for agent: map):

Request example:

Response example:

Notes:

Prompt 示例

常见问题

使用场景

同类技能推荐

Weather

Multi Search Engine

Tavily 搜索

Baidu web search

How to get `MRSCRAPER_API_TOKEN`?

Payload parameters (for `agent`: `general` or `agent`: `listing`):

Payload parameters (for `agent`: `map`):