by 0xMassi · 0xMassi/webclaw
Rust-fast local scraping and structured extraction — pull a page, get cleaned markdown + structured fields without sending the URL to a third party.
WebClaw is a local-first web-content extractor: scrape, crawl, parse readability, extract structured fields, all in a single Rust binary. Use it when you don't want pages going through a SaaS scraper.
%APPDATA%\Claude\claude_desktop_config.json{
"mcpServers": {
"webclaw-mcp": {
"command": "npx",
"args": [
"-y",
"webclaw-mcp"
]
}
}
}Open Claude Desktop → Settings → Developer → Edit Config. Restart after saving.
{
"mcpServers": {
"webclaw-mcp": {
"command": "npx",
"args": [
"-y",
"webclaw-mcp"
]
}
}
}Cursor uses the same mcpServers schema as Claude Desktop. Project config wins over global.
{
"mcpServers": {
"webclaw-mcp": {
"command": "npx",
"args": [
"-y",
"webclaw-mcp"
]
}
}
}Click the MCP Servers icon in the Cline sidebar, then "Edit Configuration".
{
"mcpServers": {
"webclaw-mcp": {
"command": "npx",
"args": [
"-y",
"webclaw-mcp"
]
}
}
}Same shape as Claude Desktop. Restart Windsurf to pick up changes.
{
"mcpServers": [
{
"name": "webclaw-mcp",
"command": "npx",
"args": [
"-y",
"webclaw-mcp"
]
}
]
}Continue uses an array of server objects rather than a map.
{
"context_servers": {
"webclaw-mcp": {
"command": {
"path": "npx",
"args": [
"-y",
"webclaw-mcp"
]
}
}
}
}Add to context_servers. Zed hot-reloads on save.
claude mcp add webclaw-mcp -- npx -y webclaw-mcpOne-liner. Verify with claude mcp list. Remove with claude mcp remove.
When to use: NDA or compliance limits SaaS scrapers.
Outcome: Page content available to Claude without third-party scraper.
Save extracted markdown for downstream RAG
| Tool | Inputs | When to call | Cost |
|---|---|---|---|
| fetch | (see docs) | Pull a URL as cleaned markdown | 1 call |
| extract | (see docs) | Apply a schema to extract structured fields | 1 call |
| crawl | (see docs) | Walk a site with depth limits | 1 call |
scrape paywalled / login-required content as agentBlocked by siteTry --respect-robots false only on your own sites
| Alternative | When to use it instead | Tradeoff |
|---|---|---|
| firecrawl-mcp | You want managed SaaS | Pages go through Firecrawl |