web MCP Server
MCP server for Robot Resources Scraper — web content to clean markdown with median 91% token reduction
Discovered via github-topic:model-context-protocol and last synced 4mo ago.
1. Install the package
npx @robot-resources/scraper-mcp
2. Add to claude_desktop_config.json
{
"mcpServers": {
"-robot-resources-scraper-mcp": {
"command": "npx",
"args": [
"@robot-resources/scraper-mcp"
]
}
}
}Config file location: ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) / %APPDATA%\Claude\claude_desktop_config.json (Windows)
string
Max pages to crawl (1-100)
Per-page timeout in milliseconds
Max link depth (0-5)
number
Max retry attempts (0-10)
string[]
string[]
Type
Description
string
number
How
number
number
Use when running OpenCLI commands to interact with websites (Bilibili, Twitter, Reddit, Xiaohongshu, etc.), desktop apps (Cursor, Notion), or public APIs (HackerNews, arXiv). Covers installation, command reference, and output formats for 87+ adapters.
AI-optimized web search via Tavily API. Returns concise, relevant results for AI agents.
MUST use for ANY PDF or image format conversion task — converting PDF and images (JPG/JPEG/PNG/BMP/TIFF/TIF/WEBP/JPEG2000) to 10 formats (Word, Excel, PPT, H...
Unified multi-provider web search and URL extraction skill with intelligent auto-routing across Serper, Brave, Tavily, Querit, Linkup, Exa, Firecrawl, Perple...
Learn how to use the Web Monitor Claude skill. Complete guide with installation instructions and examples.
Learn how to use the Event-Watcher Claude skill. Complete guide with installation instructions and examples.
Learn how to use the Agent Onboarding Claude skill. Complete guide with installation instructions and examples.