web MCP Server
MCP server for web scraping — extract clean markdown, links, metadata from any URL
Discovered via unknown and last synced 3mo ago.
1. Install the package
npx -y mcp-server-scraper
2. Add to claude_desktop_config.json
{
"mcpServers": {
"mcp-server-scraper": {
"command": "npx",
"args": [
"mcp-server-scraper"
]
}
}
}Config file location: ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) / %APPDATA%\Claude\claude_desktop_config.json (Windows)
Batch scrape multiple URLs, get title + excerpt per URL
Extract clean text content from a URL (Readability-powered)
Get title, description, OG tags, canonical, favicon
Search for a query string within the page, return matching lines
Get all links with href and anchor text
What it does
Use when running OpenCLI commands to interact with websites (Bilibili, Twitter, Reddit, Xiaohongshu, etc.), desktop apps (Cursor, Notion), or public APIs (HackerNews, arXiv). Covers installation, command reference, and output formats for 87+ adapters.
AI-optimized web search via Tavily API. Returns concise, relevant results for AI agents.
MUST use for ANY PDF or image format conversion task — converting PDF and images (JPG/JPEG/PNG/BMP/TIFF/TIF/WEBP/JPEG2000) to 10 formats (Word, Excel, PPT, H...
Unified multi-provider web search and URL extraction skill with intelligent auto-routing across Serper, Brave, Tavily, Querit, Linkup, Exa, Firecrawl, Perple...
Learn how to use the Web Monitor Claude skill. Complete guide with installation instructions and examples.
Learn how to use the Event-Watcher Claude skill. Complete guide with installation instructions and examples.
Learn how to use the Agent Onboarding Claude skill. Complete guide with installation instructions and examples.