Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
Scrapling MCP server enables AI assistants like Claude and Cursor to scrape web content through standardized tools that handle HTTP requests, browser automation, and stealth fetching with Cloudflare bypass. The server provides session-based and one-shot scraping tools that narrow pages using CSS selectors and strip prompt-injection content before sending data to the AI. It includes screenshot capabilities, remote browser connections over CDP, and secure HTTP transport, allowing agents to extract structured web data without writing custom scraping code.
Key Features
Use Cases
- 01Enable AI coding assistants to scrape documentation sites and extract API reference data
- 02Allow chatbots to fetch real-time product information from e-commerce sites with anti-bot protection
- 03Give agents the ability to monitor competitor websites and extract pricing information
- 04Automate data collection from JavaScript-heavy sites requiring browser automation
- 05Extract structured content from protected pages with Cloudflare for AI analysis
- 06Build AI agents that can navigate multi-page forms and gather session-based data
Related MCP Servers
View moremarkitdown
Python tool for converting files and office documents to Markdown.
firecrawl
The context API to search, scrape, and interact with the web at scale. 🔥
prompts.chat
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.
langflow
Langflow is a powerful tool for building and deploying AI-powered agents and workflows.
Scrapling — FAQ
What is the Scrapling MCP server?+
It's a Model Context Protocol server that gives AI assistants like Claude and Cursor the ability to scrape websites through standardized tools covering HTTP requests, browser automation, and stealth fetching with built-in anti-bot bypass.
How do I install and connect the Scrapling MCP server?+
Install with 'pip install scrapling[ai]' and 'scrapling install', then add the server configuration to your MCP client's config file (e.g., Claude Desktop's claude_desktop_config.json) pointing to the Scrapling MCP server executable.
Which AI clients work with the Scrapling MCP server?+
The server works with any MCP-compatible client including Claude Desktop, Cursor, and other editors that support the Model Context Protocol. A demo video shows it working with Claude.
Do I need API keys or proxy services to use Scrapling MCP?+
No API keys are required for basic functionality. However, for bypassing advanced bot protection or accessing geo-restricted content, you may optionally configure proxy services.
Is the Scrapling MCP server free to use?+
Yes, Scrapling is open-source under the BSD-3-Clause License and free to use. The MCP server feature is included when you install the 'ai' extra package.
What prerequisites are needed to run the MCP server?+
You need Python 3.10 or higher and must install browser dependencies with 'scrapling install' after installing the package with the 'ai' extra to enable browser-based and stealth fetching tools.
How do I install Scrapling?+
Open the source repository on GitHub and follow its README. Scrapling is a mcp server — MCP Agents Market links you directly to the official repo.
Is Scrapling free?+
Scrapling is an open-source project hosted on GitHub. Check the repository for its license and any usage requirements.