Scrapling
Level ALocal🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Overview
Scrapling is a Python web scraping framework combining fast HTTP requests, stealth browsers, JavaScript rendering, parsing, and concurrent crawling. It supports CSS/XPath selection, proxy rotation, retries, pause/resume, and JSON/JSONL/CSV/XML exports, plus an MCP server and Agent Skill for AI agents to browse and extract data—from a single page to a full crawl.
Installation
MCP client config (paste into mcp.json)
{
"mcpServers": {
"scrapling": {
"command": "scrapling-mcp",
"args": []
}
}
}Agent install prompt
Copy and paste into Cursor / Claude / other agents to install this MCP for you
Please read this MCP repository and install it into my current environment:
https://github.com/D4Vinci/Scrapling
Known working client config (can write into mcp.json):
{
"mcpServers": {
"scrapling": {
"command": "scrapling-mcp",
"args": []
}
}
}
Please: 1) check README for deps and env vars; 2) write config for my client; 3) if secrets are missing, tell me what to fill — do not invent values.
Related servers
Chrome DevTools MCP谷歌官方:让 AI 操控 Chrome——页面操作、Lighthouse 性能分析、网络监控、控制台日志UI-TARS-desktopThe Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models andPlaywright MCP微软出品的浏览器自动化工具,用结构化快照操控网页:点击、填表、截图、抓取,无需视觉模型cuaScale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmagpt-researcherAn autonomous agent that conducts deep research on any data using any LLM provideditorOpen-source 3D architecture software for AECO, scan-to-BIM. Agent-friendly, brow