Scrapling

Level ALocal

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

Overview

Scrapling is a Python web scraping framework combining fast HTTP requests, stealth browsers, JavaScript rendering, parsing, and concurrent crawling. It supports CSS/XPath selection, proxy rotation, retries, pause/resume, and JSON/JSONL/CSV/XML exports, plus an MCP server and Agent Skill for AI agents to browse and extract data—from a single page to a full crawl.

⭐ 104.6kBrowser AutomationPythonRepo ↗Updated 2026-11-17

Installation

MCP client config (paste into mcp.json)

{
  "mcpServers": {
    "scrapling": {
      "command": "scrapling-mcp",
      "args": []
    }
  }
}

Agent install prompt

Copy and paste into Cursor / Claude / other agents to install this MCP for you

Please read this MCP repository and install it into my current environment:
https://github.com/D4Vinci/Scrapling

Known working client config (can write into mcp.json):
{
  "mcpServers": {
    "scrapling": {
      "command": "scrapling-mcp",
      "args": []
    }
  }
}

Please: 1) check README for deps and env vars; 2) write config for my client; 3) if secrets are missing, tell me what to fill — do not invent values.

Related servers