robotsgate

Level FSource

robots.txt generator, validator and checker for AI crawlers (GPTBot, ClaudeBot and more). API + MCP server.

⭐ 0Browser AutomationJavaScriptRepo ↗Updated 2026-10-18

Installation

View source repo →

Related servers

checkdigitSame author⭐ 0 · Search & InfoOffline check-digit validation API + MCP server for IBAN, BIC, EU VAT, GTIN/EAN/linkpulseSame author⭐ 0 · DevOps & DeploymentBroken link checker API + MCP server: checks one page for dead links, redirect cbrowser-use⭐ 120.1k · Browser AutomationBrowser agents and stealth cloud browsers for AI: run web tasks, fill forms, extScrapling⭐ 97.7k · Browser Automation🕷️ The BEST Web Scraping framework that handles everything from a single requestChrome DevTools MCP⭐ 54.9k · Browser Automation谷歌官方：让 AI 操控 Chrome——页面操作、Lighthouse 性能分析、网络监控、控制台日志UI-TARS-desktop⭐ 39.6k · Browser AutomationThe Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and