Scrape-LE

io.github.nolindnaidoo/scrape-le · v2.4.0

Analyse robots.txt content and report whether a path may be crawled.

Install

npx -y scrape-le-mcp

Typical command from the package name. Check the README for required configuration and credentials before connecting it to real data.

Signals

GitHub stars	1
npm weekly downloads	265
Last push	2d ago
Licence	MIT
Open issues	0
SECURITY.md	No
Language	TypeScript
Latest version published	2026-10-07

Signals captured from GitHub, npm and the official MCP Registry on October 15, 2026. See the scoring method.