MCP Servers / web-scraping / Open Crawler MCP Server

Open Crawler MCP Server

JSON →
none★ 1web-scraping

A web crawler and text extractor with robots.txt compliance, rate limiting, and page size protection.

github ↗
Install
How to run this server

No install command recorded.

server path: open-crawler-mcp-server
Tools
What this server exposes
crawl
Crawl a website starting from a given URL, following links up to a specified depth and page limit.
search
Search the web using a query string and return relevant results.
extract
Extract structured data from a web page using CSS selectors or XPath expressions.
Configuration
Environment & auth
authnone
Resources
githubhttps://github.com/naoto24kawa/open-crawler-mcp-server ↗
Open Crawler MCP Server — MCP Server · libregistry