← Back to all tags

web-crawler Servers

9 servers tagged with "web-crawler"

Mcp Server Webcrawl

MCP server tailored to connecting web crawler data and archives

Search & Retrievalunknown

Infomesh

🕸️ Fully decentralized P2P search engine for LLMs — no API key, no billing, forever free. MCP-native web search via Kademlia DHT + libp2p + FTS5. Production stable ✅ → pip install infomesh

Developer ToolsMIT

Anycrawl Mcp Server

AnyCrawl MCP Server, with Scrape, Crawl and SERP.

Search & Retrievalunknown

Librecrawl Technical Seo Audit Mcp

Open-source self-hosted technical SEO audit MCP server built on the LibreCrawl engine. Runs full audits inside Claude, Cursor, or Codex — 37 tools, 50+ checks per audit (hreflang, schema.org Rich Results, security headers, image performance, WAF detection on 200-OK pages), chunke

Search & Retrievalunknown

Web Scout Mcp Suebksnn

A powerful MCP server extension providing web search and content extraction capabilities. Integrates DuckDuckGo search functionality and URL content extraction into your MCP environment, enabling AI assistants to search the web and extract webpage content programmatically.

Search & RetrievalMIT license

Crawlinx Mcp

Free technical-SEO audit MCP server for AI agents — crawl, 154 checks, LLM-ready reports. Hosted at crawlinx.com, no signup/API key.

Search & Retrievalunknown

Langgraph Crawler Mcp

高等级的免费爬虫MCP, 完全 Markdown 化支持,支持微信公众号等一大批国内网站。A powerful web crawler designed specifically for LLM applications, capable of extracting clean, readable content from various web pages and converting it to Markdown format. This tool is essential for building knowledge bases, training

Search & Retrievalunknown

Mcp Web Search Crawl

A lightweight MCP server for web searching via DuckDuckGo and extracting page content as Markdown.

Search & Retrievalunknown

Driflyte Mcp Server

MCP Server for Driflyte (https://console.driflyte.com).

Developer Toolsunknown