Home › Browser & Web Automation › Crawlerpeek

Crawlerpeek

MCP serverFreshBrowser & Web Automation Developer Tools Maps & LocationNode.js

Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.

Health check

Freshness	Fresh Activity in the last 30 days
Last activity	2026-10-25 (2 days ago)
Last commit (default branch)	needs authenticated refresh
Last push (any branch)	2026-10-25
GitHub stars	3
Star velocity	1.5 stars/day since creation
Forks	0
License	MIT
Archived	No
npm package	`crawlerpeek` v0.2.0
npm last publish	2026-10-25
npm downloads (last week)	1,000
MCP Registry name	`io.github.crawlerpeek/crawlerpeek`
Registry status	active
Registry version	0.2.0
Registry last update	2026-10-25

Checked automatically on 2026-10-28. Sources: official-mcp-registry. How we check.

Install

npx -y crawlerpeek

Command derived from the published package name. Check the project README for required config and environment variables.

Topics

ai-crawlersclaudebotcligeogithub-actiongptbotmcp-servermodel-context-protocolperplexitybotrobots-txtseoweb-crawler

Links

Source repository ↗
Website ↗
npm ↗

Maintain this project?Claim the listing to fix details, or feature it at the top of Browser & Web Automation for 30 days.Feature it · $49 Request an update (free)

Related in Browser & Web Automation

MCP serverFreshrepo ★ 92k

fetch (reference server)

A Model Context Protocol server that provides web content fetching capabilities. This server enables LLMs to retrieve and process content from web pages, converting HTML to markdown for easier consumption.

Browser & Web AutomationFiles & DocumentsPython

MCP serverFresh★ 90k