mcpcheck · nightly checks for MCP publishers
Your server broke on Windows, in Cursor, or on OAuth refresh last night. We tell you before your users do.
Enroll a remote Streamable HTTP URL or an npx/uvx package. Every night we clean-install it on three operating systems, connect with the clients your users run, check OAuth end to end, diff the tool catalog and score error messages — then put a badge on your README that says exactly what passed.
Badge example: 
What runs every night
Fresh npm/uv cache on GitHub-hosted Windows, macOS and Linux runners; spawn over stdio (or connect to your URL), initialize, tools/list. The Windows npx ENOENT that broke six official plugins shows up here first.
Official TypeScript and Python SDK clients at the current and previous minor, plus a scripted Claude Code connection check. Cursor and VS Code embed the TypeScript client, so the badge says what actually works.
401 challenge, protected-resource metadata, authorization-server metadata, PKCE S256, dynamic client registration, refresh grant, resource indicator — each failure with the fix in plain English. Live refresh when you give us a refresh token.
tools/list hashed every run and diffed against your baseline: removed tools, renamed arguments, tightened schemas, changed descriptions. Rug-pull watch for your own server, alerted by email/Slack/Discord.
10 malformed inputs per tool, every error graded on code · cause · fix · retryable. The one place we use an LLM (≤ $0.02 per server per run); the score is on the report.
CLI paths only — no GUI automation. Results on a no-JavaScript report page, report.json, trust.json and the badge. Runner: public GitHub Actions repo agentwares/runner.
Pricing — per server
- one full baseline run
- public report + badge
- no schedule, no alerts
- weekly runs
- clean install matrix
- catalog diff
- badge
- 30-day history · alerts
- nightly runs
- clean install matrix
- catalog diff
- badge
- client compat matrix
- oauth conformance
- error ergonomics
- 90-day history · alerts
Machine-readable: /mcpcheck/pricing.json · for agents: /mcpcheck/llms.txt. Test mode until launch.