clerk.com
Ready with a few material gaps
Task
What does clerk.com do and who is it for? Explain it back to me.
Critical access needs attention
These checks describe whether an ordinary agent can enter, read, and operate the public site.
- 2 / 2 passed
Agents can reach the site
Crawler access and bot defenses.
- 1 / 2 passed
Core content is available
Useful content remains accessible without a fragile browser-only path.
- 1 / 2 passed
Navigation fails safely
Redirects and missing pages give agents a recoverable path.
- 2 / 2 passed
Controls are understandable
Forms and interactive controls expose usable names and structure.
Evaluated surfaces have material gaps
The public website is always evaluated. Optional surfaces appear when the scan finds positive evidence that they apply.
Public website
Ready with gaps
10 of 18 mature checks passed
API
Needs work
5 of 9 mature checks passed
Authentication
Strong
2 of 3 mature checks passed
MCP
Blocked
0 of 3 mature checks passed
Fix these gaps first
Critical access gaps come first, followed by other applicable readiness gaps.
- 01Critical access
Agent-friendly 404s
Return a real HTTP 404 (or 410) status for nonexistent paths - never a 200 with your app shell, which makes agents believe every path exists. For full credit, give the 404 response a short markdown body pointing agents at your sitemap, llms.txt, or docs index. Verify with
curl -s -o /dev/null -w "%{http_code}" https://yourdomain.com/some-path-that-does-not-exist- it must print 404. - 02Critical access
Content without JavaScript
Server-side render your homepage so AI crawlers see meaningful content without JavaScript. Ensure an H1 and 500+ chars of text in raw HTML.
- 03Other readiness checks
OpenAPI spec published
Publish an OpenAPI (Swagger) specification at /openapi.json or /api/openapi.yaml. This is how agents understand your API surface automatically.
- 04Other readiness checks
MCP resources exposed
If your MCP server advertises the resources capability in its initialize handshake, make sure resources/list returns at least one resource. If you don't intend to expose resources, omit the capability - the check returns na with no penalty for tool-only servers. Quality of the resources you do return is scored separately by mcp-resource-quality.
- 05Other readiness checks
OAuth 2.0 support
Implement OAuth 2.0 for API authentication. Publish your authorization server metadata at /.well-known/oauth-authorization-server.
Audit the checks behind the score
Applicable evidence is grouped by how it contributes to this preview model. Bonus checks appear only when they add points.
Essential7 of 12 passed · 58.4 / 80 points
- Content without JavaScriptPartial (67%)
11351 chars with H1 but flat heading structure
Recommendation
Server-side render your homepage so AI crawlers see meaningful content without JavaScript. Ensure an H1 and 500+ chars of text in raw HTML.
- Not blocked by bot detectionPassed
Site accessible to 6 AI agent user-agents
Recommendation
Allowlist known AI agent User-Agents (ChatGPT-User, ClaudeBot, Google-Extended, DeepSeekBot) in your WAF or bot-detection rules.
- Redirect hygienePassed
No meta-refresh stubs, JavaScript-redirect stubs, or cross-domain hops across 6 checked pages
Recommendation
Replace meta-refresh and JavaScript-only redirects with real HTTP 301/302 redirects. Non-JS agents never execute
location.hrefor wait for a meta refresh - they see only the stub page. Verify withcurl -sI <url>- you should see a Location header, not a 200 with a near-empty body. - Content behind authPassed
All 5 sampled pages are publicly readable (5 with substantive content)
Recommendation
Serve your content pages without a login wall. Agents cannot complete auth flows while browsing - a 401/403 or a login-form page is invisible content. Keep public documentation public; if some content must stay gated, publish an ungated summary so agents can still represent it.
- OpenAPI spec publishedFailed
No OpenAPI/Swagger specification found
Recommendation
Publish an OpenAPI (Swagger) specification at /openapi.json or /api/openapi.yaml. This is how agents understand your API surface automatically.
- Markdown content negotiation (acceptmarkdown.com)Passed
Canonical URL serves text/markdown and text/html via Accept negotiation with Vary: Accept
Recommendation
On the responses that serve text/markdown via Accept negotiation, add Accept to the Vary header (Vary: Accept, Accept-Encoding). Without it, CDNs can serve the cached HTML variant to an agent asking for markdown (or vice versa), depending on which variant landed in cache first.
- Agent crawler reachabilityPassed
Reachable to all major AI crawlers - ChatGPT-User: reachable, ClaudeBot: reachable, Google-Extended: reachable, ora-agent: reachable, DeepSeekBot: reachable
Recommendation
Verify that major agent User-Agents can reach the homepage. If your WAF or bot rules block them, remove or narrow the blocking rule. Add an allow rule only when your security setup denies them by default.
- OAuth 2.0 supportPartial (60%)
OAuth mentioned in documentation at https://clerk.com but no OAuth or OpenID Connect endpoint responded
Recommendation
Implement OAuth 2.0 for API authentication. Publish your authorization server metadata at /.well-known/oauth-authorization-server.
- Scoped permissionsPassed
Scoped permissions documented at /docs
Recommendation
Support scoped API permissions (OAuth scopes or API key roles) so agents can request only the access they need.
- JSON error responsesPassed
API returns JSON error responses (401 at https://api.clerk.com/v1/orank-probe-test)
Recommendation
Return structured JSON error responses with error codes, messages, and resolution hints. Agents can't parse HTML error pages.
- MCP resources exposedFailed
MCP server found but connection failed - cannot list resources
Recommendation
If your MCP server advertises the resources capability in its initialize handshake, make sure resources/list returns at least one resource. If you don't intend to expose resources, omit the capability - the check returns na with no penalty for tool-only servers. Quality of the resources you do return is scored separately by mcp-resource-quality.
- Agent-friendly 404sPartial (50%)
Nonexistent paths return a real HTTP 404. For full credit, include a short markdown body (site map links, where to look next) so agents can recover.
Recommendation
Return a real HTTP 404 (or 410) status for nonexistent paths - never a 200 with your app shell, which makes agents believe every path exists. For full credit, give the 404 response a short markdown body pointing agents at your sitemap, llms.txt, or docs index. Verify with
curl -s -o /dev/null -w "%{http_code}" https://yourdomain.com/some-path-that-does-not-exist- it must print 404.
Recommended10 of 21 passed · 13.2 / 20 points
- Developer resource discoverabilityPartial (17%)
Agent struggled to find developer resources by name - only 1 result(s) out of 10. Not found via search: OpenAPI spec
Recommendation
Make your developer resources (API docs, OpenAPI spec, auth docs, webhooks, MCP server) discoverable by name. Publish them at predictable URLs, list them in llms.txt, and include your product name in page titles and headings so search engines surface them for name-based queries.
- Brand name discoverabilityPartial (67%)
clerk.com appears 2 times in brand-name search results for "Clerk identity auth" (top position: #8)
Recommendation
Make sure a clean search for your brand name returns your own domain in the top results. If it does not, your brand may be too generic, conflict with a more established term, or not yet indexed. Strengthen brand-name search by claiming consistent NAP across listings, earning press mentions that link to the canonical domain, and avoiding redirect chains that mask the apex domain in search results.
- Sitemap existsPassed
Valid sitemap found at https://clerk.com/sitemap.xml with 3155 entries
Recommendation
Add a valid XML sitemap at /sitemap.xml listing all indexable URLs. Include lastmod dates and keep it under 50MB.
- Content efficiencyPartial (50%)
Low content efficiency: 1.16% - most of the page is markup, not content
Recommendation
Reduce markup overhead so readable text is at least 5% of your HTML. Strip unused inline scripts/styles, server-render content instead of shipping large JSON hydration blobs, and keep wrapper nesting shallow.
- JSON-LD structured dataPartial (50%)
JSON-LD has Organization type but missing key fields (name, description)
Recommendation
Add JSON-LD structured data to your homepage using the identity type that matches your site - SoftwareApplication for products, Organization or LocalBusiness for companies, Person for personal sites, Article for blogs - with name, description, url, and type-appropriate fields (offers, sameAs, author) so AI can parse your identity programmatically.
- Public API/docs linked from homepagePassed
Documentation site found at https://clerk.com
Recommendation
Publish API documentation at a discoverable URL (/docs, /api, /developers). Include authentication, endpoints, and example requests.
- Agent instruction / when-to-usePartial (67%)
Agent instruction file at /.well-known/agent-skills/ but no explicit when-to-use guidance
Recommendation
Tell agents when to reach for you: add a 'when to use this' section to your llms.txt (or a dedicated agent-instructions file) that names your best-fit use cases and how an agent should call you. Be specific about the jobs you are right for - generic marketing copy does not read as guidance.
- Metadata completenessPassed
All metadata signals present: canonical URL, lang="en", og:image, og:type
Recommendation
Add all four signals to your homepage: , , , and . Agents use these for entity resolution and attribution.
- Organization schema completenessPartial (50%)
Organization schema found but missing: contactPoint, address
Recommendation
Add Organization JSON-LD that includes both contactPoint (with email/phone and contactType) and address (PostalAddress). This lets AI verify your business legitimacy and answer contact queries.
- Trust anchor pagesPassed
All trust anchor pages verified: About, Contact, Privacy
Recommendation
Publish real /about, /contact, and /privacy pages with at least 500 characters of content each. These are the pages AI agents check to verify your business is legitimate before recommending you.
- Page token budgetPassed
All 7 measured pages fit an agent context budget (largest ~6K tokens)
Recommendation
Keep each page's extracted text under ~100K characters (~25K tokens) so it fits an agent's context window without truncation. Split oversized reference pages into focused per-topic documents and link them from an index. Check a page with
curl -s <url> | wc -cand remember agents read the extracted text, not the raw HTML. - Code fence validityPassed
Code fences balanced across 1 markdown document
Recommendation
Close every fenced code block (``` or ~~~) in your served markdown. CommonMark treats everything after an unclosed fence as code, so an agent parsing the document silently loses the rest of it. Count fence lines per file - the total must be even.
- Developer portalPassed
Developer portal found at /docs
Recommendation
Create a developer portal at /developers with API keys, documentation, quickstart guides, and a sandbox environment.
- Public API with reachable endpointsPassed
REST API documentation found at https://clerk.com/docs/pinning.md. GraphQL endpoint at https://api.clerk.com/v1/graphql is reachable; introspection requires authentication (API key / OAuth), which is expected for agent access. Best-of-protocols score: 7/7.
Recommendation
Expose a public REST or GraphQL API. AI agents need programmatic access - not just a web UI - to integrate with your product.
- Agent onboarding frictionPassed
Low friction onboarding: free tier available, self-serve key generation, sandbox/test environment
Recommendation
Offer a free tier or trial, self-serve API key generation, and a sandbox environment. Agents can't fill out 'contact sales' forms.
- MCP server / manifestPartial (83%)
First-party MCP server published by product org (npm, @clerk/mcp-tools, 25485 score). Add live handshake at /.well-known/mcp for full credit.
Recommendation
Build an MCP (Model Context Protocol) server exposing your API as tools. Use Streamable HTTP transport for full score. This lets Claude, ChatGPT, and other AI agents call your product natively.
- Rate limit response headersFailed
GraphQL introspection auth-gated and no header convention documented on GraphQL-tagged pages
Recommendation
Return standard rate-limit headers on your API responses (the RFC RateLimit headers, plus Retry-After on a 429) so agents can self-throttle in real time, and document the conventions alongside your API.
- CLI tool availablePassed
CLI tool found on npm: clerk
Recommendation
Publish an official CLI tool on npm, PyPI, or Homebrew. A CLI lets agents and developers script interactions with your product without building API integrations from scratch.
- API schema complexity analysisFailed
GraphQL: introspection auth-gated and no schema evidence in docs
Recommendation
Make your API spec self-describing: a unique operationId and a description on every operation, typed parameters, and response schemas. For GraphQL, a fully typed schema with a documented cost or rate limit reads best.
- Function calling compatibilityFailed
No API spec found - function calling requires discoverable endpoints
Recommendation
Ensure API endpoints have unique operation IDs, typed schemas, and descriptions compatible with LLM function-calling formats.
- MCP resource qualityFailed
MCP server found but connection failed - cannot evaluate resource quality
Recommendation
Ensure every resource returned by resources/list reads cleanly via resources/read: declare a valid mimeType, return non-empty content, and make sure any URIs in the content resolve. Broken or empty resources break agent UX silently.
Bonus signals24 positive · +5 points
- Listed in MCP registriesPassed
Verified in 2 registries: Smithery (clerk) [verified-curation], npm (@clerk/mcp-tools) [npm-scope] - 407 agent uses, verified
Recommendation
Register your MCP server on Smithery (smithery.ai) or mcp.so so agent platforms can discover your tools. Link the registry entry from your homepage or docs for bi-directional verification.
- NPM/PyPI SDK packagePassed
NPM package found: clerk - "Clerk CLI"
Recommendation
Publish a JavaScript/TypeScript SDK package on npm so developers can integrate your API programmatically. In package.json set
repositoryto your source repo andhomepageto your product domain - these links are how agents confirm the package is your official SDK rather than a third-party tool with a similar name. - Listed on skills.shPassed
29 official skills published on skills.sh - 391,762 total installs (skills.sh/clerk)
Recommendation
Publish agent skills on skills.sh so AI agents can discover your product's capabilities. Create a SKILL.md in your GitHub repo and register it with 'npx skills add'. See skills.sh/docs.
- Registry brandingPartial (50%)
MCP manifest has name and description but no icon at /.well-known/mcp/server-card.json
Recommendation
Give your MCP server-card (at /.well-known/mcp/server-card.json) a display name, an icon or logo, and a description - all three together are what reads as a complete, branded listing agents can present.
- Agent discovery filePassed
Agent Skills index (agentskills.io) found at /.well-known/agent-skills/index.json with 20 skill(s)
Recommendation
Publish an Agent Skills index at /.well-known/agent-skills/index.json that lists your capabilities, with each skill carrying a name and a description so agents can find and parse what you offer.
- Agent Skills index conformance (v0.2.0)Passed
Index v0.2.0 conformant; verified SHA-256 of "clerk" (19 other skills present)
Recommendation
Upgrade /.well-known/agent-skills/index.json to the v0.2.0 schema: add "$schema": "https://schemas.agentskills.io/discovery/0.2.0/schema.json", and give every entry a type (skill-md or archive), url, and digest. Use "digest": "sha256:<64 lowercase hex chars>" (e.g. "digest": "sha256:a3f1...") - a bare "sha256": "" field is also accepted. Compute the value from the artifact's raw bytes.
- pricing.md existsPassed
Structured pricing.md found at /pricing.md (239 lines)
Recommendation
Create a /pricing.md file with your pricing tiers, features, and limits in plain markdown. This lets AI agents compare costs and recommend plans without scraping HTML pricing pages.
- MCP well-known discoveryPassed
MCP server discoverable via server-card.json at /.well-known/mcp/
Recommendation
Serve your MCP server at /.well-known/mcp, publish a server-card.json at /.well-known/mcp/server-card.json, or reference it in llms.txt so agents can discover it automatically without manual URL input.
- Markdown URL fallbackPassed
Full markdown fallback support. Homepage (https://clerk.com/index.md) and all 3 sampled content pages return markdown: https://clerk.com/docs.md, https://clerk.com/docs/cli.md, https://clerk.com/docs/expressjs/guides/ai/mcp/build-mcp-server.md
Recommendation
Let agents fetch markdown by appending .md to page URLs. Required for any credit: serve a markdown homepage at /index.md. For full credit (2/2): also serve a .md twin for each content page (e.g. /docs/auth -> /docs/auth.md). Content-Type should be text/markdown and the body should start with a top-level heading (not HTML).
- Sitemap freshness (lastmod)Passed
100% of 500 sampled sitemap entries carry lastmod; newest is 1 day(s) old
Recommendation
Add dates (W3C datetime, e.g. 2026-08-01) to your sitemap entries and update them when content actually changes. Aim for lastmod on at least half your entries with the newest within the last year. Verify with
curl https://yourdomain.com/sitemap.xml | grep lastmod. - llms.txt existsPassed
Found the llms.txt at https://clerk.com/llms.txt.
Recommendation
Create an llms.txt file at your domain root (/llms.txt) - the AI equivalent of robots.txt. Write at least 100 characters of real content: what your product is, what it does, and links to your key docs. Then verify it with
curl https://yourdomain.com/llms.txt- you should see your text, not HTML. If your app returns its homepage for every URL (common with single-page apps), add a static file route so the raw text is served. A placeholder with just a heading earns no credit. - llms.txt formattingPartial (50%)
The llms.txt is well-formatted with markdown links, but at 518,343 characters it exceeds the 30,000-character recommendation for a navigation index.
Recommendation
Format your llms.txt as a navigation index: start with a markdown heading, include markdown links to deeper resources, and keep it under 30,000 characters. If you have more to say, move long-form content into /llms-full.txt or per-section files (e.g. /docs/llms.txt, /api/llms.txt) and link to them from the main index.
- Skills.sh skill qualityPassed
Rich skills.sh presence - 29 skills, 391,762 installs. Agents can understand capabilities in depth
Recommendation
Expand your skills.sh presence with multiple skill repos covering different use cases. Add descriptive skill names, clear SKILL.md files, and organize by capability area.
- JSON-LD entity linking (sameAs)Passed
Strong entity linking via sameAs: github.com, linkedin.com
Recommendation
Add sameAs links in your JSON-LD structured data pointing to your Wikipedia page, Wikidata entry, GitHub org, and social profiles. This helps AI disambiguate your brand from similarly named entities.
- llms.txt links resolvePassed
All 5 probed llms.txt links resolve to real content
Recommendation
Make every link your llms.txt declares resolve to real content. Verify each one with
curl -L <url>- you should see the linked document, not your homepage. If your app returns the homepage shell for unknown paths (common with single-page apps), a 200 status is not proof: check the body. Fix or remove any dead link; agents that follow the index treat a broken link as a dead end. - API catalog (RFC 9727)Partial (50%)
api-catalog linkset[0] has no 'item' entries
Recommendation
Publish an API catalog at /.well-known/api-catalog per RFC 9727. Serve it with Content-Type: application/linkset+json;profile="https://www.rfc-editor.org/info/rfc9727" and include a 'linkset' array with item entries pointing to your OpenAPI specs and service descriptions.
- Markdown agent docsPassed
Path-suffix markdown docs served with text/markdown content-type: /index.md
Recommendation
Pick one: (a) return Content-Type: text/markdown on GET when the request sends Accept: text/markdown, or (b) publish a static /llms.md, /auth.md, or /agents.md file at your root with real markdown content. Option (b) is usually a single static file. This is the cold-discovery path for agents that land at your homepage from web search without reading llms.txt first.
- OAuth Protected Resource metadata (RFC 9728)Passed
RFC 9728 protected resource metadata found on MCP origin (resource=https://mcp.clerk.com/mcp)
Recommendation
Publish RFC 9728 protected-resource metadata at /.well-known/oauth-protected-resource. Include the resource field plus enough supporting metadata - your authorization servers, supported scopes, accepted bearer methods - that an agent can work out how to authenticate without first triggering a 401.
- Multi-language SDK packagesPartial (67%)
SDK found in npm, additional SDKs mentioned at https://clerk.com/index.md
Recommendation
Publish official SDK packages across multiple language ecosystems (npm, PyPI, Go modules, RubyGems). Auto-generate them from your OpenAPI spec using tools like openapi-generator. For each package set the project URL or homepage to your product domain (package.json
repository/homepage, PyPIHome-Pageorproject_urls, RubyGemshomepage_uri) - this is how agents verify the package is your official SDK. - MCP server-card.jsonPartial (50%)
MCP server card found at https://clerk.com/.well-known/mcp/server-card.json but missing fields: version
Recommendation
Publish a server card at /.well-known/mcp/server-card.json describing your MCP server. Required fields: name, description, version, serverUrl, tools[]. This lets agents preview your server before opening a transport connection.
- Native interactive controlsPassed
92 native controls, 1 non-native div-soup affordances (99% native).
- Accessible names on controlsPassed
92/92 interactive elements have a computable accessible name (100%).
- Accessibility-tree injection safety (bonus)Passed
No hidden instruction text detected in accessibility-tree attributes or off-screen content.
- A2UI / generative UI supportPassed
A2UI/generative UI references found at /docs (ui component)
Recommendation
Support Agent-to-UI rendering via MCP Apps (ui:// resources), OpenAI Apps SDK, or generative UI patterns that let agents render interactive UIs in conversation.
Inspect the underlying audit
The complete Ora audit uses evidence from the scan on . After applying changes, run another scan from the homepage to refresh these recommendations.
Sign me up for Vercel product updates and marketing emails.
Unsubscribe anytime. Privacy Notice
Source: Ora API
Snapshot 2026-08-21T23-58-47-438Z