Skip to content
CXVend

Crawler access checks for public websites.

Can search crawlers read your site?

See whether search crawlers can fetch your pages and read the static HTML. The free result is a random link. Paid checkout is not open.

Enter your URL. No sign-up. The free check usually finishes within a minute.

It reads public pages on our server. It does not ask a model any question.

See pricingHow we measure

Chrome extension pages

Paste the public URL. We detect whether crawlers can fetch that page and read its static HTML. We do not report who names the extension or which sources cite it.

The problem

  1. 01

    A crawler can be blocked before it reads anything.

    robots.txt or a firewall can return 403 to a search-crawler User-Agent while a browser still loads the page.

  2. 02

    Static HTML can be almost empty.

    If the words only appear after JavaScript runs, this check records the short text the first response actually contained.

  3. 03

    The paid buttons do not take payment.

    The $19 and $29 controls stay disabled until checkout is opened. The free check is the part that runs today.

How it works

  1. 01

    Enter your URL.

    We fetch the public homepage on our server. No account is required.

  2. 02

    We read robots.txt, then request the URL.

    The server fetches /robots.txt and the page with search-crawler and training-crawler User-Agents, and stores each HTTP status.

  3. 03

    We read the static HTML we got back.

    From that response we record title, meta description, noindex, nosnippet, sitemap, JSON-LD types, and text length. JavaScript is not executed.

  4. 04

    You get a random result link.

    The free result is /r/ plus an id. It is not listed. A paid record uses a different random token. An order id does not open it.

Pricing

All prices in USD. One-time payment. No subscription. No auto-renewal.

Free AI Visibility Check

$0Free

  • robots.txt rules for search crawlers and training crawlers, recorded separately
  • A live request with each crawler User-Agent, including HTTP 403 and 5xx
  • noindex, nosnippet, and static text length (JavaScript is not executed)
  • Title, meta description, sitemap.xml, and Organization / SoftwareApplication JSON-LD
  • llms.txt is noted and has no score weight
  • A 3-question model test is not part of this check. Mentions are not tested and are not scored.
  • A random /r/ result link. Anyone with the link can open it. It is not listed.
Run free check

AI Visibility Report

$19one-time

Everything in Free, plus:

  • Crawler, meta, and JSON-LD evidence for pages we actually fetch. Up to 10 pages can be inspected. Never more than 10, and 10 is a cap, not a promised count. One qualifying page is listed as one page.
  • Each priority includes the fetched URL and a verbatim excerpt. Items without that excerpt are omitted.
  • Model tests and citation checks are not tested and are not sold.
  • The customer page is /access/ plus a random token. Nothing is emailed.

Payment is not accepted on this site yet.

AI Visibility Report + Fix Pack

$29one-time

Everything in the Report, plus copy-paste files:

  • robots.txt.diff from the robots.txt we fetched
  • An Organization and SoftwareApplication candidate from the observed title, description, and URL
  • Priorities with the fetched URL and a verbatim excerpt
  • faqs.md only when a fetched page already contains that question

Payment is not accepted on this site yet.

Honest notes

  • No model sample.

    This version does not test mentions or citations. Those items are not in the score.

  • Crawlers are simulated.

    We send the crawler User-Agent strings ourselves. The vendor’s own crawler may be treated differently.

  • JavaScript is not run.

    Text length is the static HTML only. A client-rendered page can look shorter here than it does in a browser.

  • llms.txt has no weight.

    Finding llms.txt, or not finding it, does not change the score. We do not sell a draft of that file.

FAQ

Is this a subscription?
No. The $19 report and the $29 pack are one-time prices. Checkout is not open, so nothing can renew.
Do I need an account?
No. The free check needs only a public URL. The result link is a random id.
Do you ask a model about my site?
No. This version does not call a model. The check records crawler access and what is in the static HTML.
What is the $19 report?
The same crawler evidence on the pages we fetch. Up to 10 pages can be inspected. The cap is 10 pages. That is a cap, not a promise that 10 pages will be found. One qualifying page is listed as one page. A priority is included only with a verbatim excerpt. Checkout is not open.
What is the $29 pack?
The report, plus robots.txt.diff, an Organization and SoftwareApplication candidate from the scanned title, description, and URL, and priorities with page evidence. Question text is copied only when a fetched page already asks it. FAQPage markup, comparison outlines, and an llms.txt file are not included.
How would a paid record be delivered?
The record is not emailed. Open /access/ and its random token. That page is not the free /r/ link, and an order id does not open it.
What if a fix has no fetched text?
It is left out of the priority list. This site does not run an automatic refund. Checkout is not open.