Is your website invisible to AI?
Plenty of sites look perfect in a browser and are close to blank to an AI crawler. Here is why that happens, how to test for it in two minutes, and how to fix it.
Many websites are invisible to AI because their content is rendered by JavaScript in the browser rather than served as HTML. Several AI crawlers, including those behind ChatGPT, Perplexity and Claude, do not run JavaScript, so they receive an almost empty page even though it looks fine to a person. You can test it by viewing the page source, and you fix it by serving your content as real HTML.
Why it happens
Modern sites are often built as single-page applications using frameworks that assemble the page in the browser. The server sends a near-empty shell and some JavaScript, then the script fetches the content and paints it in. A human never notices, because their browser runs the script in a fraction of a second.
A crawler that does not run JavaScript sees only the shell. It gets your title and meta tags, which sit in the initial HTML, and then almost nothing: no headings, no body copy, no answer to quote. Google generally renders JavaScript, so these sites can still rank in normal search. Many AI crawlers do not render at all, which is why the same site can be perfectly visible to Google and invisible to the answer engines.
This is the most common reason genuinely good content never gets cited. The writing is fine. The crawler simply never receives it.
How to test it yourself
You do not need a tool to get a first read. Open one of your important pages, then view the page source rather than the rendered page (in most browsers this is the "View page source" option, which shows the raw HTML the server sent). Now look for a paragraph of your actual content. If you can find your headings and body text in that source, you are in good shape. If you mostly see script tags and an empty container, your content is being injected by JavaScript, and a non-rendering crawler will not see it.
A quicker version: fetch the URL in a way that does not run JavaScript and read what comes back. If the body is empty, that is what the answer engines get too.
Why meta tags alone do not fix it
It is tempting to think an SEO plugin that manages your titles and descriptions has solved this. It has not. Meta tags live in the page head and are usually present in the raw HTML, so previews and titles look right. The body content is the part that is missing. A page can have flawless meta tags and still serve a crawler an empty body, which is exactly the half-fixed state a lot of sites are in.
How to fix it
The fix is to make sure your content arrives as HTML, not as a job for the browser to do later. The main routes are:
- Server-side rendering. The server renders the full page and sends complete HTML. Increasingly the default in modern frameworks.
- Static site generation. Pages are built to static HTML ahead of time. Ideal for content that does not change every second, such as marketing pages and articles.
- Pre-rendering. A layer in front of your app detects crawlers and serves them a fully rendered snapshot. A practical retrofit when rebuilding is not an option.
Whichever route you take, confirm it worked the same way you tested the problem: view source, or fetch without JavaScript, and check the body content is now there. This is the first thing a Rank Roadie audit checks. It renders your site like a browser, then compares that against what a non-rendering crawler would see, and flags any page where the content disappears without JavaScript. You can run a free one-page audit without an account to find out where you stand.
Frequently asked questions
Why would my website be invisible to AI?
Usually because your content is rendered by JavaScript in the browser rather than served as HTML. Many AI crawlers, including those behind ChatGPT, Perplexity and Claude, do not run JavaScript, so they receive an almost empty page even though the site looks fine to a human.
How do I test if AI can read my site?
Open a key page, view the page source, and check whether your body text and headings are in the raw HTML or whether you mostly see scripts and an empty container. If the content is not there, a non-rendering crawler will not see it either.
Does Google see my JavaScript site?
Usually yes. Google generally renders JavaScript, so a client-side site can still rank. The risk is specific to AI crawlers that do not render, which is why a page can pass for Google and still be invisible to answer engines.
How do I fix it?
Serve your content as HTML rather than relying on JavaScript, through server-side rendering, static site generation, or a pre-rendering layer in front. Meta tags alone do not fix it, because the body content is still missing.
Adam Clarke
Adam is a Chartered Marketer and Fractional CMO with over seventeen years in B2B and B2C marketing, and the founder of Rank Roadie. He writes about the messy overlap between search, AI and keeping humans accountable in the loop.