Services Work Insights Free checker About Book a free audit →

The technical GEO checklist

Technical9 min read·Updated 2026-08-31
The short answer

Technical GEO comes down to four questions: can AI crawlers reach your content, can they parse it without executing JavaScript, does your structured data state unambiguously who you are, and can they tell how fresh it is? Get those right and you're eligible to be cited. They don't earn citations on their own — but nothing else works without them.

1. Crawler access

Start here, because it's binary. Check your robots.txt for these user agents and make sure the ones you want are allowed:

User agentOperatorPurpose
GPTBotOpenAITraining and index crawling
OAI-SearchBotOpenAIChatGPT search index
ChatGPT-UserOpenAILive fetch when a user's question needs it
ClaudeBot / Claude-UserAnthropicIndex and user-triggered fetch
PerplexityBotPerplexityIndex crawling
Google-ExtendedGoogleGemini and AI grounding
meta-externalagentMetaMeta AI

Two traps. First, blanket AI opt-outs added during the 2023–24 scraping backlash are still live on many sites — check before assuming. Second, robots.txt is only read from the domain root. If your site lives on a subpath (a GitHub Pages project site, for instance), your robots.txt there is decorative.

Verify, don't assume

Check server logs for actual visits from these agents. A permissive robots.txt with a firewall or bot-protection rule silently blocking the same crawlers is a common and invisible failure.

2. Rendering and markup

Not every AI crawler executes JavaScript, and those that do may not wait for slow client-side hydration. Content that only exists after a framework boots is content at risk.

3. Structured data that states your identity

This is where GEO diverges most from classic SEO. You are not adding schema to win a rich snippet; you are removing ambiguity about what entity this site represents. A connected graph beats scattered fragments:

Two rules that matter more than completeness. Use @id to link nodes so the graph is explicit rather than a pile of unrelated objects. And never let schema contradict visible content — mismatched FAQ markup in particular is a known source of manual penalties, and it undermines exactly the trust you're trying to build.

The sameAs signal

Your sameAs array — LinkedIn, GitHub, directory profiles, a Wikipedia entry if you have one — is how you tell an engine which external records refer to you. This is one of the highest-leverage and most-skipped fields.

4. Freshness signals

Recency is weighted heavily. Make it legible:

5. llms.txt — useful, oversold

An llms.txt file at your domain root offers a plain-markdown summary of your site for language models. It's cheap to add, it's a clean way to state your canonical description, and we ship it as standard.

But be clear-eyed: adoption by major engines is not established, and it is not a ranking mechanism. Any agency presenting llms.txt as the core of a GEO offering is selling the easiest deliverable rather than the effective one. Crawlability, entity clarity, extractable content and off-site authority do the actual work.

The 30-minute audit

  1. Fetch yourdomain.com/robots.txt — are AI agents allowed, and is it at the true root?
  2. View source with JS disabled — is the content there?
  3. Run the page through a schema validator — does a connected entity graph appear?
  4. Check your canonical, og:image and og:url actually match the live URL.
  5. Confirm sitemap.xml resolves and is submitted in Search Console and Bing Webmaster Tools.
  6. Search your own brand name and check what the top external sources say about you.

If you'd rather have this scored for you, our free AI visibility checker walks through the same ground in a few minutes.

Frequently asked

Does robots.txt work on GitHub Pages project sites? +
Only partially. Crawlers read robots.txt from the domain root, so on username.github.io/project/ a robots.txt inside the project folder isn't authoritative — the one at the domain root governs. It becomes fully effective once you point a custom domain at the site.
Will adding schema get me cited? +
Not on its own. Schema makes you eligible and unambiguous; it doesn't make you authoritative. Think of it as removing a barrier rather than adding a boost — necessary, not sufficient.
Do I need llms.txt? +
It's cheap and harmless, so add it — but don't expect much from it alone. Prioritize crawl access, rendering, entity schema and off-site corroboration first.
How do I check if AI crawlers are actually visiting? +
Look in your server or CDN access logs for the user agents listed above. If your host doesn't expose logs, Cloudflare and similar CDNs report AI crawler traffic in their analytics.

Keep reading

Want this done for your brand?

Book a free GEO audit: where you appear across 6+ AI engines today, the prompts competitors own, and a prioritized 90-day plan you keep either way.

Book a free audit