How To Audit Whether AI Recommends Your Brand
The Blocks Nobody Chose Most blocking discovered during audits was never a decision. A disallow copied from a template. A staging rule that survived a migration. A security plugin with an aggressive default. A content delivery network setting labelled bot protection with a switch nobody has looked at since launch.
Get the Basics Right Before Anything Clever Once access is confirmed, check that content actually exists for a crawler to read. Load your important pages with JavaScript disabled. If your specifications, pricing, service areas or contact details vanish, they are effectively absent from this channel regardless of how permissive your robots file is.
Put someone's name against this. Crawler rules sit between marketing, development and whoever administers the content delivery network, which in most organisations means nobody checks them. The failures documented here are not difficult to find, they are simply nobody's job, and a quarterly review taking half an hour prevents the most complete form of invisibility available.
A Reasonable Sequence Fix rendering first, since content a machine cannot see is the only total failure in the list. Then work through your commercially important pages one at a time, moving the direct answer to the top and replacing the vaguest paragraph with concrete figures.
Revisit the answers when the business changes rather than on a content schedule. Price changes, new capabilities and discontinued services all silently invalidate published answers, and an outdated answer stated confidently is worse than no answer at all, because it can be quoted back at you by an assistant that has no way of knowing it is stale.
Deciding Whether to Block Anything There is a legitimate argument for restricting training crawlers, particularly for publishers whose archive is the product. That is a commercial and editorial decision and it deserves a real discussion rather than a default.
Broad sites are forgiving. A blocked section or a badly rendered template still leaves a hundred other pages describing the organisation. A small site with five pages has no such buffer, which makes the mechanical checks disproportionately important.
The last of these is the most common and the hardest to see, because it produces no error anyone internally encounters. Your site works perfectly in every browser while returning a challenge page to every legitimate retrieval agent.
This is the least interesting subject in the discipline and the one that most often explains a total absence from generated answers. A brand can do everything else correctly and remain invisible because a line in a text file, or a setting nobody remembers enabling, ai seo company is turning the relevant crawlers away.
Where to Put Them Individual pages for questions with real volume and commercial weight, grouped sections for the smaller ones. Both work, and the decision should follow how much there is to say rather than a rule.
One organisational point is worth raising early, because it decides more outcomes than the tactics do. These two disciplines share a foundation, so splitting them between separate suppliers produces duplicated technical audits and occasionally contradictory instructions about the same pages. Whoever owns organic search should own this, with specialist help brought in for the parts they cannot do rather than a parallel programme running alongside.
A Single Topic Site Has No Redundancy A site covering one subject has no second chance. If the handful of pages describing that subject are not readable, there is nothing else for a system to fall back on.
Where the Work Is Genuinely the Same The foundations do not change. Crawlable pages, sane site structure, fast rendering, accurate structured data, internal links that reflect how topics relate, and content that answers a real question all serve both channels.
The most citable content most businesses could publish already exists, unwritten, in sales calls and support tickets. It is the set of questions people actually ask, with the answers your team gives verbally every week and has never put on a page.
A false trade off gets invented early in most of these projects. Somebody proposes stripping the design, flattening the copy and restructuring everything around what a crawler finds convenient, and somebody else correctly points out that this would make the site worse for customers.
The same caution applies to referral growth figures, which circulate widely without their context. One widely shared statistic showing several hundred percent growth in assistant referrals came from a sample of nineteen analytics properties. That is a real observation and a genuinely small sample, and the difference matters when you are deciding where to move budget.
The same applies to limitations. Stating plainly what you do not do, what size of job you decline and which situations suit a competitor produces the constraint statements that models lift as impartial facts.