llms.txt, Schema and Entities: The Technical Side of AI Search Visibility

Quick answer: the technical side of AI search visibility is about making your business an unambiguous, well-described entity that machines can read. Use Organization and Person schema with sameAs links to your official profiles, keep your facts consistent across the web, allow AI crawlers in robots.txt, keep content in clean HTML, submit sitemaps to Google and Bing, use IndexNow for fast discovery, and optionally publish an llms.txt file that summarizes your site.

What is an entity, and why does it matter?

An entity is a distinct thing that can be identified: a person, an organization, a place, a product. Search engines and AI systems store facts about entities and the relationships between them: "Optimize is a web design company founded in 2025 by Alvin Jay Diaz Samijon, based in the Philippines."

When your entity is clear and consistent, AI tools are more likely to describe you correctly and connect you with the right topics. When it is fuzzy, with different names, outdated descriptions and conflicting addresses, they may confuse you with someone else or leave you out.

Step 1: define your entity facts

Write down the canonical facts about your business, and use them everywhere:

• Official name (and any alternate name)
• One-sentence description of what you do and for whom
• Founding year and founder
• Location and areas served
• Main services
• Official website and social profiles
• Contact details

Then update your website, Google Business Profile, LinkedIn, directories and any other profiles so they match.

Step 2: add Organization and Person schema

Schema markup (structured data in JSON-LD format) describes these facts in a machine-readable way. A simplified Organization example:

{
  "@context": "https://schema.org",
  "@type": "Organization",
  "@id": "https://example.com/#organization",
  "name": "Example Studio",
  "url": "https://example.com/",
  "logo": "https://example.com/logo.png",
  "foundingDate": "2025",
  "founder": { "@id": "https://example.com/about/jane-doe#person" },
  "sameAs": [
    "https://www.linkedin.com/company/example",
    "https://www.facebook.com/example"
  ]
}

Key practices:

• Use @id values so different pages refer to the same entity.
• Connect people and organizations with founder, worksFor and author.
• Use sameAs to link to official profiles, which helps disambiguate your entity.
• Add Person schema for authors, with job title, photo, expertise (knowsAbout) and profiles.
• Mark up content: Article with author and dates, Service for service pages, Product for products, BreadcrumbList for structure.
• Only mark up what is visible on the page and true.

Validate with Google's Rich Results Test and the Schema.org validator.

Step 3: author and About pages

AI systems and search engines look for evidence of expertise and accountability. Give each author a page with their name, photo, role, experience and links to their profiles, and link every article to its author. Make your About page explain who is behind the business, where you operate and what you specialize in.

Step 4: let AI crawlers in

Many AI tools use their own crawlers. Common user agents include:

Decide which you allow in robots.txt. If your goal is visibility in AI answers, do not block the search-related crawlers. Also check that your firewall, CDN or security plugin is not blocking them silently.

Step 5: llms.txt

llms.txt is a proposed standard, introduced in 2024, for a plain-text Markdown file at yoursite.com/llms.txt that gives AI tools a concise summary of your site and links to your most important pages.

A simple llms.txt contains:

1. The site name as a heading
2. A one-paragraph summary
3. Sections with links to key pages, each with a short description

An honest note: support for llms.txt among major AI providers has not been widely confirmed. It is cheap to add and does no harm, but it is not a substitute for crawlable pages, schema and consistent entity information. You can see ours at optimize-it.site/llms.txt.

Step 6: fast discovery with sitemaps and IndexNow

• Submit your XML sitemap in Google Search Console and Bing Webmaster Tools.
• Use IndexNow, a protocol launched by Microsoft Bing and Yandex in 2021, to notify participating search engines immediately when you publish or update a page. Many CMS platforms and plugins support it, and it is easy to add to a custom site.
• Keep lastmod dates in your sitemap accurate, so crawlers know what changed.

Step 7: clean, semantic HTML

AI crawlers are not all equally good at running JavaScript. Make sure your key content, headings, prices and FAQs appear in the HTML that the server sends. Use semantic elements (headings, lists, tables) rather than styled divs, and give images descriptive alt text.

Technical AI search checklist

1. Entity facts defined and consistent across the web
2. Organization schema with logo, founder and sameAs
3. Person schema for authors, linked to articles
4. Service, Article and BreadcrumbList schema where relevant
5. Author pages and a clear About page
6. robots.txt allows the AI crawlers you want
7. No accidental blocking by CDN or security tools
8. llms.txt published with key pages
9. Sitemaps submitted to Google and Bing
10. IndexNow set up for new and updated pages
11. Key content available in server-rendered HTML

Frequently asked questions

Do I need llms.txt?

It is optional. It costs little and may help some tools, but it does not replace good SEO, schema and consistent business information, which matter far more.

What is entity SEO?

Entity SEO is the practice of helping search engines and AI understand the people, organizations and things your website is about, and how they relate, using consistent facts, structured data and links to authoritative profiles.

Should I block GPTBot?

It depends on your goals. GPTBot is used for model training, while OAI-SearchBot is used for ChatGPT search. Many businesses allow search crawlers for visibility and decide separately about training crawlers.

---

We implement all of this as part of our AI search optimization service and every website we build.

Get your free website audit