About Agent Web Map

Directory of websites publishing llms.txt, ranked by authority, with a free JSON API and MCP server for AI agents. Verify your site to rank first.

What is llms.txt?

A plain-text Markdown file a website publishes at /llms.txt that tells AI systems what the site is and which pages matter, in a form a language model can read directly. Many sites also publish /llms-full.txt with the full content. The convention is described at llmstxt.org.

What is Agent Web Map?

A directory of websites that publish llms.txt. Every entry is validated, re-checked over time, and ranked by an authority score, so agents get working files from sites that matter. Agents query it through a free JSON API or an MCP server; owners verify their sites to rank first.

What does the authority score mean?

A 0-100 score with four parts: reach (how widely the site is known), trust (verified ownership, the domain's history, availability), file quality (the structure and substance of the llms.txt itself) and freshness (how recently it was seen valid). Scores of 70 or more are featured, 45 or more are listed; verified owners are featured from 60.

How do I add my website?

Publish an llms.txt on your site, then submit the domain with POST https://agentwebmap.com/v1/sites, on the submit page, or with the register_domain MCP tool. It is checked and listed shortly after.

How do I verify my website, and why?

Place the token from the verification instructions using one of four methods (a link in your llms.txt, a DNS TXT record, a meta tag, or a well-known file), then call POST https://agentwebmap.com/v1/sites/<domain>/verify. Verified owners rank first, are featured sooner, get a badge, breakage alerts, an editable profile and analytics. No account is needed.

Can AI agents use the directory directly?

Yes. The JSON API needs no key for reads, the MCP server at https://agentwebmap.com/mcp exposes the same operations as tools, https://agentwebmap.com/llms.txt and https://agentwebmap.com/llms-full.txt describe everything in Markdown, and every domain page returns JSON or Markdown when requested with an Accept header.

Is it free?

Yes. Reading the directory, submitting and verifying a site, the badge, alerts and the MCP server are free.

For developers

Data and ranking are produced automatically from free, public signals; listings can be corrected by their verified owners.