AgentWebMap index coverage

This report summarizes stored crawl metadata. It makes coverage and its limits visible; directory size is not a measure of agent adoption.

Snapshot generated 2026-10-19 19:13:34 UTC. Cached for up to one hour. Download JSON.

MeasureSites
Valid llms.txt records38,924
Listed / featured sites33,858
Also publishing llms-full.txt13,032
With indexed documentation links15,113
With inferred topic labels14,668
Unclassified24,256
Publisher-declared MCP endpoints487
Valid records checked in the last 24 hours28,709

Unblocked stored records with a valid llms.txt at their last crawl. Listed counts additionally meet directory tier rules.

Earliest record: 2026-10-18 14:17:56 UTC. Stored last checks range from 2026-10-18 14:19:04 UTC to 2026-10-19 19:13:31 UTC.

Topics in public listings

Taxonomy version 2. Category counts cover featured/listed records and overlap; they must not be added to estimate unique sites.

TopicListed sites
AI and machine learning1,425
Developer tools287
Infrastructure572
Data and analytics332
Cybersecurity402
Finance and payments442
Ecommerce6,174
Productivity202
Marketing1,222
Education642
Healthcare485
Media784
Design196
Gaming338
Travel245
Community102
Legal82
Recruiting and careers154
Industry and manufacturing374
Real estate218
Arts and culture135
Sports and fitness169
Food and dining230
Automotive117
Government and public services45
Science and research57

Interpretation

Documentation benchmark