dwpv.com Basic Next.js Starter (Pages Router)
documentation Developer tools CA 48 ✓
myadlm.org Skate Park Demo Site
documentation Developer tools 58 ✓
tax1099.com llms.txt for Tax1099
interface Finance and payments Business software 50 ✓
grandcasinomn.com Skate Park Demo Site
documentation US 50 ✓
specification.website The Website Specification
interface Documentation and reference 52 ✓ ✓
honda2wheelersindia.com Skate Park Demo Site
documentation Developer tools US 58 ✓
qbe.com QBE Insurance Group
informational Insurance 48 ✓
legionisci.com Legionisci.com — AI crawler information
PL 48 ✓
getpublii.com Publii Static CMS
documentation Developer tools Open source projects PL 52 ✓
mlslistings.com MLSListings
documentation Real estate US 57 ✓
tstprep.com TST Prep
transactional Education 51 ✓ ✓
gathern.co Gathern
interface Travel AI agents and MCP 50 ✓
msu.edu Michigan State University
informational Education US 62 ✓
suvudu.com llms.txt — AI crawler instructions for this site (November 2025)
US 45 ✓
freejobalert.com FreeJobAlert.com
informational Recruiting and careers Government and public services 63 ✓
haemonetics.com Basic Next.js Starter
documentation US 50 ✓
alsglobal.com Basic Next.js Starter (Pages Router)
documentation US 52 ✓
fintreeindia.com Fintree - AI Crawler Guidance
IN 46 ✓
freshjuice.dev FreshJuice
documentation Marketing Developer tools 45 ✓ ✓
nevermined.ai Nevermined
interface AI agents and MCP Finance and payments +1 US 47 ✓
hashtag.org hashtag.org
documentation AI and machine learning 53 ✓ ✓
gaiaonline.com Gaia Online - AI Crawler Guidance
US 50 ✓
supermemory.ai supermemory
interface AI and machine learning AI agents and MCP +1 55 ✓ ✓
cancer.ca llms.txt — AI / LLM crawling preferences
CA 49 ✓
erayaha.ai Erayaha AI
interface AI and machine learning Legal +1 50 ✓ ✓
konabayev.com Konabayev — B2B Marketing, Browser Extensions, Apify Actors
transactional Marketing AI and machine learning 51 ✓ ✓
crawlbase.com Crawlbase
interface APIs and SDKs Data and analytics 60 ✓ ✓
veroscribe.com Vero Scribe
documentation Healthcare AI and machine learning US 46 ✓
bitkom.org llms.txt — Machine-readable site overview for AI and research crawlers
DE 55 ✓
cchcpelink.com llms.txt - Guidelines for Large Language Models and AI Crawlers
informational AI and machine learning US 48 ✓
ofox.ai OfoxAI
interface AI and machine learning APIs and SDKs +1 54 ✓ ✓
intechopen.com IntechOpen
documentation Science and research US 66 ✓
firecrawl.dev Firecrawl
interface AI and machine learning AI agents and MCP +2 US 65 ✓ ✓
crawl4ai.com Crawl4AI Cloud API
interface AI and machine learning APIs and SDKs DE 45 ✓
built2winweb.com BuiltToWinWeb
interface Design Marketing +5 52 ✓ ✓
freeyork.org FreeYork
informational Arts and culture Design +1 51 ✓
maxplaces.com MAXPlaces
documentation Marketing 51 ✓ ✓
iai.tv IAI.tv
informational GB 55 ✓
tinylytics.app Tinylytics
interface Data and analytics 51 ✓ ✓
yamakei-online.com AIクローラーによる要約と引用の許可設定
informational JP 49 ✓
getcurex.com Curex
transactional Healthcare 54 ✓ ✓
helpcenter.io HelpCenter.io
interface Business software APIs and SDKs DE 53 ✓ ✓
trigger.dev Trigger.dev
documentation AI and machine learning AI agents and MCP +2 61 ✓ ✓
hallme.com Hall: 207\-956\-0020
documentation AI and machine learning Marketing 49 ✓
myclickfunnels.com ClickFunnels
interface Marketing Ecommerce +2 59 ✓
kernel-error.de Kernel-Error — llms.txt
documentation Cybersecurity Personal sites and blogs DE 51 ✓ ✓
cloro.dev cloro
interface APIs and SDKs 50 ✓
nohacks.co No Hacks - AI Agent Guidelines
informational AI and machine learning Media +1 51 ✓ ✓
weaverse.io Weaverse
documentation Ecommerce Developer tools 51 ✓ ✓
astrologyhub.com Astrology Hub
transactional Media Personal sites and blogs +1 46 ✓
avtoelon.uz Instructions for AI models crawling avtoelon.uz
informational AI and machine learning UZ 54 ✓ ✓
otis.edu llms.txt — AI-friendly site summary for LLM crawlers
US 45 ✓
globnic.com globNIC — AI Discovery Manifest
informational AI and machine learning GB 51 ✓
klingdigital.com Kling Digital
documentation Marketing FI 51 ✓ ✓
redawning.com RedAwning
interface Travel APIs and SDKs +1 53 ✓ ✓
scrapegraphai.com llms.txt
interface AI agents and MCP APIs and SDKs US 48 ✓ ✓
hackshackers.com Hacks/Hackers
interface Media AI agents and MCP 53 ✓ ✓
20four7va.com 20four7VA
informational Marketing Recruiting and careers 49 ✓
scraperapi.com ScraperAPI
interface AI and machine learning APIs and SDKs +2 US 53 ✓
goempyrean.com Empyrean
documentation Business software US 54 ✓ ✓
knownagents.com Known Agents
interface AI and machine learning AI agents and MCP +1 US 52 ✓
scissormall.com Scissor Mall
transactional Ecommerce US 50 ✓ ✓
ukr.media UkrMedia — Instructions for AI Agents and LLMs
documentation AI and machine learning Media DE 50 ✓
lesraffineurs.com Les Raffineurs — contexte pour crawlers IA
informational 50 ✓ ✓
dupe.com Dupe.com
documentation Ecommerce AI and machine learning 57 ✓
zadig-et-voltaire.com Zadig&Voltaire
interface Fashion and beauty Ecommerce 59 ✓
thumbnailcreator.com ThumbnailCreator
documentation AI and machine learning Design US 49 ✓
metehan.ai Metehan Yesilyurt, metehan.ai
informational Marketing AI and machine learning +1 51 ✓ ✓
octoparse.com Web Scraping Tool & Free Web Crawlers | Octoparse
interface Data and analytics US 59 ✓
foundrynet.com FoundryNet
documentation AI and machine learning Infrastructure +1 52 ✓ ✓
sgcasinoinsider.com SGCasinoInsider - llms.txt
informational Gaming Media FR 46 ✓
spider.cloud Spider
interface APIs and SDKs AI agents and MCP US 51 ✓ ✓
vusecurity.com VU Security
documentation Cybersecurity Authentication and identity US 51 ✓ ✓
jewelershowcase.com LLM Crawling Guidance
informational AI and machine learning US 47 ✓
arcade.dev Arcade
interface AI and machine learning AI agents and MCP 56 ✓ ✓
edwardjones.com llms.txt – AI access and comprehension guide for Edward Jones
informational Finance and payments US 63 ✓
perigon.io Perigon
interface AI and machine learning APIs and SDKs +2 US 47 ✓
newhedge.io Newhedge
interface Data and analytics APIs and SDKs 51 ✓ ✓
bworld.co.kr SK브로드밴드 B world 및 B 다이렉트샵
transactional Telecom KR 50 ✓
edwardjones.ca llms.txt – AI access and comprehension guide for Edward Jones
informational Finance and payments CA 51 ✓
visittrentino.info LLMs.txt - Sitemap for AI content discovery
DE 51 ✓
seomator.com SEOmator
documentation Marketing Data and analytics US 57 ✓ ✓
clawhub.ai ClawHub
interface AI agents and MCP APIs and SDKs US 56 ✓
agent-ready.dev Agent Ready
interface AI and machine learning AI agents and MCP US 45 ✓ ✓
kasada.io Kasada
interface Cybersecurity US 49 ✓
kualoa.com Kualoa Ranch — llms.txt
documentation Travel US 48 ✓
depinhub.io DePIN Hub
documentation Crypto and Web3 Infrastructure 46 ✓ ✓
contadu.com CONTADU Content Intelligence
documentation Marketing AI and machine learning PL 46 ✓
course.careers course.careers
interface Education Recruiting and careers US 50 ✓ ✓
netrio.com llms.txt for https://www.netrio.com/
documentation Infrastructure US 46 ✓
casino.com LLMS.txt - Large Language Model Access Policy for Casino.com
informational AI and machine learning Gaming 50 ✓
simplescraper.io Simplescraper
interface AI agents and MCP APIs and SDKs +1 51 ✓ ✓
screpy.com Screpy
interface Marketing Business software +2 47 ✓
crawlora.net Crawlora
interface Real estate Ecommerce +3 50 ✓ ✓
testmuai.com TestMu AI (Formerly LambdaTest): Power Your Software Testing with AI and Cloud
interface AI and machine learning Developer tools +1 62 ✓ ✓
jumpfly.com JumpFly, Inc.
documentation Marketing 51 ✓
magecomp.com MageComp
transactional Ecommerce Marketing +3 56 ✓ ✓
auraplusplus.com Aura++
documentation Marketing Community MY 48 ✓
jimcarter.me Jim Carter III
documentation AI and machine learning US 51 ✓ ✓
modpagespeed.com mod_pagespeed 2.1
documentation Infrastructure Developer tools US 53 ✓ ✓
x-team.com X-Team
informational Recruiting and careers US 56 ✓ ✓
jio.com Jio AI Discovery File
IN 51 ✓
mupdf.com MuPDF
documentation Developer tools APIs and SDKs +1 US 55 ✓ ✓
vpsnet.com VPSnet.com
interface AI and machine learning Infrastructure LT 54 ✓ ✓
tinybird.co Tinybird LLM Agent Sitemap
documentation Data and analytics Developer tools US 50 ✓
dailybot.com Dailybot
interface AI and machine learning Productivity +2 US 52 ✓ ✓
hiredigital.com Hire Digital
transactional Business software Recruiting and careers US 47 ✓
anara.com Anara
interface AI and machine learning Productivity +1 US 64 ✓ ✓
codersera.com Codersera
interface Recruiting and careers DE 56 ✓ ✓
tavily.com Tavily Docs
interface AI and machine learning AI agents and MCP +1 65 ✓ ✓
aiagent.app AI Agent
interface AI and machine learning Marketing +2 51 ✓ ✓
wbtc.network WBTC
interface Crypto and Web3 APIs and SDKs 57 ✓ ✓
ctrify.com CTRify
interface Marketing AI and machine learning +2 US 45 ✓
spiderstrategies.com Spider Strategies
interface Business software AI agents and MCP 52 ✓
musicpusic.com Music Pusic - LLM and AI Agent Guide
documentation AI and machine learning Media IR 45 ✓
suganthan.com This llms.txt file is provided as an experiment. I know support and real world impact are currently limited, but it is simple to maintain and worth testing.
documentation Marketing AI and machine learning +1 52 ✓
usablenet.com llm.txt - LLM Usage and Access Policy for UsableNet
48 ✓
bristolguide.co.uk Bristol Guide
informational Food and dining Travel GB 46 ✓
docuclipper.com DocuClipper
interface Business software Data and analytics 55 ✓ ✓
kive.ai Kive
interface Ecommerce Design +1 55 ✓ ✓
seba.health Seba
interface Documentation and reference Science and research 45 ✓ ✓
jobiba.com Jobiba
interface Recruiting and careers 51 ✓ ✓
aeoengine.ai AEO Engine
transactional Marketing AI and machine learning US 51 ✓ ✓
aloaha.com CodeB Sovereign Communications
interface Authentication and identity ES 51 ✓ ✓
latitude.so Latitude
interface AI and machine learning AI agents and MCP +2 US 51 ✓
opoint.com Opoint A/S
interface Data and analytics APIs and SDKs 58 ✓
sleekplan.com Sleekplan
interface Business software Productivity 61 ✓ ✓
actualgroup.com Actual group
interface Recruiting and careers AI agents and MCP US 52 ✓ ✓
simcorner.com SimCorner® (https://simcorner.com)
transactional Telecom Ecommerce CA 55 ✓ ✓
keboola.com Keboola
interface Data and analytics Business software US 56 ✓ ✓
pieverse.io Pieverse
documentation AI and machine learning AI agents and MCP 46 ✓
qase.io Qase
interface AI and machine learning Developer tools +1 US 54 ✓ ✓
purplepublish.com purplepublish.com
documentation Business software Media US 48 ✓
voog.com Voog CMS
documentation Design Ecommerce +3 NL 59 ✓
ipgeolocation.io IPGeolocation.io
interface Cybersecurity Infrastructure +2 DE 59 ✓ ✓
quotidianomotori.com llms.txt generated by Coding Bunny LLMs.txt Generator
informational Media Automotive 48 ✓ ✓
eltiempo.es =====================================================================
ES 48 ✓
aao.org ============================================================
52 ✓
theweathernetwork.com =====================================================================
CA 51 ✓
whisperweb.dev Whisper Web
transactional Media AI and machine learning 50 ✓ ✓
nudgesecurity.com https://nudgesecurity.com llms.txt (Updated November 2025)
documentation Cybersecurity AI and machine learning +1 US 48 ✓
kitalent.com KiTalent — International Executive Search
documentation Recruiting and careers 47 ✓