nohacks.co No Hacks - AI Agent Guidelines
informational AI and machine learning Media +1 51 ✓ ✓
legionisci.com Legionisci.com — AI crawler information
PL 48 ✓
prerender.io Prerender.io
documentation AI and machine learning Infrastructure 53 ✓
hankookilbo.com Hankook Ilbo — AI Agent & Web Crawler Guidelines
documentation AI and machine learning Media KR 66 ✓ ✓
gaiaonline.com Gaia Online - AI Crawler Guidance
US 50 ✓
laserliner.com Laserliner - AI Crawler Index
documentation AI and machine learning Consumer electronics DE 48 ✓ ✓
fintreeindia.com Fintree - AI Crawler Guidance
IN 46 ✓
healthmug.com Healthmug AI Agent Guidelines
documentation AI and machine learning IN 56 ✓
suvudu.com llms.txt — AI crawler instructions for this site (November 2025)
US 45 ✓
onlyams.com OnlyAms VIP Platform - AI Crawlers and Large Language Models Navigation Profile
transactional AI and machine learning 47 ✓
legacymovingdenver.com Legacy Moving Denver - AI Crawler Guide
documentation Local business US 48 ✓
yourgpt.ai YourGPT - The Complete AI Agent Platform
interface AI and machine learning 57 ✓ ✓
clickgsm.ro ClickGSM — informații pentru asistenți AI și crawleri
informational Consumer electronics RO 53 ✓ ✓
cchcpelink.com llms.txt - Guidelines for Large Language Models and AI Crawlers
informational AI and machine learning US 48 ✓
funboxie.com Funboxie LLM & AI Crawler Context File
documentation Education 47 ✓
centinelanalytica.com Centinel Analytica
documentation 58 ✓ ✓
quickgsm.ro QuickGSM Service — informații pentru asistenți AI și crawleri
documentation Consumer electronics Local business RO 51 ✓ ✓
crawlbase.com Crawlbase
interface APIs and SDKs Data and analytics 60 ✓ ✓
abetter.bid A Better Bid — Official Information for AI Assistants, LLM Crawlers, and Generative Search
documentation AI and machine learning Automotive 58 ✓
zenmedia.com Zen Media: B2B Marketing and PR Agency for B2B Brands
documentation Marketing Media 48 ✓
tax1099.com llms.txt for Tax1099
interface Finance and payments Business software 50 ✓
partyrama.co.uk Partyrama: Party Supplies, Decorations & Balloons
transactional Ecommerce GB 54 ✓ ✓
potentpages.com Potent Pages
documentation AI and machine learning Data and analytics US 50 ✓
japan47go.travel JAPAN 47 GO
documentation Travel US 49 ✓
trainocate.co.jp トレノケート株式会社 LLMs.txtポリシー / Trainocate Corporation AI Content Policy (LLMs.txt) | This file defines AI crawling and training permissions for LLMs. Please read carefully. | LLMs.txt Policy for AI Crawler
informational JP 47 ✓
promptwatch.com Promptwatch
interface AI and machine learning Marketing 65 ✓ ✓
bitkom.org llms.txt — Machine-readable site overview for AI and research crawlers
DE 55 ✓
avtoelon.uz Instructions for AI models crawling avtoelon.uz
informational AI and machine learning UZ 54 ✓ ✓
specification.website The Website Specification
interface Documentation and reference 52 ✓ ✓
amberscript.com Amberscript Global B.V.
documentation AI and machine learning Media 48 ✓
scalperscompany.com Scalpers España
transactional Fashion and beauty Ecommerce CA 63 ✓ ✓
alliai.com www.alliai.com
documentation Marketing Developer tools CA 56 ✓ ✓
iai.tv IAI.tv
informational GB 55 ✓
imoo.com imoo Global Site Index
transactional Consumer electronics US 55 ✓
jeangalea.com Jean Galea
informational Personal sites and blogs 48 ✓
remoteok.com Remote OK
interface Recruiting and careers 59 ✓
getpublii.com Publii Static CMS
documentation Developer tools Open source projects PL 52 ✓
piperic.com Piperic
documentation Ecommerce Data and analytics FI 48 ✓
writesonic.com Writesonic
documentation Marketing AI and machine learning 64 ✓
cancer.ca llms.txt — AI / LLM crawling preferences
CA 49 ✓
marketsplash.com MarketSplash
documentation Marketing US 64 ✓ ✓
firecrawl.dev Firecrawl
interface AI and machine learning AI agents and MCP +2 US 65 ✓ ✓
yamakei-online.com AIクローラーによる要約と引用の許可設定
informational JP 49 ✓
otterly.ai OtterlyAI
interface Data and analytics Marketing +1 NL 63 ✓ ✓
cuny.com C.U.N.Y. Digital
documentation Marketing Nonprofit and advocacy 52 ✓
growtika.com Growtika
documentation Marketing US 47 ✓
readpartner.com ReadPartner
documentation Media AI and machine learning US 46 ✓
transamerica.com Transamerica AI Access Policy
documentation AI and machine learning Insurance +1 US 60 ✓
levamo.com Levamo
documentation Education Infrastructure 51 ✓ ✓
kontron-ais.com kontron-ais.com - llms.txt (for AI crawlers and generative engines)
documentation Industry and manufacturing Business software DE 49 ✓
hashtag.org hashtag.org
documentation AI and machine learning 53 ✓ ✓
codetrendy.com CodeTrendy
interface Marketing Productivity 51 ✓ ✓
wptasty.com WP Tasty
transactional Developer tools Food and dining 50 ✓
biletinial.com Biletinial
transactional Entertainment and streaming Events and conferences TR 62 ✓
spider.cloud Spider
interface APIs and SDKs AI agents and MCP US 51 ✓ ✓
nevermined.ai Nevermined
interface AI agents and MCP Finance and payments +1 US 47 ✓
againstdata.com AgainstData
documentation AI and machine learning US 50 ✓ ✓
hardgsm.ro HardGSM — informații pentru asistenți AI și crawleri
informational RO 45 ✓ ✓
vzy.one VZY
documentation Entertainment and streaming Media 45 ✓ ✓
fraudblocker.com Fraud Blocker: Click Fraud Protection Software.
documentation Cybersecurity Marketing 60 ✓
baytechconsulting.com Baytech Consulting
documentation Developer tools Business software +1 US 54 ✓ ✓
crawl4ai.com Crawl4AI Cloud API
interface AI and machine learning APIs and SDKs DE 45 ✓
scmdojo.com SCMDOJO
transactional Education Business software 47 ✓
scrapegraphai.com llms.txt
interface AI agents and MCP APIs and SDKs US 48 ✓ ✓
truenorthsocial.com True North Social - Full-Service Digital Marketing Agency
informational Marketing Media 52 ✓
cloro.dev cloro
interface APIs and SDKs 50 ✓
ninjaone.com NinjaOne
documentation US 57 ✓
oathnet.org OathNet
interface Cybersecurity 51 ✓ ✓
anakin.io Anakin.io
interface AI and machine learning AI agents and MCP +1 IN 51 ✓ ✓
simplescraper.io Simplescraper
interface AI agents and MCP APIs and SDKs +1 51 ✓ ✓
ukr.media UkrMedia — Instructions for AI Agents and LLMs
documentation AI and machine learning Media DE 50 ✓
maquinadoesporte.com.br Máquina do Esporte
informational BR 47 ✓
hstockplus.com HstockPlus
transactional Ecommerce SG 48 ✓
gathern.co Gathern
interface Travel AI agents and MCP 50 ✓
ariseserver.com Arise Server
documentation Infrastructure DE 46 ✓
vistancenetworks.com Vistance Networks
informational SE 51 ✓
mavplusz.hu MÁV Plusz - Multimodális Utastájékoztatási Belföldi és Nemzetközi Útvonaltervező (mavplusz.hu)
informational Travel HU 47 ✓
tinyfish.ai TinyFish
interface Infrastructure AI agents and MCP US 58 ✓
stork.ai Stork.ai
documentation AI and machine learning Media US 55 ✓ ✓
gentlemonster.com GENTLE MONSTER Official Online Stores
transactional Ecommerce Fashion and beauty 59 ✓
scraperapi.com ScraperAPI
interface AI and machine learning APIs and SDKs +2 US 53 ✓
jio.com Jio AI Discovery File
IN 51 ✓
ddi.com DDI (Development Dimensions International) — Leadership Assessment & Development
documentation Business software ZA 59 ✓
browse.ai Browse AI - No-code web scraping and website monitoring platform
interface AI and machine learning Data and analytics +2 54 ✓
bowlerhat.co.uk Bowler Hat
documentation GB 47 ✓
webscraping.ai WebScraping.AI
interface AI and machine learning APIs and SDKs +1 51 ✓ ✓
brightbid.com Brightbid
documentation Marketing SE 48 ✓
leesa.com Leesa
informational US 48 ✓
musicpusic.com Music Pusic - LLM and AI Agent Guide
documentation AI and machine learning Media IR 45 ✓
leboat.com llm.txt for Le Boat LLM Crawling Guide
US 50 ✓
elmaouid.dz جريدة الموعد اليومي (Elmaouid Daily Newspaper)
informational Media DZ 46 ✓
otis.edu llms.txt — AI-friendly site summary for LLM crawlers
US 45 ✓
hrcloud.com HR Cloud
documentation Recruiting and careers Business software US 51 ✓
roadsurfer.com roadsurfer AI Search Content
50 ✓
hbzhan.com llms.txt - 专为AI模型提供的环保在线网站内容导航
CN 46 ✓
vistarmedia.com LLMs.txt for Vistar Media (vistarmedia.com)
documentation AI and machine learning Media +1 51 ✓
tavily.com Tavily Docs
interface AI and machine learning AI agents and MCP +1 65 ✓ ✓
kommo.com llms.txt — Kommo CRM AI Index
informational Marketing US 53 ✓
visittrentino.info LLMs.txt - Sitemap for AI content discovery
DE 51 ✓
treasuredata.com Treasure AI - llms.txt
US 55 ✓
craftyartapp.com Crafty Art — AI Overview (llms.txt)
52 ✓ ✓
coway.com [Coway Official AI Directory]
KR 45 ✓
axfood.se llms.txt för axfood.se
informational AI and machine learning SE 46 ✓
seti.org llms.txt — AI access instructions
49 ✓
alphaomegaconsulting.com Alpha Omega Consulting — LLMS Content Index
documentation AI and machine learning US 46 ✓
kam.co.ke llms.txt — AI Crawler Guidance for Kenya Association of Manufacturers
documentation Industry and manufacturing Business software KE 47 ✓
dmifinance.in DMI Finance llms.txt - AI Crawler and Large Language Model Access Guidelines
documentation AI and machine learning Finance and payments IN 58 ✓ ✓
treehousehotels.com Treehouse Hotels
documentation Travel US 45 ✓
procana.com Procana CBD Shop
transactional Ecommerce US 47 ✓
paro.ai llms.txt – Grants access to AI and LLM crawlers for indexable content discovery and integration.
documentation AI and machine learning Finance and payments US 51 ✓
erli.pl Erli.pl - LLMs.txt & Crawler Specifications
transactional Ecommerce PL 50 ✓
zoominfo.com ZoomInfo LLM Information
documentation Marketing 56 ✓
monkey.app =========================================
48 ✓
free.ai Free.ai — llms.txt
interface AI and machine learning APIs and SDKs US 55 ✓
syncee.com llms.txt — Policy for AI crawlers & assistants
documentation AI and machine learning Ecommerce US 55 ✓
drafthouse.com Alamo Drafthouse (drafthouse.com)
informational 56 ✓
futuremarketreport.com Future Market Report — AI Crawler Guide
informational Data and analytics US 45 ✓
wati.io This means all AI crawlers are disallowed from using your content.
documentation Communications 45 ✓
legalzoom.com :blue_book: LegalZoom LLMs.txt — Guidance for AI Crawlers & Synthesizers
50 ✓
ase.dk Ase.dk llms.txt — Guidance for AI/LLM crawlers
documentation Legal Recruiting and careers DK 47 ✓
irishlucky.com IrishLucky.com — LLM / AI crawler summary
informational Gaming Entertainment and streaming DE 47 ✓
mommyish.com Mommyish - AI Crawler Guidance
informational Media US 47 ✓
friendlydiamonds.com ========== LLM & AI CRAWLERS ==========
transactional Ecommerce 46 ✓
traders-trust.com Traders Trust — Site Map for AI Crawlers
documentation Finance and payments 45 ✓
souda-kyoto.jp そうだ 京都、行こう。
informational Travel JP 47 ✓
intercomcdn.com intercom.com — llms.txt
documentation 66 ✓
starwoodhotels.com Starwood Hotels
documentation Travel US 64 ✓
cureallplumbing.com Cure All Plumbing — LLMS Content Index
transactional AI and machine learning Local business 47 ✓
lnu.se Linnéuniversitetet (LNU)
informational Education Science and research SE 56 ✓
usehardal.com Hardal: Server-Side Tracking and First-Party Data Infrastructure
interface Marketing Data and analytics NL 54 ✓
floatbot.ai Floatbot.AI — llms.txt
documentation AI and machine learning Communications 50 ✓
jump.bg llms.txt for Jump.BG
transactional Infrastructure BG 50 ✓ ✓
tesorio.com Tesorio
documentation Finance and payments AI agents and MCP US 45 ✓
kamyarshah.com Fractional COO - Fractional CMO - Kamyar Shah
documentation AI and machine learning 51 ✓ ✓
itecsonline.com ITECS
documentation Cybersecurity Infrastructure +1 51 ✓ ✓
igears.com.hk iGears Technology Limited
documentation Marketing Business software +1 HK 46 ✓
cognizo.ai Cognizo
transactional AI and machine learning Marketing 47 ✓
tstprep.com TST Prep
transactional Education 51 ✓ ✓
iavaz.com Imagine Audio Video — LLMS Content Index
documentation AI and machine learning Media +2 46 ✓
armature.tech Armature
transactional AI agents and MCP Marketing US 48 ✓
diariocarioca.com Diário Carioca — The World's Newspaper
informational Media IE 47 ✓
fillthegaps.net Fill The Gaps (FTG)
documentation Construction and architecture US 46 ✓
xcopter.com xcopter (엑스캅터)
transactional Consumer electronics Industry and manufacturing +1 KR 47 ✓
siteor.com Siteor — website builder and CMS
transactional Design Ecommerce +1 IE 49 ✓
mediaslide.com Mediaslide
documentation Business software Marketing US 49 ✓
speed1.gr Speed1
transactional Automotive GR 46 ✓
topmate.io Topmate — AI Crawler Guidance
informational Finance and payments Business software 45 ✓
varonis.com This llms.txt file provides guidance for AI crawlers and LLMs on how to understand and represent Varonis content.
documentation Cybersecurity US 63 ✓
zhaket.com Zhaket (ژاکت)
transactional Ecommerce IR 51 ✓
anasazidoor.com Anasazi Architectural Door — LLMS Content Index
transactional AI and machine learning Industry and manufacturing +2 US 47 ✓
hurra.com encoding: UTF-8
DE 49 ✓
intechopen.com IntechOpen
documentation Science and research US 66 ✓
lustich.de Lustich.de — Deutsche Online-Casino-Tests seit 1997
informational Gaming Entertainment and streaming DE 56 ✓ ✓
maximizemarketresearch.com Maximize Market Research Pvt. Ltd.
transactional Data and analytics Science and research 56 ✓
cerri.com Cerri
documentation Industry and manufacturing Business software PL 51 ✓ ✓
interactivecrypto.com InteractiveCrypto
documentation Finance and payments Crypto and Web3 +1 51 ✓
paitolottosdy.info PaitoLottoSDY
informational Media 52 ✓ ✓
tryghed.dk TryghedsGruppen - AI Agent Information
informational AI and machine learning DK 46 ✓
booksnbobs.com Books n Bobs
transactional Ecommerce SG 46 ✓
selectedfirms.co SelectedFirms — llms-full.txt
documentation Developer tools Business software 53 ✓
smartsites.com SmartSites
transactional Marketing US 56 ✓ ✓
thecompanycheck.com The Company Check AI and MCP Usage Guide
informational AI and machine learning 48 ✓
edwardjones.com llms.txt – AI access and comprehension guide for Edward Jones
informational Finance and payments US 63 ✓
edwardjones.ca llms.txt – AI access and comprehension guide for Edward Jones
informational Finance and payments CA 51 ✓
seomator.com SEOmator
documentation Marketing Data and analytics US 57 ✓ ✓
v3game.site V3 Game – LLMs.txt
documentation Gaming 47 ✓
openrouter.ai OpenRouter
interface Developer tools AI and machine learning +1 69 ✓ ✓
anchorless.io AnchorLess
transactional 54 ✓ ✓
universalads.com Universal Ads
transactional Marketing US 51 ✓
foreks.com ForInvest - Türkiye'nin Finansal Veri Sağlayıcısı
documentation Finance and payments Data and analytics 63 ✓ ✓
mlslistings.com MLSListings
documentation Real estate US 57 ✓
skidrowgamereloaded.co Skidrow Game Reloaded
documentation Gaming DE 47 ✓
sumas.ch SUMAS – Sustainability Management School
documentation Education CH 51 ✓ ✓
kerovit.com Kerovit by Kajaria
informational Industry and manufacturing Construction and architecture 50 ✓ ✓
marisapeer.com Marisa Peer
transactional Education US 50 ✓
chery.com.tr Chery Türkiye (Chery Turkey) - AI Context and Sitemap
transactional Automotive TR 49 ✓
musicrecords.cz MusicRecords.cz
transactional Ecommerce Entertainment and streaming CZ 55 ✓ ✓
shifton.com Shifton
transactional Productivity Business software 53 ✓ ✓
lahome.cz LaHome.cz
transactional Home and garden Ecommerce CZ 51 ✓ ✓
complex.com Complex
informational Media 66 ✓
dirjournal.com DirJournal: The Global Business Trust Graph
documentation US 49 ✓ ✓
defined.ai Defined.ai
transactional AI and machine learning Data and analytics 50 ✓
supraworx.com SupraWorx
transactional DE 45 ✓
igears.net iGears Technology Limited
documentation AI and machine learning Cybersecurity 47 ✓
gyde.ai Gyde
documentation Finance and payments Healthcare +3 US 46 ✓
alkimi.org Alkimi
documentation Marketing AI agents and MCP US 50 ✓ ✓
cryptomode.com CryptoMode.com
documentation Media Crypto and Web3 GB 49 ✓
getproven.com GetProven
interface Business software APIs and SDKs 47 ✓
bomforge.com BOMForge
interface Industry and manufacturing Business software +2 48 ✓
startupsavant.com Startup Savant
documentation 48 ✓
rankability.com Rankability
documentation Marketing 52 ✓
mash.com Mash
documentation Marketing Real estate +1 US 47 ✓
tamburins.com TAMBURINS Official Online Store
transactional Ecommerce Fashion and beauty 50 ✓
columbiaasia.com Columbia Asia Hospitals
transactional Healthcare 46 ✓
vivinavi.com Vivinavi - Global Japanese Community Portal & Hyper-local Guide
informational Community US 55 ✓
freeyork.org FreeYork
informational Arts and culture Design +1 51 ✓
mytvs.com myTVS LLM and AI Search Guide
informational AI and machine learning CA 45 ✓ ✓
slidy.ai Slidy AI
documentation AI and machine learning RU 51 ✓
newsbreak.com NewsBreak
documentation Media Local business US 64 ✓
afyon.bel.tr T.C. Afyonkarahisar Belediyesi AI Assistant Context
informational AI and machine learning Government and public services TR 47 ✓
standbanner.co.uk LLMs.txt for www.standbanner.co.uk
transactional Marketing GB 47 ✓
reynwood.com Reynwood Communications
documentation Food and dining Industry and manufacturing +3 59 ✓ ✓
impt.io IMPT — The Planet's Loyalty Programme
informational 46 ✓
ewaahotels.com EWAA Hotels
transactional Travel US 47 ✓
cycleai.ai Cycle AI
informational AI and machine learning Entertainment and streaming 55 ✓
izydaisy.com IzyDaisy (izydaisy.com)
documentation Gaming 51 ✓ ✓
totoroboat.com TotoroBoat (totoroboat.com)
documentation Gaming Entertainment and streaming 51 ✓ ✓
totororing.com TotoroRing (totororing.com)
documentation Gaming Entertainment and streaming 51 ✓ ✓
azat.tv Azat TV — Independent Media Portal
documentation Media 46 ✓
whichcasino.com WhichCasino
informational Gaming Entertainment and streaming +1 51 ✓
super.ai super.AI
documentation AI and machine learning Data and analytics +1 56 ✓ ✓
mtoag.com MTOAG
documentation AI and machine learning IN 47 ✓
safe.com llm.txt for safe.com
US 47 ✓
cardahealth.com Carda Health
documentation Healthcare US 49 ✓
tinylytics.app Tinylytics
interface Data and analytics 51 ✓ ✓
palmate.ai Palmate AI
documentation AI and machine learning Business software DE 49 ✓
vidofy.ai Vidofy AI
transactional AI and machine learning Media 45 ✓ ✓
pr-cy.io pr-cy.io — SEO Tools & Website Analysis
informational Marketing AI and machine learning +1 RU 51 ✓
canterberrygifts.com Canterberry Gifts
transactional Ecommerce Marketing US 52 ✓ ✓
firsteigen.com FirstEigen
documentation AI and machine learning Data and analytics +1 US 47 ✓
builtwith.com BuiltWith
informational Marketing Data and analytics CA 63 ✓ ✓
kiyoh.com Kiyoh
documentation Ecommerce Marketing 60 ✓
iimskills.com llm.txt for www.iimskills.com
documentation Education 52 ✓
dictogo.app DictoGo
documentation Education 48 ✓ ✓
redtag.ca llms.txt
CA 48 ✓
organised.co Organised
transactional Food and dining US 47 ✓
aiallure.com aiAllure
transactional AI and machine learning US 53 ✓ ✓
kittygiraudel.com Kitty Giraudel
informational Personal sites and blogs US 48 ✓
moneypilot.com MoneyPilot
documentation Finance and payments US 47 ✓
taroot.ir Taroot.ir
documentation Entertainment and streaming IR 46 ✓
thetaxbook.com TheTaxBook
transactional Finance and payments Documentation and reference US 46 ✓
allied.com llms.txt for allied.com — v0.4
ZA 45 ✓
fodda.ai Fodda
interface AI and machine learning AI agents and MCP +1 US 45 ✓ ✓
revivalrugs.com Revival Rugs
transactional Home and garden Ecommerce CA 51 ✓
thebraintumourcharity.org llms.txt for https://thebraintumourcharity.org
45 ✓
huarenstore.com Huaren Store
transactional Ecommerce Food and dining 46 ✓ ✓
letterenfonds.nl Nederlands Letterenfonds
informational Arts and culture NL 52 ✓
classicemu.com ClassicEmu - Play Retro and Emulator Games Online
documentation Gaming 47 ✓ ✓
deepseek.ai DeepSeek.ai - The Unofficial DeepSeek Community & Resource Hub
documentation AI and machine learning Community US 51 ✓
localdominator.co Local Dominator
documentation Marketing US 49 ✓
smytten.com Smytten
transactional Ecommerce Fashion and beauty IN 57 ✓
lorealparisusa.com LLMs.txt - Master File
53 ✓
schuttsports.com Schutt Sports — Full Reference Document for AI Systems
documentation AI and machine learning Sports and fitness CA 46 ✓ ✓
usablenet.com llm.txt - LLM Usage and Access Policy for UsableNet
48 ✓
a-sales.co A-Sales
documentation Marketing 50 ✓ ✓
erayaha.ai Erayaha AI
interface AI and machine learning Legal +1 50 ✓ ✓
knup.com Knup
informational Real estate US 48 ✓
eliterooter.com Elite Rooter
transactional Local business US 46 ✓
kenso.ir Kenso
informational Ecommerce Consumer electronics IR 45 ✓
geico.com GEICO
documentation Insurance US 63 ✓