alelo.com.br =========================
BR 46 ✓
draup.com ==========================================
US 49 ✓ ✓
dimo-diagnostic.net ======================
US 48 ✓
html-color-codes.info ========================================
US 45 ✓
speakerscorner.co.uk ===============================================
GB 45 ✓
holla.world =========================================
— 47 ✓
monkey.app =========================================
— 48 ✓
kenzz.com Kenzz - كنز
transactional Ecommerce Industry and manufacturing EG 55 ✓
visitmckinney.com Visit McKinney
informational Arts and culture Food and dining +1 US 56 ✓ ✓
fithub.co.il FitHub CrossFit Namal
transactional Sports and fitness IL 45 ✓ ✓
sbicard.com =====================================================
IN 49 ✓
candelamedical.com ============================================================
US 49 ✓
aao.org ============================================================
— 52 ✓
kosokubus.com =========================================================
JP 45 ✓
clientam.com =========================================================
FR 52 ✓
maritime-database.com Maritime Database
documentation Data and analytics Logistics and shipping DE 51 ✓
adbutler.com =========================================================
US 51 ✓ ✓
iai.tv IAI.tv
informational GB 55 ✓
eltiempo.es =====================================================================
ES 48 ✓
theweathernetwork.com =====================================================================
CA 51 ✓
hurra.com encoding: UTF-8
DE 49 ✓
stallionesearch.com StallionESearch
informational AI and machine learning US 46 ✓
ilumeo.com.br Categoria:
informational BR 46 ✓ ✓
feedoptimise.com Feedoptimise
documentation Ecommerce Marketing +1 — 53 ✓
sen7ry.com Sentry
— 46 ✓ ✓
errortrace.dev Sentry
US 57 ✓ ✓
fintreeindia.com Fintree - AI Crawler Guidance
IN 46 ✓
tweaktown.com TweakTown
documentation Media Consumer electronics — 59 ✓
wardatrobe.com Wardatrobe
documentation Fashion and beauty — 46 ✓
taylor.edu 404 Page Not Found
— 52 ✓ ✓
lokalbolig.dk LokalBolig | Landsdækkende dansk ejendomsmæglerkæde
informational Real estate DK 49 ✓
chinapp.com 抓取间隔
informational CN 49 ✓
legionisci.com Legionisci.com — AI crawler information
PL 48 ✓
alliancerecruitmentagency.co.uk Alliance Recruitment Agency — United Kingdom (alliancerecruitmentagency.co.uk)
documentation Recruiting and careers GB 46 ✓
alfred.edu Page Not Found
informational — 53 ✓ ✓
gadget.dev Overview
US 48 ✓
talentlms.com ─────────────────────────────
— 49 ✓
pfeifergroup.com Website
DE 47 ✓
findmykids.org Homepage
DE 55 ✓
one1.gg ONE1
informational Gaming US 46 ✓
strokebestpractices.ca Title
CA 47 ✓
eurac.edu Eurac Research
documentation Science and research US 56 ✓
instaproofs.com instaproofs
US 52 ✓
jewelershowcase.com LLM Crawling Guidance
informational AI and machine learning US 47 ✓
kidney.ca global
CA 48 ✓
drschaer.com global
DE 48 ✓
anysearch.com AnySearch Documentation
— 51 ✓ ✓
hexahealth.com HexaHealth
transactional Healthcare IN 59 ✓
findglocal.com FindGlocal agent search
— 46 ✓
bushcenter.org 404: Not found
informational — 53 ✓ ✓
built2winweb.com BuiltToWinWeb
interface Design Marketing +5 US 53 ✓ ✓
homeflow.co.uk Homeflow
GB 46 ✓
noch.com NOCH
transactional AI and machine learning Ecommerce DE 52 ✓
statusisdown.com Status Is Down
— 47 ✓
mtnweekly.com Just another WordPress site
— 47 ✓
postmagazine.com Just another WordPress site
US 50 ✓
omegapediatrics.com Omega Pediatrics
transactional AI and machine learning Healthcare — 56 ✓ ✓
mintlayer.org Updated: 2026-04-15
— 50 ✓ ✓
avtoelon.uz Instructions for AI models crawling avtoelon.uz
informational AI and machine learning UZ 54 ✓ ✓
huarenstore.com Huaren Store
transactional Ecommerce Food and dining — 51 ✓ ✓
funkemunky.cc 404
informational — 47 ✓ ✓
winnersinstitute.in WiNNERS Institute
documentation Education IN 51 ✓
realreviews.org RealReviews
informational Local business US 48 ✓
musikalienhandel.de Musikalienhandel.de
transactional Ecommerce AI agents and MCP DE 46 ✓
chatforest.com ChatForest
documentation Data and analytics Developer tools +2 US 52 ✓
justdiscord.org JustDiscord
interface APIs and SDKs Community — 47 ✓
noibu.com Noibu
documentation Ecommerce Data and analytics +1 US 61 ✓
potentpages.com Potent Pages
documentation AI and machine learning Data and analytics US 55 ✓
thelawyerworld.com TheLawyerWorld
documentation — 46 ✓
alliancerecruitmentagency.ca Alliance Recruitment Agency — Canada (alliancerecruitmentagency.ca)
documentation Recruiting and careers CA 46 ✓
cling-ai.com Cling AI
transactional AI and machine learning — 51 ✓
olostep.com Olostep
interface AI and machine learning APIs and SDKs — 57 ✓
nodasoft.com nodasoft.com Automotive Parts Online Store
transactional Automotive Ecommerce RU 55 ✓
kwtiles.com.au KW Tiles
transactional Home and garden AU 51 ✓
ajkerpatrika.com Ajker Patrika (আজকের পত্রিকা)
informational Media — 57 ✓
bogner.com BOGNER
transactional Ecommerce Fashion and beauty DE 58 ✓
llms-txt-generator.de llms.txt Generator
interface AI and machine learning Developer tools DE 45 ✓ ✓
epodex.com EPODEX
transactional Industry and manufacturing Ecommerce +1 — 62 ✓ ✓
onitdigital.com Onit Digital
documentation Automotive Marketing +1 US 56 ✓ ✓
modelscope.ai ModelScope
interface AI and machine learning AI agents and MCP +1 SG 55 ✓
vistancenetworks.com Vistance Networks
informational SE 51 ✓
flamepages.com FlamePages
transactional Marketing — 48 ✓
wigglypaint.com WigglyPaint
documentation Design — 50 ✓
marieclaire.com.tw Marie Claire Taiwan（美麗佳人）
informational Media Fashion and beauty TW 54 ✓
secureiot.house Secure IoT House
transactional Cybersecurity — 50 ✓ ✓
aif.org American India Foundation (AIF)
informational Nonprofit and advocacy US 53 ✓
mediaplayercodecpack.com Media Player Codec Pack
documentation Media Consumer electronics GB 56 ✓ ✓
painting-planet.com Painting-Planet: Art Encyclopedia, description paintings of Famous Artist
documentation — 45 ✓
riftatlas.com Rift Atlas
informational Gaming US 48 ✓
grepsr.com Grepsr
documentation Data and analytics — 52 ✓
bastify.com Bastify
transactional Infrastructure DE 55 ✓
scrapegraphai.com llms.txt
interface AI agents and MCP APIs and SDKs US 53 ✓ ✓
lightpanda.io Lightpanda
documentation Developer tools AI agents and MCP US 55 ✓ ✓
recepta.pl Recepta.pl
transactional Ecommerce Healthcare PL 55 ✓
medme.pl Medme.pl
transactional Healthcare Ecommerce PL 50 ✓
agleader.com llm.txt for agleader.com
documentation AI and machine learning US 51 ✓
emprego.com emprego.com
interface Recruiting and careers AI agents and MCP +1 — 52 ✓ ✓
stackb.net Stack B
documentation Community Gaming DE 49 ✓
majhinaukri.in Majhi Naukri
informational Recruiting and careers IN 52 ✓
howthelightgetsin.org howthelightgetsin.org
documentation GB 51 ✓
amlcompany.com AML Company
documentation Real estate Legal +2 — 50 ✓ ✓
theirstack.com TheirStack
interface Data and analytics Business software US 60 ✓ ✓
nobleid.org NobleID — persistent identifiers for research works and researchers
documentation Science and research — 54 ✓ ✓
bio-protocol.org llms.txt for https://bio-protocol.org
documentation Community Science and research +1 US 50 ✓
emorahealth.com Emora Health
interface Healthcare — 56 ✓ ✓
whatismyip.live WhatIsMyIP.live
interface Infrastructure Cybersecurity +1 — 47 ✓
51papaya.com 51PAPAYA
documentation Entertainment and streaming AI and machine learning US 57 ✓ ✓
alhena.ai Alhena AI - AI-Readable Website and Product Guide
documentation AI and machine learning — 53 ✓
almashhad.com Al Mashhad
informational Media — 59 ✓
grupobimbo.com Grupo Bimbo - LLM Context Gateway
documentation Food and dining US 54 ✓
khelnow.com KhelNow
informational Media Sports and fitness — 59 ✓
yoreevo.com Yoreevo
informational Real estate — 51 ✓
speak-up.pro SpeakUp
transactional Business software Events and conferences AE 53 ✓
aspeedtech.com ASPEED Technology Inc.
documentation Consumer electronics JP 52 ✓
ametsoc.org llms.txt
informational Science and research — 50 ✓
skofeber.dk Skofeber
transactional Ecommerce DK 48 ✓
skofeber.se Skofeber
transactional Ecommerce SE 48 ✓
hanbit.co.kr Hanbit+
informational Education KR 45 ✓
rdp.sh RDP.sh
informational DE 45 ✓
cutoutandkeep.net Cut Out + Keep
documentation Arts and culture — 57 ✓
gayboy-porn.art GayBoy-Porn
informational — 56 ✓
sprachcaffe.com SPRACHCAFFE (sprachcaffe.com)
documentation Education IE 53 ✓
toursport.pl TourSport.pl
transactional Ecommerce PL 53 ✓
conductscience.com ConductScience
informational Science and research US 52 ✓
witter.com Witter
informational Ecommerce US 51 ✓
project2025.observer Project 2025 Tracker
documentation Government and public services US 50 ✓
qoxy.com QOXY
transactional Infrastructure — 48 ✓
kowal.co Kowal Store
transactional Ecommerce DE 46 ✓
kowal.store Kowal Store
transactional Ecommerce DE 46 ✓
cheventi.it cheventi.it
informational Events and conferences IT 45 ✓
nodeloc.com NodeLoc
informational Community — 56 ✓
textus.com TextUs — LLM Resource File (llms.txt)
documentation AI and machine learning US 52 ✓
beonemedicines.com Guidance for Large Language Model (LLM) crawlers
informational AI and machine learning Healthcare +1 US 58 ✓
newbreedrevenue.com New Breed | HubSpot's Top Solutions Partner
informational Marketing US 57 ✓
nstauthority.co.uk North Sea Transition Authority (NSTA)
documentation Government and public services GB 54 ✓
perstorp.com Perstorp
documentation Industry and manufacturing — 56 ✓
legacymovingdenver.com Legacy Moving Denver - AI Crawler Guide
documentation Local business US 53 ✓
wte.net WTE Solutions (wte.net)
documentation AI and machine learning Business software US 53 ✓
sollishealth.com Sollis Health
transactional Healthcare — 54 ✓
eventticketscenter.com Event Tickets Center - LLM Context & Documentation
US 51 ✓
factory360.com llms.txt for Factory360 | Experiential Marketing Agency & Services - Factory360
informational Marketing US 52 ✓
amnestyusa.org Amnesty International USA
informational Nonprofit and advocacy — 57 ✓
okay.com OKAY.com
informational HK 50 ✓
concentrix.com Concentrix llms.txt
US 47 ✓
am730.com.hk am730.com.hk - AI Agent Resource & Site Guide
informational AI and machine learning HK 46 ✓
aioseo.com AIOSEO
documentation Marketing — 66 ✓ ✓
molin.ai Molin AI - Cut your customer support by 80% with AI
documentation Ecommerce AI and machine learning — 58 ✓
fliprogram.com llms.text — Guidance for AI agents interacting with Food Liability Insurance Program (FLIP)
informational AI and machine learning — 45 ✓ ✓
getmacha.com Macha
interface AI and machine learning AI agents and MCP +1 US 58 ✓ ✓
kernel-error.de Kernel-Error — llms.txt
documentation Cybersecurity Personal sites and blogs DE 51 ✓ ✓
irishlucky.com IrishLucky.com — LLM / AI crawler summary
informational Gaming Entertainment and streaming DE 50 ✓
amnex.com Amnex Infotechnologies
documentation Data and analytics IN 48 ✓
tavily.com Tavily Docs
interface AI and machine learning AI agents and MCP +1 US 65 ✓ ✓
cyberpowerpc.com CyberPowerPC – llms.txt
informational US 54 ✓
spotibo.com Spotibo is not a web spider. It is a web dog! drumbigoo
transactional Marketing Developer tools — 51 ✓
uic.org UIC — International Union of Railways
documentation Industry and manufacturing US 60 ✓
therecoveryvillage.com The Recovery Village
informational Education Healthcare US 61 ✓
advancedrecoverysystems.com Advanced Recovery Systems
documentation Healthcare — 52 ✓
qshop.ai Qshop
transactional Design Marketing +1 KR 57 ✓
prerender.io Prerender.io
documentation AI and machine learning Infrastructure — 53 ✓
zougla.gr Zougla – Greek News Website (Politics, Economy, World News, Live Media)
informational Media GR 58 ✓
swecobelgium.be Sweco Belgium
documentation Construction and architecture BE 48 ✓
wheelerworks.nl Wheelerworks
transactional Ecommerce Automotive NL 48 ✓
seemehired.com SeeMeHired (seemehired.com)
documentation Recruiting and careers Business software IE 55 ✓ ✓
unisg.ch unisg.ch – Universität St. Gallen
informational CH 49 ✓
sweco.se Sweco Sweden
documentation Construction and architecture SE 52 ✓
riderly.com Riderly
transactional Travel Automotive — 51 ✓
logo-teka.com LogoTeka (logo-teka.com)
documentation Design RU 50 ✓
brickstickershop.com BrickStickerShop
transactional Ecommerce NL 47 ✓
gteek.com Gteek.com - Roadmap and Context for AI Agents and Large Language Models (LLMs)
documentation AI and machine learning BG 47 ✓
coinunited.io CoinUnited.io
transactional Finance and payments Crypto and Web3 — 47 ✓ ✓
swecogroup.com Sweco Group
informational Construction and architecture SE 56 ✓
avepoint.com llms.txt for AvePoint.com
informational US 55 ✓
skinory.io Skinory
documentation Gaming — 50 ✓ ✓
vertbaudet.fr FICHIER LLMS.TXT - CONTROLE D'ACCES AUX IA GENERATIVES (LLMs)
FR 48 ✓
expcarry.com ExpCarry
transactional Gaming US 55 ✓
bagabet.com BagaBet (www.bagabet.com)
documentation Sports and fitness Media — 51 ✓
careerfaqs.com.au Career FAQs – AI-Accessible Course Information
documentation Recruiting and careers Education AU 52 ✓ ✓
hammerton.com Hammerton
transactional Home and garden Ecommerce — 49 ✓
seret.co.il Seret (סרט)
informational Media Entertainment and streaming IL 45 ✓
purplepublish.com purplepublish.com
documentation Business software Media US 53 ✓
vaperanger.com Allow all known major AI and LLM bots to crawl the entire site
informational US 45 ✓
cleveland.edu Cleveland University-Kansas City: Chiropractic and Health Sciences
transactional Education Healthcare US 51 ✓
stuller.com Stuller Inc. — LLM Guidance File (llms.txt)
documentation US 51 ✓
abyssale.com Abyssale
interface APIs and SDKs Marketing +1 — 57 ✓ ✓
rocketgames.io RocketGames.io
informational Gaming FR 52 ✓ ✓
espaceagro.com EspaceAgro – Guide pour IA / LLM
informational FR 50 ✓
imtec.ba Imtec.ba
transactional Ecommerce Consumer electronics BA 47 ✓
cdnetworks.com 规则组 1: 针对所有爬虫的通用规则
documentation FR 48 ✓
easeofbiz.com EaseOfBiz
documentation — 54 ✓
techenclave.com TechEnclave
informational Community — 56 ✓
allianceinternational.co.in Alliance Recruitment Agency — India (allianceinternational.co.in)
documentation Recruiting and careers IN 46 ✓
weelee.co.za llms.txt for Weelee
transactional Automotive Ecommerce ZA 46 ✓
germanos.gr Germanos (germanos.gr)
transactional Ecommerce Consumer electronics GR 45 ✓
minotaurus.io Minotaurus
transactional Crypto and Web3 — 46 ✓
digitalpoint.com Industry News
documentation Media Community +1 — 60 ✓ ✓
procurementresource.com Procurement Resource
documentation Industry and manufacturing Data and analytics — 57 ✓
geef.nl Geef.nl
informational Nonprofit and advocacy NL 51 ✓
cchcpelink.com llms.txt - Guidelines for Large Language Models and AI Crawlers
informational AI and machine learning US 48 ✓
twi-global.com TWI — Technical Excellence in Materials Joining and Engineering
documentation Science and research GB 56 ✓
trainocate.co.jp トレノケート株式会社 LLMs.txtポリシー / Trainocate Corporation AI Content Policy (LLMs.txt) | This file defines AI crawling and training permissions for LLMs. Please read carefully. | LLMs.txt Policy for AI Crawler
informational JP 47 ✓
equator-network.org EQ Reporting Guidelines — AI Agent Notice
informational AI and machine learning — 51 ✓
pageai.pro PageAI
documentation Marketing Design +3 — 49 ✓
knowledgeowl.com The
documentation Documentation and reference Business software US 57 ✓ ✓
medlife.ro MedLife
documentation Healthcare RO 56 ✓ ✓
anynines.com anynines
documentation Infrastructure US 47 ✓
fylehq.com Sage Expense Management (formerly Fyle): AI-Powered Expense Management Software
documentation Finance and payments Business software US 58 ✓ ✓
brandclickx.com Brand ClickX
documentation FR 48 ✓
arzdigital.com Arzdigital
documentation Finance and payments Media IR 60 ✓
u4n.com U4N
transactional Gaming Ecommerce HK 58 ✓
tosheroon.com Tosheroon
interface Data and analytics FI 53 ✓
toxsl.com Software and mobile app development company - ToXSL Technologies
documentation Developer tools Business software IN 52 ✓
observatorioblockchain.com Observatorio Blockchain
informational Media Crypto and Web3 — 50 ✓
stage.in STAGE
informational Entertainment and streaming IN 50 ✓
anakin.io Anakin.io
interface AI and machine learning AI agents and MCP +1 IN 51 ✓ ✓
gamechange.partners Partner Academy
documentation Marketing NO 46 ✓ ✓
seosherpa.com SEO SHERPA™
documentation Marketing — 57 ✓
walterreeves.com Walter Reeves: The Georgia Gardener
informational Home and garden US 50 ✓ ✓
gh-stores.com GH-Stores
transactional Ecommerce Fashion and beauty — 55 ✓
gaeta.it Gaeta.it
informational Media IT 52 ✓ ✓
reepl.io Reepl
interface AI and machine learning Marketing — 50 ✓ ✓
fdb4.io FDB4
interface AI agents and MCP APIs and SDKs +1 — 50 ✓ ✓
dwellmark.house dwellmark.house
interface Real estate Data and analytics US 46 ✓
joost.blog joost.blog
documentation Marketing Personal sites and blogs — 57 ✓
mysovi.ai Sovi.AI (mysovi.ai)
informational AI and machine learning — 48 ✓ ✓
your-erotic-stories.com Your Erotic Stories
informational Marketing CZ 52 ✓
gaugedb.com GaugeDB
documentation Gaming Data and analytics — 47 ✓
crawlbase.com Crawlbase
interface APIs and SDKs Data and analytics — 60 ✓ ✓
oceanblueproject.org Environmental Nonprofit Organization
documentation Nonprofit and advocacy US 52 ✓
vedantu.com Vedantu
transactional Education US 64 ✓
rhinoafrica.com Rhino Africa Safaris
documentation Travel ZA 56 ✓
spxflow.com llms.txt - AI Indexing Guidelines for SPXFLOW
US 45 ✓
espc.com llms.txt
documentation Local business Real estate GB 58 ✓
tandemdiabetes.com Tandem Diabetes Care
documentation Healthcare US 59 ✓
towardspackaging.com Towards Packaging Analytics & Consulting
documentation — 52 ✓ ✓
pogodnik.com Pogodnik — Ukrainian Weather Forecast Service
informational Media — 51 ✓
outbackequipment.com.au Outback Equipment
transactional Ecommerce AU 49 ✓
jetoctopus.com Technical SEO Platform for Google & AI Search
documentation Marketing — 49 ✓
spotdraft.com SpotDraft
documentation Legal Business software +1 US 61 ✓ ✓
thinkcontest.com 씽굿 ThinkGood
informational AI and machine learning Education +1 KR 46 ✓
code-brew.com Code Brew Labs
informational AI and machine learning US 55 ✓
aperlena.com Aperlena
documentation Data and analytics ES 47 ✓
findipv6.com FindIPv6
documentation Developer tools Infrastructure US 52 ✓
newamericanjackets.com New American Jackets - LLM Instructions
US 48 ✓
northamericanjackets.com North American Jackets - LLM Instructions
SG 46 ✓
ridgefieldrecovery.com The Recovery Village Ridgefield
transactional Healthcare US 52 ✓
sunbonoo.com sunbonoo.com
transactional Local business Travel — 51 ✓
simeononsecurity.com llms.txt for SimeonOnSecurity
— 50 ✓ ✓
stablediffusion.fr Stable Diffusion AI online
documentation AI and machine learning FR 55 ✓ ✓
warminboxes.com WarmInboxes.com
transactional Marketing Communications — 54 ✓ ✓