bsvblockchain.org BSV Hub
documentation Crypto and Web3 Documentation and reference — 58 ✓ ✓
northpole.security North Pole Security
documentation Cybersecurity US 56 ✓ ✓
ainetwork.ai AI Network
documentation — 51 ✓ ✓
intellipay.com IntelliPay
documentation Finance and payments US 56 ✓ ✓
crusoecloud.com Crusoe Cloud
interface Infrastructure AI and machine learning — 57 ✓ ✓
matt-haycox.com Matt Haycox
informational Media Personal sites and blogs — 47 ✓
apis.io APIs.io — Federated API Discovery Network
interface APIs and SDKs AI agents and MCP — 56 ✓ ✓
sftptogo.com SFTP To Go
transactional Infrastructure — 54 ✓
a-real.ru Интернет Контроль Сервер
documentation Cybersecurity RU 51 ✓
ennhri.org ENNHRI
informational Government and public services Nonprofit and advocacy US 49 ✓
cdnetworks.com 规则组 1: 针对所有爬虫的通用规则
documentation FR 48 ✓
mindnetwork.xyz Mind Network Docs
documentation Crypto and Web3 Science and research — 54 ✓ ✓
social9.com Social9
transactional Marketing — 50 ✓ ✓
bjkpfw.com Network Security Verification
informational ZA 46 ✓
valoannetwork.com VA Loan Network
documentation Finance and payments Documentation and reference US 55 ✓ ✓
unit21.ai Unit21 — LLMs.txt (Curated)
documentation Cybersecurity Finance and payments +1 US 56 ✓
frontendchecklist.io Front-End Checklist
documentation Marketing Developer tools +1 US 47 ✓
gomechanic.in llms.txt for gomechanic.in
documentation IN 47 ✓
openvibe.quest OpenVibe.Quest
interface — 45 ✓ ✓
asbn.com ASBN Small Business Network
informational Media US 50 ✓
goodaccess.com GoodAccess
documentation Cybersecurity Infrastructure DE 55 ✓
algosec.com AlgoSec
interface Cybersecurity — 56 ✓
startupnetworks.co.uk Startup Networks
documentation Community GB 55 ✓ ✓
txone.com TXOne Networks
documentation Cybersecurity Industry and manufacturing US 61 ✓ ✓
auditchain.com Auditchain Labs AG
documentation Finance and payments AI and machine learning +1 CH 55 ✓ ✓
xen-orchestra.com Xen Orchestra Blog
documentation Infrastructure DevOps and observability FR 59 ✓ ✓
berqnet.com Berqnet
documentation Cybersecurity — 55 ✓
easynac.com EasyNAC
documentation Infrastructure Cybersecurity +1 — 51 ✓
lightningcad.com LightningCAD
documentation Industry and manufacturing Business software NL 46 ✓
iqranetwork.com IQRA Network Help Center
documentation Education — 52 ✓
codesamplex.dev CodeSampleX
interface AI agents and MCP Developer tools KR 48 ✓
markethealth.com MarketHealth — Affiliate Network
documentation Healthcare Marketing CA 59 ✓ ✓
flashstart.com Flashstart
documentation Cybersecurity — 51 ✓
immunitysec.com ImmunitySec
documentation Cybersecurity Documentation and reference — 56 ✓
tuna.am Tuna Документация
documentation Infrastructure Developer tools RU 56 ✓ ✓
equilibriummarketing.com Equilibrium Marketing
documentation Marketing US 50 ✓ ✓
rolemodelsoftware.com RoleModel Software
documentation Business software NL 51 ✓
rampnetwork.com Ramp Network
interface Finance and payments Crypto and Web3 +1 US 57 ✓
nethris.com Access granted for GPTBot
documentation GB 48 ✓
centripetal.ai centripetal
documentation Cybersecurity — 52 ✓ ✓
21analytics.co 21 Analytics
documentation Finance and payments Cybersecurity — 51 ✓ ✓
cyberghostvpn.com CyberGhost VPN - llms.txt
documentation Infrastructure — 54 ✓
zeronetworks.com Zero Networks
documentation Infrastructure Cybersecurity — 58 ✓
mondoreale.it Mondoreale
informational Media IT 47 ✓
mgretailer.com Sensitive paths
— 53 ✓
sufy.com SUFY
interface AI and machine learning Infrastructure SG 50 ✓
respectnetwork.com Respect Network
informational Marketing FR 48 ✓ ✓
publicsectornetwork.com Public Sector Network
informational Government and public services Community AU 59 ✓ ✓
lbblawyers.com Landye Bennett Blumstein LLP
documentation Legal US 51 ✓
teldat.com llms.txt — Teldat
documentation Cybersecurity Infrastructure ZA 57 ✓ ✓
mmoo.bz MMOO Research
documentation Data and analytics Documentation and reference — 52 ✓
allerin.com Allerin
documentation AI and machine learning Industry and manufacturing US 57 ✓ ✓
concurrence.com Concurrence
documentation Healthcare AI and machine learning +1 US 55 ✓ ✓
wi-fi.click Wi-Fi.Click
documentation Telecom RU 54 ✓
nium.com Nium
interface Finance and payments APIs and SDKs US 58 ✓
giga.ai Giga
documentation AI and machine learning Communications +1 US 54 ✓
dilendorf.com Dilendorf Law Firm PLLC
documentation Legal US 52 ✓
icade.fr Specific rules for AI crawlers
informational FR 47 ✓
formal.ai Formal
interface AI and machine learning Cybersecurity +1 — 51 ✓
startupdefense.io Startup Defense
documentation Cybersecurity US 47 ✓
creationcare.org Evangelical Environmental Network
documentation Nonprofit and advocacy US 49 ✓
pathwayshp.com Pathways Health Partners
informational Healthcare US 46 ✓
jmssjgzsx.com Network Security Verification
informational ZA 46 ✓
maldivese.com Maldives Online Casino
informational Gaming — 48 ✓
cash2bitcoin.com Cash2Bitcoin
documentation Crypto and Web3 US 52 ✓
pagbets.org PagBets.org
informational Gaming Entertainment and streaming — 56 ✓
benheine.com BenHeine, your daily dose of Art and Tech news: Find here Artworks, Tech and entrepreneurship articles, Live Art, Video content, e\-Marketing by Ben Heine, Art Therapy workshops, Pencil Vs Camera in S
transactional Arts and culture Marketing +1 DE 53 ✓
qjmotoritaly.com Network Security Verification
informational HK 46 ✓
doctormgt.com DoctorMGT
documentation Healthcare US 53 ✓
gorilladash.com Gorilla Dash
interface Marketing Business software +1 US 53 ✓
seon.io SEON
documentation Cybersecurity US 53 ✓
myplace.app MyPlace
interface Food and dining Marketing +1 US 51 ✓
awsfundamentals.com AWS Fundamentals
documentation Documentation and reference Infrastructure — 55 ✓ ✓
mahannet.ir خرید اینترنت پرسرعت ماهان نت
transactional Telecom IR 48 ✓
venuelabs.com Jitendra Vaswani
informational Marketing US 49 ✓
zyllem.com Zyllem
documentation AI and machine learning Ecommerce +1 SG 52 ✓
acc-ict.com ACC ICT
documentation Infrastructure — 48 ✓
thelendersnetwork.com The Lenders Network
documentation Finance and payments US 51 ✓
strike.me Your Bitcoin company
documentation Finance and payments Crypto and Web3 — 54 ✓
oraclemobilesecurity.com admin
documentation Cybersecurity — 48 ✓
gozunga.com Gozunga
documentation Infrastructure — 52 ✓
postalbridge.com PostalBridge
transactional Telecom US 55 ✓
lasso.security Lasso Security — llms.txt
US 48 ✓
nersa.org.za National Energy Regulator of South Africa (NERSA)
documentation Government and public services ZA 50 ✓
siptrunk.com SIPTRUNK.com
documentation Communications Telecom US 50 ✓
innefu.com Innefu Labs
informational AI and machine learning Cybersecurity +1 IN 52 ✓
authelia.com Authelia
documentation Open source projects Authentication and identity +1 US 57 ✓
netop.com Netop
documentation Cybersecurity DE 53 ✓
teslatel.ru Teslatel
informational Telecom Infrastructure RU 56 ✓ ✓
modernmarket.com Modern Market Eatery
informational Marketing Food and dining — 53 ✓
innoloft.com Innoloft
documentation No-code and automation Business software — 55 ✓
4netplayers.com llms.txt for 4Netplayers
informational DE 47 ✓
walrus.xyz Walrus
documentation Infrastructure AI agents and MCP US 61 ✓ ✓
tophentai.com Top Hentai
informational — 53 ✓
localtonet.com Localtonet (https://localtonet.com)
interface AI and machine learning Infrastructure +2 DE 64 ✓ ✓
oroagents.com ORO AI
interface Developer tools AI and machine learning +1 — 51 ✓ ✓
splashaccess.com SplashAccess
informational Data and analytics Infrastructure +1 — 51 ✓
doothemes.com Doothemes
documentation Marketing — 57 ✓ ✓
finera.com finera.
documentation Finance and payments US 52 ✓
wedos.eu WEDOS.zone
informational Cybersecurity CZ 47 ✓
fincenfetch.com FincenFetch
documentation Business software — 46 ✓
enterprisenetworkingplanet.com Enterprise Networking Planet
informational Infrastructure — 53 ✓
sms.to SMS.To
interface Developer tools Communications +1 US 55 ✓
latchel.com Latchel
documentation Business software Real estate — 56 ✓ ✓
99ff16.com Network Security Verification
informational ZA 46 ✓
birite.com BiRite Foodservice Distributors - Restaurant Food and Equipment Supply
documentation Food and dining Marketing +1 US 46 ✓
vertbaudet.fr FICHIER LLMS.TXT - CONTROLE D'ACCES AUX IA GENERATIVES (LLMs)
FR 48 ✓
sa.guide Mid Murray - Australian Regional Network
documentation AU 46 ✓
hounds.fun Hounds
transactional Crypto and Web3 HK 45 ✓ ✓
timly.com LLMs.txt - AI access policy
documentation — 45 ✓
defined.net Defined Networking
transactional Infrastructure Cybersecurity — 57 ✓
crypto.news crypto.news
informational Media Crypto and Web3 — 66 ✓ ✓
asnhomecaremarketing.com Approved Senior Network®
documentation Marketing US 51 ✓
casino.com LLMS.txt - Large Language Model Access Policy for Casino.com
informational AI and machine learning Gaming — 50 ✓
wearerealty.com WE ARE REALTY
documentation Marketing Real estate +1 — 47 ✓
newshosting.com llms.txt for https://www.newshosting.com
informational US 55 ✓
compumundohipermegared.one AS203258
documentation Infrastructure Personal sites and blogs DE 51 ✓
your-materiel.com Your Materiel
transactional Consumer electronics Ecommerce — 46 ✓
k-1.info K-1 CLASSICS
documentation Sports and fitness — 46 ✓
manjaro.news nerdvpn.de and all subdomains
informational AI and machine learning CA 46 ✓
principia-scientific.com Principia Scientific, Intl.
informational Media — 59 ✓
captchafox.com CaptchaFox
documentation Infrastructure Cybersecurity FR 56 ✓
whop.com Whop
interface Finance and payments APIs and SDKs — 62 ✓
ravelin.com Ravelin
documentation AI and machine learning Ecommerce +2 US 56 ✓
devops-daily.com DevOps Daily
documentation Developer tools Infrastructure +2 — 54 ✓ ✓
webhookrelay.com Webhook Relay
interface Infrastructure DevOps and observability +1 — 50 ✓ ✓
linqia.com Linqia
informational Marketing US 59 ✓
indiantelevision.com Indian Television Dot Com
informational Media US 60 ✓
buyproxies.org Buy proxies
documentation Infrastructure Developer tools — 48 ✓
ravion.com Ravion
interface Developer tools DevOps and observability +2 — 50 ✓ ✓
yourpokerdream.com YourPokerDream
documentation Gaming — 56 ✓
beneschlaw.com Benesch Law
informational Legal US 53 ✓
sealifeparkhawaii.com Sea Life Park Hawaii
transactional Travel US 53 ✓
runwaylive.com RUNWAY — Entity Resolution and Primary-Source Index
informational — 45 ✓ ✓
ropere.com Ropere — Electronics, Networking & Energy Solutions
interface Ecommerce Consumer electronics — 51 ✓ ✓
lgnetworksinc.com LG Networks, Inc.
documentation Cybersecurity Business software +1 US 53 ✓
sfcompute.com San Francisco Compute
interface AI and machine learning Infrastructure US 51 ✓
novelbits.io Novel Bits
documentation Developer tools Education — 51 ✓ ✓
marketingagency.sg Marketing Agency Singapore
documentation Ecommerce Industry and manufacturing +1 SG 48 ✓
semgrep.dev Semgrep
documentation Cybersecurity Developer tools — 61 ✓
fineproxy.org FineProxy
interface Infrastructure — 57 ✓
prh.org Physicians for Reproductive Health: A network of providers advocating for equitable reproductive health care, dignity, and freedom for all\.
documentation Healthcare Nonprofit and advocacy — 53 ✓
clickpatrol.com ClickPatrol
documentation Marketing Cybersecurity IE 46 ✓
here.com HERE Technologies
interface Data and analytics APIs and SDKs US 66 ✓
medwave.io Medwave Billing & Credentialing
documentation Finance and payments Healthcare US 51 ✓ ✓
meetingapplication.com meetingapplication.com
documentation Business software US 48 ✓
jorianwoltjer.com Practical CTF
documentation Cybersecurity Documentation and reference — 46 ✓ ✓
xaccel.net Xaccel Networks
documentation Cybersecurity Infrastructure US 53 ✓
euclidnet.com Euclid Networks
informational Local business US 46 ✓
chatujme.cz Chatujme.cz
documentation Community CZ 59 ✓
psychotherapynetworker.org Psychotherapy Networker
informational Education Healthcare US 58 ✓
iplocationblock.com IP Location Block
interface Cybersecurity APIs and SDKs — 56 ✓
atmosvere.eu Atmosvere
documentation Cybersecurity FR 49 ✓
klimaprotocol.com Klima Protocol
documentation Crypto and Web3 US 52 ✓
een.com Eagle Eye Networks
documentation Cybersecurity US 57 ✓
dataremote.com DataRemote
transactional Ecommerce Telecom US 58 ✓
core.app Core
transactional Crypto and Web3 — 58 ✓
flightq.app FlightQ
informational Entertainment and streaming Travel — 54 ✓ ✓
formblends.com FormBlends
interface Healthcare US 55 ✓ ✓
colive.com Colive
informational Real estate IN 52 ✓
timesofblockchain.com Times Of Blockchain
informational Crypto and Web3 Media — 48 ✓
findipv6.com FindIPv6
documentation Developer tools Infrastructure US 52 ✓
mewurk.com Mewurk
transactional Productivity Business software +1 ZA 51 ✓
medplum.com Medplum
interface Healthcare Developer tools +1 — 58 ✓ ✓
daveywater.com Davey Water Products - LLMs.txt
documentation — 46 ✓
datingapi.io Dating API
documentation APIs and SDKs US 45 ✓ ✓
redfoxsec.com Redfox Cybersecurity
documentation Cybersecurity Ecommerce +2 US 51 ✓
bitcoinnews.com Bitcoin News
informational Media Crypto and Web3 — 56 ✓
vocphone.com VOCPhone: Voice over Cloud
transactional Marketing Communications +1 AU 52 ✓
paproviders.org Rehabilitation & Community Providers Association (RCPA)
informational Healthcare Nonprofit and advocacy US 48 ✓
coopboardgames.com Co-op Board Games
informational Gaming — 49 ✓
cybertechnologyinsights.com cybertechnologyinsights.com
documentation Marketing Media +1 US 51 ✓
dt-global.com DTGlobal
documentation — 49 ✓
summit-broadband.com Summit Broadband
documentation Telecom US 52 ✓
ifokus.se iFokus
documentation Community SE 53 ✓
bitcoincasinoaffiliates.com Bitcoin Casino Affiliates
documentation Gaming Marketing — 47 ✓
artiba.org www.artiba.org
transactional Education AI and machine learning US 52 ✓
nownodes.io NOWNodes — AI & Developer Routing Index
interface AI and machine learning Infrastructure +2 — 61 ✓ ✓
flow.space Flowspace
documentation Ecommerce Logistics and shipping US 55 ✓
host-tracker.com HostTracker
transactional DevOps and observability — 60 ✓
growthepie.com growthepie
documentation Data and analytics US 57 ✓ ✓
clintoncountydailynews.com Clinton County Daily News
informational Media US 55 ✓
fraud.net FraudNet
documentation Cybersecurity Finance and payments US 57 ✓
speedkit.com Speed Kit
documentation Ecommerce Marketing +1 — 56 ✓ ✓
timesofcasino.com Times Of Casino
informational Gaming Media — 51 ✓
saasultra.com Jitendra Vaswani
informational Marketing GB 48 ✓
bugbytes.com Hiero
documentation APIs and SDKs Developer tools US 50 ✓ ✓
balleralert.com Baller Alert
informational Media US 61 ✓ ✓
chipp.ai Chipp AI
transactional AI and machine learning AI agents and MCP US 55 ✓ ✓
lawyersmutualnc.com Lawyers Mutual Insurance Of North Carolina
documentation Legal Insurance US 49 ✓
casinos.org Casinos.org
informational Entertainment and streaming Media — 48 ✓
e-invoice.be e-invoice.be
interface Developer tools APIs and SDKs +1 BE 45 ✓ ✓
rarediseases.org National Organization for Rare Disorders: NORD
informational Healthcare Nonprofit and advocacy — 60 ✓
gamster.org Gamster
documentation Gaming Community — 51 ✓
pubnub.com PubNub Platform
interface Infrastructure APIs and SDKs +1 US 68 ✓ ✓
ltcillinois.org Learning Technology Center
documentation Education Cybersecurity US 54 ✓
gsfleet.io GSFleet
documentation Automotive Business software DE 46 ✓
underbrain.com Underbrain Mgz
documentation Media Arts and culture IT 53 ✓
unchainedcrypto.com Unchained
informational Media Crypto and Web3 — 59 ✓
hire.engineer Hire
transactional Recruiting and careers DE 51 ✓ ✓
incredible.co.za Incredible Connection
transactional Ecommerce Consumer electronics ZA 58 ✓ ✓
tmcobb.com T.M. Cobb
transactional Construction and architecture US 55 ✓ ✓
regroove.ca Regroove IT Consulting
informational Cybersecurity Business software +1 CA 46 ✓
aeronyx.network AeroNyx
documentation Communications — 50 ✓ ✓
pandorainsurance.com Pandora Insurance: Auto \| Home \| Commercial \| Life \| Health
documentation Healthcare Insurance US 46 ✓
popcorn.space Popcorn
transactional Communications Travel — 53 ✓
searchhub.io searchHub
documentation Ecommerce AI and machine learning +1 DE 51 ✓
icirr.org ICIRR
interface Healthcare Nonprofit and advocacy US 52 ✓
operavps.com Operavps
documentation Infrastructure — 51 ✓
neoagent.io Neo Agent
interface AI and machine learning Productivity +2 US 46 ✓
getmysa.com Mysa Smart Thermostats
transactional Consumer electronics Home and garden CA 61 ✓ ✓
nextcarehealth.com Nextcare: Your health managed with care
transactional Healthcare Insurance FR 59 ✓
behavox.com Behavox
documentation Cybersecurity Business software US 57 ✓ ✓
bunny.net bunny.net Documentation
interface Infrastructure Documentation and reference +1 FR 70 ✓ ✓
edel.finance Edel
documentation Finance and payments Crypto and Web3 US 50 ✓
klippa.com Klippa
documentation Data and analytics AI and machine learning +1 — 57 ✓
balluff.com Balluff
documentation Industry and manufacturing DE 55 ✓
cloudquery.io CloudQuery
documentation AI and machine learning Data and analytics +2 — 54 ✓ ✓
maxprograms.com Maxprograms - Solutions for the Translation Industry
transactional Developer tools Open source projects US 51 ✓
myipscan.net MyIPScan
documentation Infrastructure Cybersecurity — 48 ✓ ✓
gastopowerjournal.com Gas to Power Journal
informational Energy and utilities Media US 53 ✓
soulshepherding.org Soul Shepherding
informational — 53 ✓
alc.org.au NSW Aboriginal Land Council
documentation Marketing Government and public services AU 47 ✓
zyphe.com Zyphe
documentation AI and machine learning AI agents and MCP +1 — 55 ✓ ✓
edgeone.ai Tencent EdgeOne
interface Infrastructure Cybersecurity SG 57 ✓
slash.com Slash Financial
interface Finance and payments APIs and SDKs US 52 ✓
swapwallet.app SwapWallet
interface Crypto and Web3 DE 51 ✓
proxus.io Proxus
interface Data and analytics Industry and manufacturing +2 — 45 ✓ ✓
brollyacademy.com Brolly Academy
documentation AI and machine learning Education IN 48 ✓
kharon.com Kharon
interface Data and analytics Cybersecurity +1 US 56 ✓
coywolf.com Coywolf
documentation AI and machine learning Personal sites and blogs — 52 ✓
godigit.com Digit Insurance
informational Insurance IN 59 ✓
linkbase.com Linkbase
transactional AI and machine learning Marketing +1 — 51 ✓
dappcdn.com dAppCDN - Decentralized Application Content Delivery Network
documentation Infrastructure Open source projects — 48 ✓
payrails.com Payrails
interface Finance and payments APIs and SDKs US 51 ✓
alltechsupport.com Alltech IT Solutions
documentation Business software Cybersecurity US 52 ✓
doba.com Doba — AI-Powered Dropshipping Platform
transactional Ecommerce Business software US 53 ✓
bitdefender.com Bitdefender | Global Leader in Cybersecurity
transactional Cybersecurity — 67 ✓
mitchellmartin.com Mitchell Martin
informational Recruiting and careers US 52 ✓
synthesized.io Synthesized
documentation AI and machine learning Developer tools +2 US 47 ✓
hendersonchamber.com Henderson Chamber of Commerce
informational Local business US 52 ✓
glpi-project.org www.glpi-project.org
documentation Business software Open source projects FR 59 ✓
pharmacytimes.com Pharmacy Times
informational Healthcare Media US 62 ✓
atlanticcourier.net Atlantic International Express
documentation Logistics and shipping IN 56 ✓ ✓
braiins.com Braiins
documentation Crypto and Web3 — 61 ✓
m2pfintech.com M2P Fintech
interface Finance and payments APIs and SDKs IN 56 ✓
arootah.com Alternative Investment Talent & Executive Coaching Services | Arootah
documentation Recruiting and careers — 52 ✓
istanbul-ist-international-airport.com Istanbul Airport Guide
documentation Travel — 51 ✓
centrifuge.io Centrifuge
documentation Finance and payments Crypto and Web3 — 47 ✓
civic-forum.eu European Civic Forum
informational Nonprofit and advocacy FR 47 ✓