thehistorypress.co.uk The History Press: Independent non\-fiction publisher
transactional Media GB 54 ✓
grpm.org Grand Rapids Public Museum: Be curious\.
informational Arts and culture US 48 ✓
historicalclimatology.com Historical Climatology
documentation Science and research — 47 ✓
publicorthodoxy.org Public Orthodoxy
informational Education Arts and culture +1 US 51 ✓
publicmedievalist.com The Public Medievalist: The Middle Ages in the Modern World
informational Arts and culture Media US 48 ✓
ourhkfoundation.org.hk Our Hong Kong Foundation (OHKF)
informational Science and research Nonprofit and advocacy HK 49 ✓
historycollection.com History Collection: Covering History's Untold Stories
informational Marketing Media +1 GB 60 ✓
supremecourthistory.org Supreme Court Historical Society: Supreme Court Historical Society
documentation Nonprofit and advocacy Education — 58 ✓
historykon.pl Historykon\.pl: Historia w zasięgu ręki\!
informational Media PL 49 ✓
audioaz.com AudioAZ
interface Media — 54 ✓
goguides.com GoGuides
interface Data and analytics US 48 ✓
mintlayer.org Updated: 2026-04-15
— 45 ✓ ✓
bestblogs.dev BestBlogs.dev
documentation AI and machine learning Media US 46 ✓
fondazionegramsci.org Fondazione Gramsci onlus
documentation Marketing Nonprofit and advocacy +1 DE 54 ✓
audubonart.com Oppenheimer Gallery: The Natural History Art Gallery
transactional Arts and culture Ecommerce — 50 ✓
belmont.edu LLM Crawling Directives for Belmont University
informational Education — 56 ✓
chimesfreedom.com chimesfreedom: Pophistory: music, movies, history, and life\.
informational Marketing Media +1 US 46 ✓
getfreed.ai Freed Public Pages
documentation Healthcare AI and machine learning US 60 ✓
streetartutopia.com STREET ART UTOPIA: We declare the world as our canvas
informational Marketing Arts and culture US 59 ✓
thehistorylist.com The History List
informational Arts and culture Events and conferences US 46 ✓
alelo.com.br =========================
BR 46 ✓
geaugalibrary.net Geauga County Public Library
documentation Marketing Government and public services US 47 ✓
oroagents.com ORO AI
interface Developer tools AI agents and MCP +1 — 50 ✓ ✓
historydefined.net History Defined
informational US 52 ✓
fortticonderoga.org Fort Ticonderoga
documentation Arts and culture Travel — 51 ✓
switchyardpark.com Switchyard Park
informational Marketing Arts and culture — 46 ✓
html-color-codes.info ========================================
US 45 ✓
ctpublic.org Connecticut Public
informational Media US 61 ✓
metadata.io Metadata
interface AI and machine learning Marketing +1 US 53 ✓
hurra.com encoding: UTF-8
DE 49 ✓
zabalist.com Zabalist — Texas Construction Intelligence
documentation Data and analytics Construction and architecture — 47 ✓
nimbus.ca Nimbus Publishing and Vagrant Press
transactional Media Ecommerce CA 50 ✓
newyorkalmanack.com New York Almanack: History, Natural History & the Arts
informational Arts and culture Media US 52 ✓
mcny.org Museum of the City of New York
transactional Arts and culture US 61 ✓
keeptrack.space KeepTrack
interface Media Science and research +1 — 57 ✓
monkey.app =========================================
— 48 ✓
holla.world =========================================
— 47 ✓
sirillp.com Siri & Glimstad LLP: Delivering Justice Nationwide
informational Legal — 47 ✓
alcoholproblemsandsolutions.org Alcohol Problems and Solutions
informational Marketing US 48 ✓
glagoslav.com Glagoslav Publications
transactional Arts and culture — 46 ✓
candelamedical.com ============================================================
US 49 ✓
biometricsinstitute.org Biometrics Institute
informational Nonprofit and advocacy AU 48 ✓
aao.org ============================================================
— 52 ✓
acpl.lib.in.us Allen County Public Library
interface Education Arts and culture US 45 ✓
meda.org MEDA
informational Nonprofit and advocacy US 48 ✓
populartimelines.com Popular Timelines
informational Education DE 48 ✓
ro.am Roam Guides
documentation Productivity — 50 ✓
iis.ac.uk The Institute of Ismaili Studies
documentation Education Science and research GB 47 ✓
muzeumlotnictwa.pl Muzeum Lotnictwa Polskiego w Krakowie
informational Arts and culture PL 51 ✓
publicstorage.com Public Storage
transactional Local business — 60 ✓
kosokubus.com =========================================================
JP 45 ✓
connecticuthistory.org Connecticut History | a CTHumanities Project
documentation US 59 ✓
newsbank.com NewsBank, Inc.
documentation Data and analytics Education US 62 ✓
clientam.com =========================================================
FR 45 ✓
stateof.ai State of AI Report
documentation AI and machine learning DE 61 ✓ ✓
adbutler.com =========================================================
US 46 ✓ ✓
r-and-company.com R & Company
transactional Arts and culture US 47 ✓
stockfilm.com Stockfilm
transactional Education Media +1 — 51 ✓ ✓
skinory.io Skinory
documentation Gaming — 50 ✓ ✓
southernfoodways.org Southern Foodways Alliance
informational Food and dining Nonprofit and advocacy US 58 ✓
sbicard.com =====================================================
IN 49 ✓
hmapr.com HMA Public Relations
documentation Marketing US 47 ✓
hollins.edu Hollins University: Inspiring\. Challenging\. Distinctive\.
documentation Education US 54 ✓
todayingeorgiahistory.org Today In Georgia History
informational Marketing Education US 48 ✓
sahistory.org.za South African History Online (SAHO)
documentation Education Science and research ZA 52 ✓
deletefootprints.ai DeleteFootprints.ai
documentation AI and machine learning Cybersecurity US 47 ✓
warren-wilson.edu Warren Wilson College
documentation Education US 52 ✓
tractivity.co.uk Tractivity
documentation Business software GB 54 ✓
charlestonranked.com CharlestonRanked
interface Travel US 51 ✓ ✓
eltiempo.es =====================================================================
ES 48 ✓
perpfuse.com perpfuse
documentation Finance and payments Data and analytics RU 52 ✓ ✓
drive-ins.com Drive-Ins.com
documentation Arts and culture US 48 ✓
theweathernetwork.com =====================================================================
CA 51 ✓
pestworld.org www.pestworld.org/llms.txt
documentation Education US 61 ✓
publicsectornetwork.com Public Sector Network
informational Government and public services Community — 54 ✓ ✓
opper.ai Opper AI
interface AI and machine learning APIs and SDKs +1 — 59 ✓ ✓
underbrain.com Underbrain Mgz
documentation Media IT 53 ✓
synopticdata.com Synoptic Data
interface Data and analytics Science and research GB 57 ✓
codex-reset.com Codex Reset
documentation AI and machine learning — 54 ✓ ✓
mariamitchell.org www.mariamitchell.org
documentation Science and research Education US 47 ✓
fansmetric.com FansMetric
interface Marketing Business software +1 US 56 ✓ ✓
crystalmeth.org Crystal Meth Anonymous: Can’t Stop Using? There is a solution\.
transactional Healthcare Nonprofit and advocacy US 48 ✓
gadget.dev Overview
US 48 ✓
tela.com Tela
interface AI and machine learning Business software — 52 ✓
webdesignernews.com WebDesignerNews
interface Design Media US 48 ✓
dailydrop.com Daily Drop
— 47 ✓
ls.app Linken Sphere
documentation Cybersecurity IE 58 ✓
worldhistory.org World History Encyclopedia
documentation Science and research Education +1 GB 65 ✓
beonemedicines.com Guidance for Large Language Model (LLM) crawlers
informational AI and machine learning Healthcare +1 — 58 ✓
cinephiliabeyond.org Cinephilia & Beyond
informational Media Arts and culture HR 57 ✓
upy.ac.id Universitas PGRI Yogyakarta: Humanis, Glokal dan Entrepreneur
documentation Education ID 57 ✓
spmoh.com St\. Petersburg Museum of History
informational Marketing Arts and culture US 46 ✓
world4.eu World4 - Costume - Culture - History
informational Arts and culture FR 46 ✓
daralwahi.com Dar Al Wahi Publication
transactional Arts and culture — 57 ✓ ✓
mentalfloss.com Mental Floss
informational Education Media US 67 ✓
vintageguitar.com Vintage Guitar® magazine
informational Media — 54 ✓
all-about-photo.com All About Photo
informational Arts and culture Media US 58 ✓
rezstream.com rezStream
informational US 51 ✓
aleksvideo.ru Японская кухня и местные блюда
informational Food and dining RU 49 ✓
sen7ry.com Sentry
— 46 ✓ ✓
viralmag.fr Viral Mag
informational Media FR 49 ✓
errortrace.dev Sentry
US 57 ✓ ✓
moneyconvert.net MoneyConvert.net
interface Finance and payments Data and analytics — 52 ✓ ✓
anysearch.com AnySearch Documentation
— 51 ✓ ✓
4dmoleculartherapeutics.com 4DMT
informational Marketing Healthcare +1 — 48 ✓
eps.org European Physical Society
informational Education Science and research +1 FR 59 ✓
alfred.edu Page Not Found
informational — 53 ✓ ✓
instastatistics.com Instastatistics
interface Data and analytics APIs and SDKs — 63 ✓ ✓
gehlpeople.com Gehl
documentation Construction and architecture FI 52 ✓
thepinktimes.com The Pink Times
informational Media DE 53 ✓
talentlms.com ─────────────────────────────
— 49 ✓
hwphotobooths.ca HW Photobooths
transactional Gaming Events and conferences CA 57 ✓
kaikokinenkaikan.com 横浜市開港記念会館
documentation Marketing Arts and culture JP 46 ✓
cursor.com Cursor Documentation
US 58 ✓
cursor.sh Cursor Documentation
US 54 ✓
gasenginemagazine.com Gas Engine Magazine
transactional Arts and culture Media — 47 ✓
historiek.net Historiek
informational Arts and culture — 50 ✓
mossandfog.com Moss & Fog
documentation Design Arts and culture +1 US 54 ✓
historyoasis.com History Oasis
documentation Media — 46 ✓
gretnala.com City Of Gretna
documentation Marketing Government and public services US 47 ✓
scandiweb.com llms.txt version: 1.0
— 50 ✓
ecotarium.org EcoTarium
informational Arts and culture Education US 48 ✓
waywordradio.org A Way with Words
informational Media US 58 ✓
taylor.edu 404 Page Not Found
— 52 ✓ ✓
intpubnyc.com International Publishers: Books to Help You Understand and Change the World\!
transactional Ecommerce Media US 47 ✓
qualcomm.com Qualcomm Incorporated
documentation Consumer electronics Documentation and reference US 65 ✓
ancestry-stories.com Ancestry\-stories\.com: Family history true stories
informational DE 46 ✓
sherlock.xyz Sherlock (sherlock.xyz)
informational US 45 ✓
theboxplymouth.com The Box Plymouth: Museum, Art Gallery, Archive
informational Arts and culture GB 51 ✓
iabmexico.com IAB México
documentation Marketing US 48 ✓
clipssaver.com ClipsSaver
documentation Media — 52 ✓ ✓
unusualwhales.com Unusual Whales
interface APIs and SDKs Data and analytics +1 — 55 ✓ ✓
historicthirdward.org Historic Third Ward
interface Local business US 45 ✓
oeschinensee.ch Oeschinensee: Ankommen, die Natur spüren\.
informational Travel CH 48 ✓
acrearpublicidad.com Acrear Publicidad
transactional Local business FR 52 ✓ ✓
matrijs.com Uitgeverij Matrijs: Publicaties op historisch gebied
transactional Arts and culture Media NL 47 ✓
blackgirlnerds.com Black Girl Nerds: The Intersection of Geek Culture and Black Feminism
informational Arts and culture Media US 58 ✓
worldmusicviews.com World Music Views: DISCOVER A WORLD OF MUSIC
informational Marketing Media +1 FR 46 ✓
puntajenacional.cl Puntaje Nacional
documentation Education CL 46 ✓
borong.com Borong
documentation — 54 ✓ ✓
tnsr.org Texas National Security Review: An interdisciplinary journal committed to excellence, scholarly rigor and accessibility to the public and policymakers\.
documentation Marketing Science and research US 59 ✓
hackshackers.com Hacks/Hackers
interface Media AI agents and MCP — 53 ✓ ✓
filmsinreview.com Films in Review
interface Media Arts and culture US 45 ✓
altenergymag.com AltEnergyMag
informational Media Energy and utilities CA 56 ✓
welcometoskipton.com Welcome to Skipton
informational Local business GB 50 ✓
bleeding.org Bleeding.org
documentation Healthcare Nonprofit and advocacy US 59 ✓
tourismvictoria.com Tourism Victoria
documentation Travel US 59 ✓
brusselsmorning.com Brussels Morning Newspaper
informational Media US 53 ✓
coti.io COTI — Private Programmable Money
documentation Crypto and Web3 — 52 ✓
abpn.org.br ABPN
documentation Nonprofit and advocacy Education BR 47 ✓
nortal.com Nortal
documentation Business software US 58 ✓
missoulapubliclibrary.org Missoula Public Library
documentation Education Government and public services FR 47 ✓
public.com Public: Invest in stocks, ETFs, crypto, and alternatives in one place\.
interface Finance and payments AI agents and MCP +1 US 60 ✓
thelibrary.org Springfield-Greene County Library
interface Education Arts and culture US 54 ✓
customweather.com CustomWeather | Weather API, Historical Weather & Alerts
interface AI and machine learning APIs and SDKs US 46 ✓
opengov.com OpenGov
documentation Business software Government and public services — 56 ✓
minecraft.how Minecraft.How - Site Map & AI Access Notes
documentation Gaming US 56 ✓ ✓
crafty.gg Crafty
informational Gaming — 52 ✓ ✓
denverunionstation.com Denver Union Station
transactional Food and dining Local business +1 US 52 ✓
lmkr.com LMKR
documentation Business software Data and analytics AE 52 ✓ ✓
swgde.org SWGDE
documentation Science and research Cybersecurity — 47 ✓
ngram.com ngram
interface AI and machine learning Media US 54 ✓ ✓
fpp.co.uk Focal Point Publications
documentation Science and research GB 57 ✓ ✓
telemetr.com telemetr.com
interface Data and analytics Marketing — 45 ✓ ✓
tgads.net tgads.net
interface Marketing APIs and SDKs — 45 ✓ ✓
tgadsspy.com Telegram Ads Spy
interface Marketing Data and analytics — 53 ✓ ✓
telegramstats.io Telegram Channel Stats
interface Data and analytics Marketing — 51 ✓ ✓
adsguru.org Telegram Ads Research
interface Marketing Data and analytics — 50 ✓ ✓
telegramadsarchive.com Telegram Ads Archive
interface Media Marketing +1 — 50 ✓ ✓
telegramadsfeed.com Telegram Ads Feed
interface Marketing — 50 ✓ ✓
telegramadsanalytics.com Telegram Ads Analytics
interface Data and analytics Marketing +1 — 45 ✓ ✓
telegramadsspy.com Telegram Ads Spy
interface Marketing Data and analytics — 45 ✓ ✓
telegramstats.net Telegram Channel Stats
interface Marketing Data and analytics — 45 ✓ ✓
tgads.observer Telegram Ads Observer
interface Marketing — 45 ✓ ✓
tgads.xyz Telegram Ad Library
documentation Marketing — 45 ✓ ✓
tgmetrics.net Telegram Ads Benchmarks
interface Marketing Data and analytics +1 — 45 ✓ ✓
tgads.info Telegram Ads Help Center
documentation Marketing Data and analytics — 54 ✓ ✓
tgads.biz Telegram Ads for Business
interface Marketing APIs and SDKs — 45 ✓ ✓
bestapps.tg Best Telegram Mini-Apps
documentation Marketing TG 45 ✓ ✓
topapps.tg Top Telegram Mini-Apps
interface Marketing Data and analytics TG 45 ✓ ✓
appagg.com AppAgg
documentation Gaming US 57 ✓
nile1.com NILE1
informational Media US 47 ✓
alcademics.com Alcademics
transactional Marketing Personal sites and blogs FR 51 ✓
movieparadise.app Movie Paradise
informational Entertainment and streaming — 57 ✓ ✓
iniva.org iniva
informational Arts and culture GB 49 ✓
foropenal.com Foro Penal
documentation Nonprofit and advocacy — 51 ✓
nd-center.com ND Center
informational Education US 47 ✓
linkedhelper.com Linked Helper
documentation Marketing US 62 ✓ ✓
dietitians.ca Dietitians of Canada
documentation Nonprofit and advocacy Healthcare CA 54 ✓
stcharlesparks.com St. Charles Parks and Recreation
informational Marketing Government and public services US 53 ✓
michiganvirtual.org Michigan Virtual
documentation Education — 52 ✓
cmcc.it CMCC: Centro Euro\-Mediterraneo sui Cambiamenti Climatici
documentation Science and research IT 52 ✓
tecinfobcn.com TecinfoBCN
transactional Consumer electronics Local business ES 47 ✓
culturalq.com Cultural Intelligence Center
documentation Education US 49 ✓
emeraldbook.org Emerald Book
documentation Media US 46 ✓
norwichvoice.ca Norwich Voice
documentation CA 45 ✓ ✓
govspend.com GovSpend
documentation Business software Data and analytics +1 US 59 ✓ ✓
brouky.tech Brouky
informational Finance and payments AI and machine learning — 46 ✓
korben.info Korben.info
informational Media — 61 ✓ ✓
kuksi.com kuksi
interface Arts and culture US 45 ✓
esegece.com eSeGeCe
documentation Developer tools APIs and SDKs ES 56 ✓ ✓
pelhamlibrary.org Town of Pelham Public Library: 530 Colonial Ave, Pelham, NY 10803 \(914\) 738\-1234
informational Government and public services Education US 46 ✓
politica-china.org Observatorio de Política China [OPCh]
informational Marketing Science and research ES 46 ✓
intrinseca.com.br Editora Intrínseca: Publicamos poucos e bons livros\!
informational Marketing Media BR 56 ✓
orderly.network Orderly Network
documentation Crypto and Web3 Developer tools US 60 ✓ ✓
hawksleyworkman.com Hawksley Workman 2
interface Entertainment and streaming US 45 ✓
westernspirit.org Western Spirit Museum
documentation Arts and culture US 47 ✓
losprimeros.tv Los Primeros TV
informational Media — 49 ✓
tysol.pl Tysol.pl
informational Media PL 54 ✓
pointcast.xyz PointCast
documentation — 45 ✓ ✓
ucel.edu.ar UCEL
transactional Education AR 45 ✓
arquives.ca The ArQuives
transactional Arts and culture CA 55 ✓
ipocentral.in IPO Central
documentation Finance and payments IN 51 ✓
publica.la publica.la
interface Ecommerce Media +1 — 55 ✓ ✓
backtweets.com backtweets
interface Community Marketing — 48 ✓
mobileindustryreview.com Mobile Industry Review
informational Media — 46 ✓
fluxproweb.com FluxProWeb
transactional Design AI and machine learning — 50 ✓ ✓
ielfreight.com Late September Truckload Update: Regional Pressure Builds Ahead of the Fourth Quarter
informational Logistics and shipping US 46 ✓ ✓
wanthishirt.com Wanthishirt
documentation Entertainment and streaming — 50 ✓ ✓
psychologicalscience.org Association for Psychological Science (APS)
documentation Science and research Nonprofit and advocacy US 65 ✓
hpr1.com High Plains Reader Fargo, ND
informational Media — 48 ✓
pixai.art PixAI
interface AI and machine learning APIs and SDKs JP 65 ✓
edmsauce.com EDM Sauce
informational Media US 61 ✓ ✓
lowyat.net Lowyat.NET
informational Media Community +1 — 61 ✓ ✓
magazines.com Magazines.com
transactional Media Ecommerce — 61 ✓
uncrate.com Uncrate
informational Media — 61 ✓
prismix.dev Prismix — Live status, AI news, and 80 MCP servers for the AI ecosystem
interface Developer tools AI and machine learning +3 — 50 ✓
sixtyfour.ai Sixtyfour
interface AI agents and MCP APIs and SDKs +1 US 50 ✓ ✓
whatifoundtoday.com https://whatifoundtoday.com
informational Industry and manufacturing Personal sites and blogs FR 49 ✓
indieshortsmag.com Indie Shorts Mag
transactional Media Entertainment and streaming US 48 ✓
modernstoragemedia.com Modern Storage Media
documentation Media US 48 ✓
dquinn.net DQuinn\.net: Boston\-based freelance web designer Daniel Quinn specializes in fully custom WordPress development for small businesses, startups, and established brands\.
documentation Marketing Personal sites and blogs US 46 ✓
learnofchrist.com Learn of Christ
documentation Education US 46 ✓
socialnetworkforaiagents.com agent-socials
interface AI and machine learning Community +1 — 45 ✓ ✓
iwmi.org International Water Management Institute (IWMI)
documentation Science and research US 59 ✓
stlouisfed.org Federal Reserve Bank of St. Louis (St. Louis Fed)
documentation Government and public services GB 67 ✓
afternoonvoice.com Afternoon Voice
informational Media IN 47 ✓
dusk.network Dusk
documentation Crypto and Web3 Finance and payments — 51 ✓
viralnation.com Viral Nation
documentation Community Marketing +1 US 55 ✓ ✓
vehileaks.com VehiLeaks
transactional Automotive — 47 ✓
lubimyczytac.pl Lubimyczytac
informational Community PL 62 ✓
tipranks.com TipRanks
documentation Data and analytics Finance and payments NL 58 ✓
avirato.com Avirato
documentation Marketing Business software +1 FR 57 ✓
frenchweddingstyle.com French Wedding Style
documentation Media Travel — 55 ✓ ✓
nurserynearme.com.au Nursery Near Me (nurserynearme.com.au)
transactional Home and garden Ecommerce AU 50 ✓ ✓
utrgvpulse.com PULSE
documentation US 49 ✓
cigarjournal.com Cigar Journal
informational Media — 47 ✓
getproven.com GetProven
interface Business software APIs and SDKs — 47 ✓
simplebim.fr simplebim® France — CADatWORK Learning
transactional Business software FR 47 ✓
fpua.com Fort Pierce Utilities Authority
documentation Energy and utilities US 46 ✓