scrapegraphai.com llms.txt
interface AI agents and MCP APIs and SDKs US 53 ✓ ✓
thecoolhour.com The Cool Hour: Find your favorite brand at The Cool Hour, fall in love with a new designer, discover the next label to break the fashion circuit.
informational Ecommerce Fashion and beauty — 53 ✓
abqraw.com ABQ RAW
informational Media US 52 ✓
birthmark.org Vascular Birthmarks Foundation
documentation Healthcare Nonprofit and advocacy US 52 ✓
causaly.com causaly.com - Causaly | Agentic AI Platform for Life Sciences R&D
documentation AI and machine learning Science and research US 52 ✓
cefriel.com Cefriel: Centro di Ricerca, Innovazione e Formazione
informational Education Science and research IT 52 ✓
craftaxethrowing.com Craft Axe Throwing
transactional Local business Events and conferences — 52 ✓
dante-ai.com Dante AI
documentation AI and machine learning Marketing +1 — 52 ✓
digitaleyecon.com Digital Eyecon Pvt Ltd
documentation Marketing ID 52 ✓
eastmarketmilano.com East Market Milano
documentation FR 52 ✓
ecocart.co.in ecocart.co.in
transactional Ecommerce IN 52 ✓
f22labs.com F22 Labs
documentation Developer tools Business software +1 US 52 ✓
freedownloadmobileringtones.com FDMR
documentation Entertainment and streaming — 52 ✓
hentaiflash.net Hentai Flash
documentation Entertainment and streaming FR 52 ✓
jolla-devices.com Jolla devices
transactional Consumer electronics IT 52 ✓
lavashow.com Lava Show
transactional Arts and culture Travel NL 52 ✓
mccannsystems.com McCann
documentation Construction and architecture — 52 ✓
nardelloandco.com Nardello & Co
documentation Marketing Legal US 52 ✓
patc.net Potomac Appalachian Trail Club
transactional Nonprofit and advocacy US 52 ✓
psgrkcw.ac.in PSGRKCW
informational Education IN 52 ✓
radyfoundation.org Rady Children's Hospital Foundation
informational Nonprofit and advocacy Healthcare US 52 ✓
sirtbhopal.ac.in Sagar Institute of Research and Technology (SIRT)
informational Education IN 52 ✓
solguruz.com SolGuruz
documentation Developer tools Business software +1 US 52 ✓
tierragamer.com TierraGamer
informational Gaming Media — 52 ✓
vivcrochets.com VivCrochets
documentation Personal sites and blogs FR 52 ✓
vueschool.io Vue School
transactional Education Developer tools — 52 ✓
zenvanriel.com Zen van Riel - Senior AI Engineer
documentation AI and machine learning Personal sites and blogs NL 52 ✓ ✓
awrgroup.com www.awrgroup.com
documentation US 51 ✓
bettingexchange.net Betting Exchange® | Trading Sportivo con Gianluca Landi
documentation Education — 51 ✓
bitreactor.to Bitreactor - Telusuri Dunia Game Sekarang Juga
informational Gaming Media FR 51 ✓
casinomobilefrancais.com casinomobilefrancais.com
informational Gaming Entertainment and streaming DE 51 ✓
codemancers.com Codemancers
documentation Ecommerce Business software +1 — 51 ✓
consigli.com Consigli Construction
informational Education Construction and architecture US 51 ✓
foojay.io foojay.io - Friends Of OpenJDK
documentation Developer tools Community — 51 ✓
humanagency.com Human Agency
documentation AI and machine learning Business software US 51 ✓
itmgoi.in ITM Gwalior
documentation Education IN 51 ✓
jessewaites.com Jesse Waites
documentation Personal sites and blogs US 51 ✓
jimmysong.io Jimmy Song — AI Native Infrastructure
documentation AI and machine learning Infrastructure +1 — 51 ✓
parallellabs.app Parallel AI
documentation AI and machine learning Marketing +1 US 51 ✓
pathofhoperescue.com Path Of Hope Rescue
documentation Pets US 51 ✓
semtrix.de Semtrix – Full-Service Search-Experience-Agentur für SEO, SEA und GEO
documentation Marketing DE 51 ✓ ✓
tateeda.com TATEEDA | GLOBAL
documentation Developer tools Business software +1 — 51 ✓ ✓
telanganapatrika.in Telanganapatrika - తెలంగాణపత్రిక
informational Media IN 51 ✓
tooldirectory.ai ToolDirectory.AI
interface AI and machine learning — 51 ✓ ✓
viestories.com Viestories
informational Media — 51 ✓
weblineglobal.com WeblineGlobal
informational Recruiting and careers — 51 ✓
2389.ai 2389 Research, Inc
documentation AI and machine learning AI agents and MCP +1 DE 50 ✓ ✓
adamkalamchi.com adamkalamchi.com
documentation Real estate AI and machine learning +1 US 50 ✓ ✓
aibuilderclub.com AI Builder Club
documentation AI and machine learning AI agents and MCP +1 US 50 ✓
emirateshospitals.ae Emirates Hospitals
documentation Healthcare AE 50 ✓
hippocampusmagazine.com Hippocampus Magazine
documentation Media Arts and culture US 50 ✓
linkup.so Linkup
interface AI agents and MCP APIs and SDKs +1 US 50 ✓
mcpservers.org Awesome MCP Servers
documentation AI and machine learning Developer tools +1 — 50 ✓
printkk.com PrintKK
transactional Ecommerce US 50 ✓
respan.ai Respan
documentation AI and machine learning DevOps and observability +1 US 50 ✓
roadie.io Roadie - fully customizable Context Layer & Internal Developer Portal built on Backstage
interface Developer tools AI agents and MCP +1 — 50 ✓ ✓
shelf.io Shelf.io
documentation AI and machine learning Productivity +1 US 50 ✓
testriq.com Testriq QA Lab — Software Testing Services
documentation Developer tools Business software US 50 ✓ ✓
cultofluna.com CULT of LUNA
documentation DK 49 ✓
dvwarehouse.com DV Warehouse
transactional Ecommerce Consumer electronics — 49 ✓
euristiq.com Euristiq
documentation NL 49 ✓
geekbarpulseaustralia.com geekbarireland
transactional Ecommerce Consumer electronics PL 49 ✓
quantumuniversity.edu.in quantumuniversity.edu.in llms.txt
informational Education IN 49 ✓
betson.nl Bedrijfskleding Limburg Werkkleding Limburg Promotiekleding Limburg -Snickers Workwear - FHB Workwear - Fristads Workwear
transactional Fashion and beauty NL 48 ✓
bisok.com BIS/Grooper
documentation AI and machine learning Data and analytics US 48 ✓
caringhandsvet.com Caring Hands Animal Hospital
transactional Pets Local business US 48 ✓
flur.ee Fluree
documentation AI and machine learning Data and analytics EE 48 ✓
hobicode.com HobiCode
informational Marketing Business software — 48 ✓
maldivese.com Maldives Online Casino
informational Gaming — 48 ✓
memside.com Memside
documentation AI and machine learning AI agents and MCP — 48 ✓ ✓
poornima.edu.in Poornima University
documentation Education Travel IN 48 ✓
songstuff.com Songstuff: Your Music, Our Mission
informational Marketing US 48 ✓
timesofblockchain.com Times Of Blockchain
informational Media Crypto and Web3 — 48 ✓
brandchamp.io BrandChamp
documentation Marketing Business software US 47 ✓
grepture.com Grepture
interface AI agents and MCP AI and machine learning +1 US 47 ✓
porcausa.org Fundación porCausa
informational Nonprofit and advocacy Media FR 47 ✓
youcanprint.it Youcanprint
transactional IT 47 ✓
badalabege.fr Club de badminton à Labège - BadALabege
documentation FR 46 ✓
catcraftyknits.com Cat Crafty Knits
documentation Design — 46 ✓
emivalcorp.com Emival Corp - Tires Store
transactional Automotive Ecommerce US 46 ✓
greatlakes.edu.in === Core Function ===
informational Education IN 46 ✓
littlepeopleuk.org Little People UK
documentation GB 46 ✓
promptmetrics.xyz Prompt Metrics
documentation AI and machine learning Marketing — 46 ✓ ✓
robertsantore.com Robert Santoré
informational Arts and culture US 46 ✓
saiprashnavali.com https://www.saiprashnavali.com
documentation IN 46 ✓
sanjeed.in Sanjeed's Digital Garden
documentation Developer tools IN 46 ✓
zalt.me Mahmoud Zalt
documentation Developer tools Infrastructure +1 — 45 ✓ ✓
hyperallergic.com Hyperallergic
informational Education Arts and culture +1 — 69 ✓ ✓
nuxt.com Nuxt Docs
documentation Developer tools Open source projects +1 US 67 ✓ ✓
merip.org Middle East Research and Information Project
documentation Education Media +1 NL 65 ✓ ✓
modal.com Modal Documentation
documentation AI and machine learning Infrastructure — 64 ✓ ✓
voiceflow.com Voiceflow
documentation AI and machine learning AI agents and MCP +1 US 64 ✓ ✓
yankodesign.com Yanko Design
informational Design — 64 ✓
civic.com Civic
interface AI and machine learning AI agents and MCP +1 US 63 ✓ ✓
techloy.com Techloy
informational Media NL 63 ✓ ✓
aov.ai AOV.ai
transactional Ecommerce VN 62 ✓ ✓
datarobot.com DataRobot
documentation AI and machine learning AI agents and MCP US 62 ✓
fivetran.com Fivetran Documentation
documentation Data and analytics Documentation and reference US 62 ✓
inngest.com Inngest
documentation AI agents and MCP DevOps and observability +1 — 62 ✓ ✓
poly.ai PolyAI
interface Developer tools AI agents and MCP +2 US 62 ✓ ✓
producttalk.org Product Talk
documentation Personal sites and blogs Education NL 62 ✓ ✓
webreference.com Web Reference
documentation Developer tools Documentation and reference +1 — 62 ✓
antier.com Antier — AI and Blockchain Infrastructure for Enterprises
interface AI and machine learning Infrastructure +1 — 61 ✓ ✓
balleralert.com Baller Alert
informational Media US 61 ✓ ✓
bell-sw.com BellSoft Liberica JDK
documentation Developer tools Infrastructure — 61 ✓ ✓
blacknut.com Blacknut Cloud Gaming
transactional Gaming Entertainment and streaming FR 61 ✓
broadwaynews.com Broadway News
documentation Media Arts and culture NL 61 ✓ ✓
cosmicjs.com Cosmic Documentation
interface AI agents and MCP APIs and SDKs US 61 ✓ ✓
cuchd.in Best Private University in Punjab, North India (India) - Chandigarh University
informational Education IN 61 ✓
legalinsurrection.com Le·gal In·sur·rec·tion
informational Marketing Media — 61 ✓
mlflow.org MLflow
interface AI and machine learning DevOps and observability +1 — 61 ✓
techandtrends.com Tech&Trends
informational AI and machine learning Cybersecurity +2 FR 61 ✓
ultralytics.com Ultralytics
documentation AI and machine learning Developer tools US 61 ✓
benchlm.ai BenchLM AI
documentation AI and machine learning Data and analytics — 60 ✓ ✓
chutes.ai Chutes
interface AI and machine learning Infrastructure +1 — 60 ✓ ✓
facultyfocus.com Faculty Focus \| Higher Ed Teaching \& Learning: A Free Publication from the Creators of The Teaching Professor
informational Education US 60 ✓
geeks3d.com Geeks3D
documentation Marketing Consumer electronics CH 60 ✓
getzowie.com Zowie
documentation AI and machine learning AI agents and MCP +2 US 60 ✓
inkeep.com Inkeep
documentation AI and machine learning Business software US 60 ✓ ✓
itglobal.com LLMS to ITGLOBAL.COM
documentation Infrastructure AI and machine learning KZ 60 ✓
japan-forward.com Japan Forward
informational Marketing Media US 60 ✓
modular.com Modular
interface AI and machine learning Infrastructure US 60 ✓
redefinemeat.com Redefine Meat
transactional Food and dining — 60 ✓ ✓
aitinkerers.org AI Tinkerers
informational AI and machine learning Community — 59 ✓ ✓
cdhowe.org C\.D\. Howe Institute
informational Science and research Nonprofit and advocacy CA 59 ✓
minestrator.com MineStrator
transactional AI and machine learning Infrastructure +1 FR 59 ✓ ✓
motorhomefun.co.uk MotorhomeFun: The Motorhome Support and Social Network
informational Community Automotive GB 59 ✓
orq.ai Orq.ai
interface AI and machine learning AI agents and MCP +1 CA 59 ✓ ✓
photoephemeris.com The Photographer's Ephemeris
documentation — 59 ✓
promptfoo.dev Promptfoo
interface AI and machine learning Developer tools +1 — 59 ✓ ✓
reidoscoins.com.br Rei dos Coins
transactional Ecommerce BR 59 ✓
relevanceai.com Relevance AI
documentation AI and machine learning AI agents and MCP US 59 ✓
risingwave.com RisingWave
documentation Data and analytics Infrastructure +1 — 59 ✓ ✓
speechblubs.com Speech Blubs
documentation Education Healthcare — 59 ✓ ✓
superannotate.com SuperAnnotate | Streamline AI Data Workflows
documentation AI and machine learning Data and analytics US 59 ✓
tiledesk.com Tiledesk: Conversational Automation for Customer Engagement
documentation Marketing AI and machine learning +2 US 59 ✓
unige.it Università di Genova
documentation Education IT 59 ✓
aisera.com This file lists key LLM-related resources for AI tools to crawl and index. Optimized for AI discovery and reasoning systems.
documentation AI and machine learning AI agents and MCP +1 US 58 ✓
apilayer.com APILayer
interface APIs and SDKs Developer tools — 58 ✓
awesomeagents.ai Awesome Agents
documentation AI and machine learning Media — 58 ✓ ✓
fni.no Fridtjof Nansens Institutt
informational Science and research NO 58 ✓ ✓
gonzoproxy.com GonzoProxy
interface Infrastructure NL 58 ✓ ✓
innoq.com INNOQ
documentation Developer tools Business software +1 — 58 ✓
iternal.ai Iternal Technologies
documentation AI and machine learning Healthcare US 58 ✓ ✓
madeinvilnius.lt MadeinVilnius.lt
informational Media LT 58 ✓ ✓
mrmondialisation.org Mr Mondialisation
informational Media FR 58 ✓
nutrient.io Nutrient — The document layer for agents
interface AI agents and MCP APIs and SDKs +1 US 58 ✓ ✓
originalmarines.com Original Marines
transactional Fashion and beauty IT 58 ✓
shattered.io Shattered
informational Cybersecurity Media — 58 ✓ ✓
spinsucks.com Spin Sucks
informational Education Marketing US 58 ✓
techaheadcorp.com TechAhead LLM Index
documentation AI and machine learning Developer tools +2 — 58 ✓
thehalara.fr Halara
transactional Fashion and beauty Ecommerce FR 58 ✓
tinyfish.ai TinyFish
interface Infrastructure AI agents and MCP +1 US 58 ✓
uzone.id Uzone.id
informational Media ID 58 ✓
across.to Across Protocol
documentation AI and machine learning Finance and payments +2 — 57 ✓
allerin.com Allerin
documentation AI and machine learning Industry and manufacturing US 57 ✓ ✓
andros.dev Andros Fenollosa
documentation Developer tools Personal sites and blogs ES 57 ✓
animalfoundation.com The Animal Foundation
informational Nonprofit and advocacy Pets US 57 ✓
appsierra.com Appsierra
documentation Developer tools AI and machine learning IN 57 ✓ ✓
boristane.com Boris Tane
documentation Personal sites and blogs — 57 ✓ ✓
brainwareuniversity.ac.in Brainware University
informational Education IN 57 ✓
casinovergelijker.net CasinoVergelijker
informational Gaming — 57 ✓
chapsvision.com ChapsVision
documentation AI and machine learning Data and analytics +1 FR 57 ✓
dbvis.com SQL Client and Database Management Software - DbVisualizer
transactional Data and analytics Developer tools SE 57 ✓
dreamfactory.com DreamFactory
interface APIs and SDKs AI and machine learning +1 US 57 ✓
exaltedfuneral.com Exalted Funeral Press
transactional Gaming CA 57 ✓ ✓
hakia.com Hakia
documentation Cybersecurity Education — 57 ✓
harpercollins.co.in HarperCollins
transactional Arts and culture Media IN 57 ✓
hyscaler.com HyScaler
documentation AI and machine learning US 57 ✓
kanerika.com Kanerika
documentation Data and analytics Healthcare +4 US 57 ✓
lcsupply.com Lion Country Supply
transactional Ecommerce Pets CA 57 ✓ ✓
loyjoy.com LoyJoy
interface AI and machine learning Marketing +2 DE 57 ✓ ✓
metalzone.fr MetalZone
informational Media FR 57 ✓
porternovelli.com Porter Novelli: Strategic communications fueled by innovation\.
documentation Marketing US 57 ✓
procurementresource.com Procurement Resource
documentation Industry and manufacturing Data and analytics — 57 ✓
proxies.sx PROXIES.SX
interface Developer tools Infrastructure +1 SX 57 ✓ ✓
qualitypashmina.com Pashmina
informational — 57 ✓
ramdass.org Ram Dass: Love Serve Remember Foundation
transactional Nonprofit and advocacy US 57 ✓
softjourn.com Softjourn — You Have Ideas. We Bring Them to Life.
documentation Developer tools Business software US 57 ✓
thehalara.co.uk Halara
transactional Fashion and beauty GB 57 ✓
upstage.ai Upstage
interface AI and machine learning Finance and payments +2 US 57 ✓
uvik.net Uvik Software - AI/LLM Brand Brief
documentation AI and machine learning Data and analytics — 57 ✓ ✓
wanderinginn.com The Wandering Inn: The Wandering Inn is an ongoing Fantasy\-LitRPG web serial by pirateaba with millions of readers worldwide\.
informational Marketing Entertainment and streaming — 57 ✓
xgamingserver.com XGamingServer.com
transactional Gaming Infrastructure US 57 ✓ ✓
zeropath.com ZeroPath
interface Cybersecurity US 57 ✓ ✓
alicelabs.ai Alice Labs
documentation AI and machine learning Education US 56 ✓ ✓
allthingsbaby.com Agent Instructions — AllThingsBaby.com
documentation CA 56 ✓ ✓
amfmtreatment.com AMFM Mental Health Treatment
informational Healthcare US 56 ✓
anglinglines.com Angling Lines
transactional Travel Sports and fitness — 56 ✓ ✓
attractgroup.com Attract Group
documentation Developer tools Business software — 56 ✓ ✓
authzed.com AuthZed
interface Cybersecurity Databases US 56 ✓
bespoke-bride.com Bespoke-Bride: Wedding Blog
informational Personal sites and blogs — 56 ✓
chronoinnovation.com Chrono Innovation
documentation Developer tools Business software +1 — 56 ✓ ✓
comparethecloud.net Compare the Cloud
documentation Media Infrastructure GB 56 ✓
cryptonewsz.com CryptoNewsZ
informational AI and machine learning Media +1 — 56 ✓
emulatorgamesx.net Emulator Games
informational Gaming — 56 ✓ ✓
explorebigsky.com Explore Big Sky
informational Marketing US 56 ✓
file.org.br FILE FESTIVAL
informational Arts and culture Events and conferences BR 56 ✓
kastner-oehler.at Kastner & Öhler
transactional Ecommerce Fashion and beauty AT 56 ✓ ✓
kestra.io Kestra
interface AI and machine learning Cybersecurity +3 — 56 ✓ ✓
lcb.org LCB.org
informational US 56 ✓
mastt.com Mastt
documentation AI and machine learning Productivity +2 US 56 ✓
melodicmag.com // MELODIC Magazine: Melodic Magazine keeps you up to date on your favorite musicians with interviews, tour dates, live photos, and live show reviews\.
informational Marketing Media +1 US 56 ✓
mixedbread.com Mixedbread
interface AI agents and MCP APIs and SDKs +1 US 56 ✓ ✓
mouratoglou.com Mouratoglou
transactional Education Sports and fitness FR 56 ✓
ncrp.org NCRP
documentation Marketing Nonprofit and advocacy US 56 ✓
nexttgo.com Nexttgo
transactional Ecommerce Home and garden CA 56 ✓ ✓
openfga.dev OpenFGA
documentation Cybersecurity Authentication and identity +1 — 56 ✓ ✓
ossinsight.io OSSInsight
documentation Open source projects Data and analytics US 56 ✓ ✓
perfectiongeeks.com PerfectionGeeks Technologies — AI & LLM Guidance File
documentation AI and machine learning Design +1 IN 56 ✓ ✓
pulsefilms.com Pulse Films
informational Media US 56 ✓ ✓
saneshoppe.com SaneShoppe
transactional Fashion and beauty Ecommerce CA 56 ✓ ✓
thoughtly.com Thoughtly
interface AI and machine learning Finance and payments +3 US 56 ✓ ✓
varsuite.co.uk Varsuite
documentation Ecommerce GB 56 ✓ ✓
winternode.com WinterNode
transactional Gaming Infrastructure — 56 ✓ ✓
101mobility.com 101 Mobility
informational Automotive US 55 ✓
adaline.ai Adaline
interface AI and machine learning DevOps and observability +1 US 55 ✓ ✓
ahhhhfs.com ahhhhfs
informational — 55 ✓
celebbabylaundry.com Celeb Baby Laundry
informational Personal sites and blogs — 55 ✓
cerebrium.ai Cerebrium
documentation Infrastructure AI and machine learning — 55 ✓
cloudian.com Cloudian
documentation Infrastructure US 55 ✓
euremotejobs.com EU Remote Jobs
informational Recruiting and careers — 55 ✓
floatbot.ai Floatbot.AI — llms.txt
documentation AI and machine learning Communications — 55 ✓
fluffcore.com Porno
informational FR 55 ✓
gardinerbryant.com The Bryant Review
informational Personal sites and blogs Media — 55 ✓ ✓
graphify.com Graphify
interface Developer tools Data and analytics +1 US 55 ✓ ✓
itsourcecode.com itsourcecode.com — Free Source Code & Capstone Projects for BSIT Students
documentation Developer tools Education FR 55 ✓
kitelytech.com KitelyTech
documentation Data and analytics Infrastructure +1 US 55 ✓ ✓
koio.co KOIO
transactional Fashion and beauty Ecommerce CA 55 ✓ ✓
kuber.studio llms.txt — Kuber Mehta
documentation US 55 ✓
laceembrace.com Lace Embrace
transactional Fashion and beauty CA 55 ✓ ✓
meritis.fr Meritis: Des experts qui vous conseillent\. Une organisation qui délivre\.
informational FR 55 ✓
noedgeai.com Doc2X / NoEdgeAI
documentation AI and machine learning Documentation and reference NL 55 ✓
pingcap.com PingCAP (TiDB) — llms.txt
documentation Infrastructure US 55 ✓ ✓
rittmananalytics.com Rittman Analytics
informational Data and analytics PL 55 ✓ ✓
rubyllm.com RubyLLM Documentation
interface AI and machine learning Developer tools +1 US 55 ✓ ✓
1010wcsi.com 1010 WCSI
informational Marketing Media — 54 ✓
bernas.id BERNAS.id
informational Media ID 54 ✓
boxuk.com Box UK: Delivering Your Digital Future
documentation Business software US 54 ✓
codegnan.com codegnan.com
documentation AI and machine learning Developer tools +1 GB 54 ✓
dometrain.com Dometrain
interface Education — 54 ✓
erickson.it Edizioni Centro Studi Erickson S.p.A.
transactional Education IT 54 ✓
feip.co DVIP (FEIP) — IT Company
informational Developer tools Business software +1 RU 54 ✓ ✓
gracecentered.com Grace Centered - Online Christian Magazine
informational Community US 54 ✓
hargacampur.com Hargacampur.com
informational Ecommerce — 54 ✓
heyjackass.com HeyJackass\!: Illustrating Chicago Values
transactional Marketing Media US 54 ✓
leisurehotels.co.in Leisure Hotels
transactional Travel IN 54 ✓
mojok.co Mojok\.co: Suara Orang Biasa
informational Media — 54 ✓
nephcure.org NephCure: For Rare Kidney Disease
informational Healthcare Nonprofit and advocacy US 54 ✓
nicovip.com MPM Nicovip
transactional Ecommerce — 54 ✓