beonemedicines.com Guidance for Large Language Model (LLM) crawlers
informational AI and machine learning Healthcare +1 53 ✓
bridgebio.com BridgeBio
documentation Healthcare Science and research 51 ✓
prothena.com Prothena
documentation Marketing Healthcare +1 US 47 ✓
arcusbio.com Arcus Biosciences
documentation Healthcare Science and research US 48 ✓
biogen.com Biogen
documentation Healthcare Science and research US 61 ✓
formblends.com FormBlends
interface Healthcare US 54 ✓ ✓
otr3.com OTR3: Matrix Therapy Company in Regenerative Medecine
informational Healthcare Science and research FR 47 ✓
definiumtx.com Definium Therapeutics
informational Healthcare US 51 ✓
lyell.com Lyell
informational Healthcare Science and research US 46 ✓
juvlabs.com Juvenescence
informational Healthcare Science and research US 47 ✓
clinchoice.com ClinChoice: Your Global Full\-Service CRO
documentation Healthcare Science and research US 47 ✓
avitamedical.com AVITA Medical
documentation Healthcare US 47 ✓
delveinsight.com DelveInsight
transactional Data and analytics Healthcare 48 ✓
tely.ai Tely AI
documentation AI and machine learning Marketing 54 ✓ ✓
protagonist-inc.com www.protagonist-inc.com
documentation Healthcare 47 ✓
intuitionlabs.ai IntuitionLabs
documentation Data and analytics Developer tools +2 59 ✓
nicox.com Nicox: Visible Science
documentation Marketing Healthcare FR 47 ✓
geron.com Geron Corporation: more meaningful moments
documentation Science and research Healthcare US 52 ✓
voyagertherapeutics.com Voyager Therapeutics
documentation Marketing Healthcare +1 US 47 ✓
opko.com OPKO Health, Inc.
informational Healthcare US 48 ✓
citiustech.com CitiusTech - Leading Healthcare Technology & Consulting Company
documentation Healthcare US 48 ✓
soundphysicians.com Sound Physicians: Care by design\.
documentation Healthcare US 49 ✓
chempartner.com ChemPartner: Integrated Preclinical CRO and Drug Development Solutions
documentation Science and research Healthcare US 46 ✓
tayshagtx.com Taysha GTx
documentation Marketing Healthcare 46 ✓
walterbushnell.com Walter Bushnell
informational Marketing Healthcare 46 ✓
echobind.com Echobind
documentation Healthcare AI and machine learning +1 US 50 ✓ ✓
ppd.com PPD, Inc.: PPD is a leading global contract research organization (CRO) providing comprehensive, integrated drug development, laboratory and lifecycle management services.
documentation Healthcare Science and research US 49 ✓
libd.org The Lieber Institute for Brain Development | Research & Discovery
informational Science and research Healthcare US 47 ✓
bullfrogai.com Bullfrog AI: One Giant Leap for Mankind
documentation AI and machine learning Science and research +1 US 47 ✓
annovisbio.com Annovis Bio, Inc. (NYSE: ANVS)
informational Healthcare Science and research US 47 ✓
pharmastuff.org PHARMA STUFF
informational Education Healthcare +2 51 ✓ ✓
hakkoda.io Hakkoda (An IBM Company)
documentation AI and machine learning Infrastructure +1 46 ✓
hologic.com Hologic
documentation Healthcare US 59 ✓
tateeda.com TATEEDA | GLOBAL
documentation Developer tools Business software +1 46 ✓ ✓
clinicaltrialvanguard.com The Clinical Trial Vanguard
informational Healthcare Media 54 ✓ ✓
cureepilepsy.org CURE Epilepsy: Promoting and funding patient\-focused research\.
informational Nonprofit and advocacy Healthcare +1 51 ✓
getdynamiq.ai Dynamiq
interface AI and machine learning AI agents and MCP US 50 ✓ ✓
ailoitte.com Ailoitte
documentation Developer tools Business software 52 ✓ ✓
ens-newswire.com Environment News Service (ENS)
informational Media US 60 ✓
generatebiomedicines.com Generate:Biomedicines: Now we can\.
informational AI and machine learning Healthcare +1 US 51 ✓
intuz.com Intuz
documentation AI and machine learning Developer tools 47 ✓
dyne-tx.com Dyne Therapeutics
documentation Healthcare US 54 ✓ ✓
rhoworld.com Rho
documentation Science and research Healthcare US 47 ✓
4dmoleculartherapeutics.com 4DMT
informational Marketing Healthcare +1 48 ✓
greenice.net Greenice
documentation AI and machine learning Ecommerce +3 US 47 ✓
caidya.com Caidya®: Adapting at The Speed of Science
informational Healthcare US 47 ✓
captodayonline.com CAP TODAY: Where the world of the clinical laboratory comes together
informational Healthcare Science and research +1 US 50 ✓
paasp.net paasp network
documentation Science and research DE 46 ✓
tigermedgrp.com Tigermed
documentation Healthcare Science and research CN 46 ✓
helix.com Helix
documentation Healthcare Science and research 52 ✓
pocket.network Pocket Network
interface AI and machine learning AI agents and MCP +1 US 60 ✓
carpe.com Carpe.com | The Future of Digital Health
interface Healthcare AI and machine learning US 45 ✓
zifo.com Zifo
documentation Data and analytics AI and machine learning DE 51 ✓ ✓
appliedclinicaltrialsonline.com Applied Clinical Trials Online
informational Healthcare Media US 51 ✓
brainstorm-cell.com BrainStorm Cell Therapeutics Inc.
informational Healthcare Science and research US 47 ✓
frontiermeds.com Frontier Medicines
informational Marketing Healthcare +1 46 ✓
pharmabharat.com PharmaBharat: Pharma, Clinical Research \& Healthcare Jobs
informational Healthcare Recruiting and careers FR 56 ✓
brighterclick.com Brighter Click
documentation Ecommerce Healthcare +2 US 47 ✓
komodohealth.com Komodo Health: Get the most accurate, patient\-centric view of the U\.S\. healthcare system\. Scale insight generation with NLP\-based AI and an enterprise platform\.
informational Healthcare AI and machine learning US 51 ✓
praxismedicines.com Praxis Medicines
documentation Healthcare Science and research 47 ✓
eclinicalsol.com eClinical Solutions
documentation Healthcare Data and analytics US 47 ✓
worldwide.com Worldwide Clinical Trials
informational Healthcare Science and research 51 ✓
avancecro.com Avance Clinical
documentation Healthcare Science and research ZA 47 ✓
vizient.com Vizient Inc. (Extended AI Interface Map)
informational Healthcare Data and analytics 54 ✓
trinitylifesciences.com Trinity: The Commercialization Intelligence Partner for Life Sciences
informational Business software Healthcare US 50 ✓
dartai.com Dart
documentation Productivity AI and machine learning US 55 ✓ ✓
labcorp.com Labcorp (Laboratory Corporation of America)
transactional Healthcare 63 ✓
yourperiod.ca Your Period
documentation Healthcare CA 47 ✓
ifeelonline.com ifeel: Always by your side
documentation Healthcare US 47 ✓
provectus.com Provectus
documentation AI and machine learning Business software 48 ✓
cerbaresearch.com Cerba
documentation Healthcare Science and research BE 47 ✓
mindsethealth.com Mindset Health
documentation Healthcare Education US 48 ✓
digitalscientists.com Digital Scientists
documentation Healthcare AI and machine learning 46 ✓ ✓
priorlabs.ai Prior Labs
interface AI and machine learning APIs and SDKs US 50 ✓
sophiagenetics.com SOPHiA GENETICS: Where others see data we see answers
documentation Healthcare US 51 ✓
synapsesocial.com Synapse
documentation Science and research Healthcare US 59 ✓ ✓
themomentum.ai Momentum
interface Healthcare Data and analytics +2 US 48 ✓
mmitnetwork.com MMITNetwork: Solving the what and why of market access\.
documentation Healthcare Business software US 50 ✓
novavax.com Novavax
documentation Science and research Healthcare US 60 ✓
arcturusrx.com Arcturus Therapeutics: Building Next Generation RNA Medicines
informational Healthcare 51 ✓
impedimed.com ImpediMed
documentation Marketing Healthcare US 47 ✓
creolestudios.com Creole Studios
documentation AI and machine learning Developer tools +1 US 51 ✓
managedhealthcareexecutive.com Managed Healthcare Executive
informational Healthcare Media US 60 ✓
visionlifesciences.com Vision Lifesciences
documentation Healthcare US 46 ✓
eagleanalytical.com Eagle
transactional Industry and manufacturing Science and research US 46 ✓
zeroentropy.dev ZeroEntropy
interface AI and machine learning APIs and SDKs US 47 ✓
arctoris.com Arctoris: Better Data Today\. Better Drugs Tomorrow\.
documentation Science and research Healthcare US 46 ✓
grandviewresearch.com Grand View Research
transactional Data and analytics Business software +1 68 ✓
labclinics.com labclinics.com
transactional Science and research ES 55 ✓
me-med.com MeMed
documentation Healthcare US 47 ✓
worldpharmatoday.com World Pharma Today
informational Industry and manufacturing Media +1 SG 47 ✓
kore1.com KORE1
informational Cybersecurity Healthcare +1 US 50 ✓
clario.com Clario
documentation Science and research Healthcare US 52 ✓
dimensionmarketresearch.com Dimension Market Research (DMR)
transactional Data and analytics Business software +1 SG 55 ✓ ✓
getwidget.dev GetWidget Flutter & AI
documentation AI and machine learning Business software 50 ✓ ✓
azumo.com Azumo
documentation Developer tools AI and machine learning US 52 ✓
velocityclinical.com Velocity Clinical Research
informational Healthcare 47 ✓
curiaglobal.com Curia Global, Inc.
documentation Industry and manufacturing Healthcare +1 US 49 ✓
memoryblue.com memoryBlue
documentation Recruiting and careers Productivity +2 US 47 ✓
pct.edu Pennsylvania College of Technology
informational Healthcare Industry and manufacturing +1 US 54 ✓
genomind.com Genomind
documentation Healthcare US 48 ✓
webmavens.com Web Mavens
documentation Developer tools Business software 46 ✓
emorphis.com www.emorphis.com
documentation Finance and payments Business software +1 US 47 ✓
bgosoftware.com BGO Life Sciences Technologies
documentation Developer tools Healthcare +1 47 ✓
medicoreach.com MedicoReach
transactional Healthcare Industry and manufacturing +1 47 ✓
blackpear.com Black Pear Software
documentation Healthcare 47 ✓
corasystems.com Cora Systems
documentation Industry and manufacturing Business software +1 US 46 ✓
avature.net Avature
documentation AI and machine learning Marketing +2 US 57 ✓
norstella.com Norstella: At Norstella, our mission is simple: to help patients gain access to life\-saving therapies\.
documentation Healthcare Business software US 49 ✓
doxatalent.com DOXA Talent
documentation Business software Recruiting and careers 46 ✓
arango.ai Arango
documentation AI and machine learning Data and analytics +1 48 ✓
qasource.com QASource
transactional Developer tools US 48 ✓
immatics.com Immatics: The global leader in precision targeting of PRAME
documentation Healthcare Science and research US 50 ✓
acuitymd.com AcuityMD
documentation Healthcare Business software +1 US 50 ✓
lezdotechmed.com LezDo TechMed
documentation Healthcare Legal US 46 ✓
breezebio.com BreezeBio
informational Healthcare Science and research 50 ✓ ✓
indeema.com Indeema
documentation DE 47 ✓
kandasoft.com Kanda Software: Custom Software Development Company (www.kandasoft.com)
documentation Developer tools Business software 48 ✓
aventionmedia.com Avention Media
transactional Healthcare Marketing +1 45 ✓ ✓
dataforest.ai DATAFOREST
informational AI and machine learning Data and analytics +2 49 ✓
cureangelman.org Foundation for Angelman Syndrome Therapeutics (FAST)
documentation Healthcare Nonprofit and advocacy US 47 ✓
solix.com Solix Technologies, Inc.: Solix Technologies, Inc. is a leading cloud data management application solution provider that empowers data-driven enterprises with solutions for digital transformation incl
documentation AI and machine learning Data and analytics US 47 ✓
causaly.com causaly.com - Causaly | Agentic AI Platform for Life Sciences R&D
documentation AI and machine learning Science and research US 47 ✓
revenue.io Revenue: Revenue\.io is the Salesforce\-native Revenue Orchestration Platform, unifying dialers, guided selling, call tracking, conversation intelligence, and AI agents to drive performance before, du
documentation AI and machine learning Marketing +1 US 52 ✓
userlane.com Userlane
documentation Business software US 56 ✓
abmatic.ai Abmatic AI, Agentic Marketing and Sales Platform for Mid-Market and Enterprise B2B
transactional AI and machine learning Marketing +1 55 ✓ ✓
kitelytech.com KitelyTech
documentation Data and analytics Infrastructure +1 US 50 ✓ ✓
cabotsolutions.com Cabot Technology Solutions
documentation Developer tools Healthcare +2 US 47 ✓
improvado.io Improvado - public agent guidance
interface AI and machine learning Marketing +2 59 ✓ ✓
perfectiongeeks.com PerfectionGeeks Technologies — AI & LLM Guidance File
documentation AI and machine learning Design +1 51 ✓ ✓
cd-genomics.com CD Genomics
documentation Science and research Data and analytics US 49 ✓
reducto.ai Reducto
interface AI and machine learning APIs and SDKs US 55 ✓ ✓
lyzr.ai Lyzr.ai
documentation IN 52 ✓
umdf.org UMDF
informational Nonprofit and advocacy Healthcare US 52 ✓
altoros.com www.altoros.com
documentation Finance and payments Infrastructure +1 US 51 ✓
marutitech.com Maruti Techlabs
documentation Cybersecurity Data and analytics +3 51 ✓
sages.org SAGES: Reimagining surgical care for a healthier world
documentation Healthcare Science and research 47 ✓
shaip.com Shaip
documentation AI and machine learning US 47 ✓
sigmacomputing.com Sigma
documentation Data and analytics AI agents and MCP US 60 ✓
technource.com Technource
informational Productivity Business software +1 US 48 ✓
leadjourney.io LeadJourney
documentation Ecommerce Marketing +1 47 ✓
liner.com Liner
interface AI and machine learning AI agents and MCP +1 64 ✓ ✓
h2o.ai H2O AI
documentation AI and machine learning AI agents and MCP 61 ✓
sbigrowth.com SBI Growth
documentation Business software Marketing US 53 ✓
fiddler.ai Fiddler AI: The AI Control Plane for Enterprise Agents
documentation AI and machine learning Cybersecurity +1 US 52 ✓
addepto.com Addepto
informational AI and machine learning PL 51 ✓
hrcloud.com HR Cloud
documentation Recruiting and careers Business software US 51 ✓
antino.com Antino
documentation AI and machine learning IN 48 ✓
q3tech.com Managed IT and Custom Technology Solutions with AI
informational Cybersecurity Data and analytics +3 IN 48 ✓
ysioscapital.com Ysios Capital
documentation Finance and payments Healthcare 48 ✓
axplora.com Axplora
documentation Industry and manufacturing Developer tools US 47 ✓
bytestechnolab.com Bytes Technolab Inc: Engineered for the AI Era
documentation AI and machine learning Business software 47 ✓
qdrant.tech https://qdrant.tech/
interface AI and machine learning Data and analytics +2 US 61 ✓
vastdata.com VAST Data
documentation AI and machine learning Data and analytics +1 US 58 ✓
voiceaispace.com Voice AI Space
informational AI and machine learning US 54 ✓
exadel.com Exadel: AI-Enabled Digital Engineering Services
documentation Business software AI and machine learning 53 ✓
truefoundry.com TrueFoundry
documentation AI agents and MCP AI and machine learning +1 53 ✓
innolitics.com Innolitics
documentation Developer tools Healthcare +1 US 51 ✓
leadgenius.com LeadGenius
documentation Marketing Business software 51 ✓
computools.com Computools
documentation Developer tools Productivity +1 US 49 ✓
dentinstitute.com Dent Neurologic
documentation Healthcare US 49 ✓
strangeworks.com Strangeworks
interface AI and machine learning Infrastructure US 49 ✓
empat.tech Empat
documentation Finance and payments Healthcare +2 47 ✓
prolificstudio.co Prolific Studio
documentation Media Design 47 ✓
dsstream.com DS Stream
documentation AI and machine learning Data and analytics US 46 ✓
ncha.org NCHA
informational Healthcare Nonprofit and advocacy US 46 ✓
eleks.com ELEKS
documentation AI and machine learning Business software US 62 ✓ ✓
air.org American Institutes for Research (AIR)
documentation Science and research ZA 61 ✓
assemblyai.com AssemblyAI
interface AI and machine learning APIs and SDKs +1 US 61 ✓
pinpointhq.com Pinpoint
documentation Recruiting and careers US 60 ✓
communitynewspapers.com Miami’s Community News
informational Media US 59 ✓
paperguide.ai Paperguide
documentation Science and research AI and machine learning 57 ✓
confident-ai.com Confident AI
documentation AI and machine learning DevOps and observability +1 US 56 ✓ ✓
pump.co Pump.co — Cloud Cost Optimization
documentation Cybersecurity Infrastructure CA 55 ✓ ✓
joveo.com Joveo
documentation Marketing Recruiting and careers US 54 ✓ ✓
digitalheroesco.com Digital Heroes, llms.txt
documentation Developer tools Healthcare 52 ✓
mobisoftinfotech.com Mobisoft Infotech
informational Developer tools Healthcare +2 52 ✓
openwhispr.com OpenWhispr
documentation AI and machine learning Productivity +1 US 51 ✓
xicom.biz Xicom LLMs.txt
documentation Developer tools Healthcare +2 51 ✓
ascendingdc.com ASCENDING
documentation Data and analytics AI and machine learning +1 50 ✓ ✓
assistents.ai assistents.ai
documentation AI and machine learning AI agents and MCP +1 DE 50 ✓ ✓
carelu.com Carelu
documentation Healthcare US 50 ✓ ✓
vegavid.com llms.txt — Vegavid Technology
documentation AI and machine learning 50 ✓
ssdp.org SSDP
informational Nonprofit and advocacy 49 ✓
flur.ee Fluree
documentation AI and machine learning Data and analytics EE 48 ✓
program-ace.com Program-Ace
documentation AI and machine learning Developer tools +3 FI 48 ✓
tellius.com Tellius
documentation AI and machine learning Data and analytics US 48 ✓
cs-recruiters.com Careerscape
informational Recruiting and careers US 47 ✓
grax.com GRAX - Salesforce Data Platform for Backup, Recovery, Archive, Replication, Seeding, and Activation for AI and Analytics
documentation Data and analytics AI and machine learning +2 47 ✓
grepsr.com Grepsr
documentation Data and analytics 47 ✓
synthesized.io Synthesized
documentation AI and machine learning Developer tools +2 US 47 ✓
techmagic.co TechMagic
informational Cybersecurity Developer tools +1 US 47 ✓
technbrains.com TechnBrains
documentation Developer tools Finance and payments +3 US 47 ✓
technostacks.com Technostacks
documentation Healthcare Industry and manufacturing +3 US 47 ✓
unicrew.com unicrew
documentation Developer tools Business software 47 ✓
annotationbox.com AnnotationBox
transactional AI and machine learning Data and analytics GB 46 ✓
datasaur.ai Datasaur
documentation AI and machine learning 46 ✓
healthyram.com HealThyRam.com
transactional Healthcare FR 46 ✓
unicoconnect.com Unico Connect
documentation Developer tools Real estate +2 US 46 ✓
fireflies.ai Fireflies.ai
interface AI and machine learning Productivity +1 67 ✓ ✓
xmind.com Xmind
interface Productivity AI agents and MCP 63 ✓
securecodewarrior.com Secure Code Warrior
documentation Developer tools Cybersecurity US 57 ✓
txone.com TXOne Networks
documentation Cybersecurity Industry and manufacturing US 56 ✓ ✓
stealthagents.com Stealth Agents
documentation Marketing Recruiting and careers 55 ✓ ✓
solulab.com SoluLab
documentation AI and machine learning Healthcare +2 53 ✓
convai.com Convai
interface AI and machine learning AI agents and MCP US 52 ✓
magora-systems.com Magora: software development company, London and UK
documentation Developer tools 52 ✓ ✓
bostongene.com BostonGene
documentation Healthcare AI and machine learning 51 ✓ ✓
metizsoft.com Metizsoft Solutions
documentation AI and machine learning Ecommerce +3 51 ✓ ✓
noon.ai Noon AI
documentation Recruiting and careers AI and machine learning +1 US 51 ✓ ✓
stfalcon.com Stfalcon — Custom Software Development Agency
documentation Developer tools Finance and payments +3 DE 51 ✓
tilde.ai Tilde.ai
documentation AI and machine learning DE 51 ✓
buildmvpfast.com BuildMVPFast
documentation Developer tools 49 ✓ ✓
intercoast.edu InterCoast Colleges
documentation Education US 48 ✓
incruiter.com InCruiter: Interview as a Service Platform
documentation Recruiting and careers AI and machine learning IN 47 ✓
keystepmedia.com Key Step Media
transactional Education 47 ✓
clinicmaster.com Clinicmaster
documentation Business software Healthcare CA 46 ✓
grapestechsolutions.com Grapes Tech Solutions
documentation Cybersecurity Data and analytics +2 US 46 ✓
humanagency.com Human Agency
documentation AI and machine learning Business software US 46 ✓
ipocentral.in IPO Central
documentation Finance and payments IN 46 ✓
scrambleid.com ScrambleID: llms.txt
interface AI and machine learning Developer tools +3 US 46 ✓