calvium.com Calvium
documentation GB 47 ✓
beonemedicines.com Guidance for Large Language Model (LLM) crawlers
informational AI and machine learning Healthcare +1 US 58 ✓
balderton.com Balderton Capital
documentation Marketing Finance and payments — 53 ✓
grpva.com Greater Richmond Partnership (GRP)
documentation Government and public services — 46 ✓
entomologytoday.org Entomology Today: Brought to you by the Entomological Society of America
informational Marketing Science and research US 59 ✓
raiselens.com Raise Lens
interface Finance and payments Data and analytics — 50 ✓ ✓
fccollege.edu.pk FCCU University: A Premiere Liberal Arts University
informational Education PK 46 ✓
cognizant.com Cognizant
documentation AI and machine learning — 64 ✓
fertilizerdaily.com Fertilizer Daily
informational Media Agriculture FR 48 ✓
massinc.org MassINC
informational Media Nonprofit and advocacy US 48 ✓
yottabit.com YottaBit: The Future Is Bigger Than You Think (yottabit.com)
documentation Industry and manufacturing Media +1 US 45 ✓ ✓
meda.org MEDA
informational Nonprofit and advocacy US 48 ✓
ccianet.org Computer & Communications Industry Association
informational Nonprofit and advocacy US 56 ✓
ibsu.ac.pg IBS University (IBSU) – World Class Education for a Brighter Future
documentation Education PG 52 ✓
albuquerque.com Albuquerque.com
informational Marketing Travel US 46 ✓
global-greenhouse-warming.com Global Greenhouse Warming
informational US 48 ✓
britishcolumbia.ca Trade and Invest British Columbia
documentation Government and public services CA 48 ✓
thinger.io Thinger.io
interface AI and machine learning Infrastructure — 48 ✓
bloghart.com Bloghart.com
documentation Marketing Personal sites and blogs FR 46 ✓
abatable.com Abatable
documentation Finance and payments Business software — 47 ✓
infrastructurevictoria.com.au Infrastructure Victoria
documentation Infrastructure Government and public services +1 AU 46 ✓
api.org American Petroleum Institute (API)
informational Industry and manufacturing US 64 ✓
ehn.org EHN
documentation Media US 64 ✓ ✓
totallydublin.ie Totally Dublin: Dublin Nightlife, Events, Culture and Restaurants
informational Food and dining Marketing +1 IE 49 ✓
adseon.xyz Adseon
informational Real estate FR 53 ✓
skyquestt.com SkyQuest Technology Consulting
documentation Business software — 60 ✓
africanews24.com Africa News 24
documentation Media — 50 ✓
gbbc.io Global Blockchain Business Council (GBBC)
informational Community Crypto and Web3 PL 47 ✓
vut.ac.za Vaal University of Technology
documentation Education ZA 51 ✓
iihs.co.in Indian Institute for Human Settlements (IIHS)
documentation Science and research Education IN 51 ✓
aiunderstanding.org AI Understanding
documentation AI and machine learning Education — 50 ✓ ✓
esoft.lk ESOFT Metro Campus
documentation Education LK 47 ✓
fpri.org Foreign Policy Research Institute
informational Science and research — 53 ✓
integral-corp.com Integral Consulting Inc\.: Insight for an evolving world
informational Science and research US 47 ✓
openweather.co.uk OpenWeather for Business
interface APIs and SDKs Data and analytics GB 51 ✓ ✓
siwi.org Stockholm International Water Institute (SIWI)
informational Nonprofit and advocacy Science and research US 59 ✓
ohe.org OHE
informational Science and research US 49 ✓
africatimes.com AfricaTimes
informational Media — 55 ✓
islandinnovation.com Island Innovation
informational Media Science and research +1 US 48 ✓ ✓
designsingapore.org DesignSingapore Council
documentation Marketing Design US 56 ✓
challengesuccess.org Challenge Success: An Affiliate of the Stanford Graduate School of Education
documentation Education Nonprofit and advocacy US 48 ✓
visegradpost.com Visegrád Post
informational Media — 49 ✓
naset.com NASET - National Association of Special Education Teachers
informational Education — 45 ✓
charteredaccountantsworldwide.com Chartered Accountants Worldwide: No ordinary business minds
informational US 47 ✓
farmersreviewafrica.com Farmers Review Africa
informational Industry and manufacturing Agriculture +1 FR 50 ✓
forward-college.eu Forward College: Make your studies a journey
documentation Marketing Education — 47 ✓
wiuc-ghana.edu.gh Wisconsin International University College, Ghana
informational Education GH 47 ✓
philsa.gov.ph Philippine Space Agency \(PhilSA\): The Philippine Space Agency \(PhilSA\) is the central government agency addressing all national issues and activities related to space S\&T applications\.
documentation Government and public services Marketing +1 PH 47 ✓
whoi.edu Woods Hole Oceanographic Institution: OUR OCEAN. OUR PLANET. OUR FUTURE.®
informational Science and research US 55 ✓
france-science.com France Science
informational Education Science and research — 47 ✓
acoss.org.au ACOSS: Australian Council of Social Service
documentation Marketing Nonprofit and advocacy AU 47 ✓
sphera.com Sphera: To create a safer, more sustainable and productive world\.
documentation Business software US 52 ✓
citrine.io Citrine Informatics: AI for Product Development, Production, and Sales in Materials and Chemicals
documentation AI and machine learning Science and research US 48 ✓
deepseanews.com Deep Sea News
informational Media US 58 ✓
inspiredplc.co.uk Inspired: Today's partner for a better tomorrow
documentation Energy and utilities GB 47 ✓
commondreams.org Common Dreams
documentation Healthcare Media US 70 ✓ ✓
cia-ica.ca Canadian Institute of Actuaries \| Institut canadien des actuaires: Helping Canadians face the future with confidence \| Aider la population canadienne à faire face à l’avenir en toute confiance
documentation Nonprofit and advocacy CA 48 ✓
wwsg.com Worldwide Speakers Group
transactional Events and conferences US 52 ✓ ✓
prospiant.com Prospiant
informational Construction and architecture Agriculture US 48 ✓
bora-corp.com Bora Pharmaceuticals
informational Healthcare Industry and manufacturing CA 47 ✓
myjoyonline.com MyJoyOnline
informational Media US 58 ✓
spire.com Spire Global: For an increasingly complex, uncertain and fast moving world
documentation Science and research Data and analytics US 59 ✓
sustainabilityonline.net Sustainability Online
transactional Media — 47 ✓
allianceforwaterefficiency.org Alliance for Water Efficiency
documentation Nonprofit and advocacy US 56 ✓
apnic.foundation APNIC Foundation
informational Cybersecurity Nonprofit and advocacy — 58 ✓ ✓
oliverwyman.com oliverwyman.com
documentation AI and machine learning Media US 63 ✓
simpliflying.com SimpliFlying
documentation AI and machine learning Marketing — 51 ✓ ✓
medicalresearch.com MedicalResearch.com
informational Healthcare Media +1 US 57 ✓
geopard.tech GeoPard \- Precision agriculture Mapping software: Precision agriculture Mapping software
documentation Agriculture Data and analytics US 49 ✓
cadus.org cadus.org
documentation Nonprofit and advocacy DE 46 ✓
eps.org European Physical Society
informational Education Science and research +1 FR 59 ✓
ecojobs.com EcoJobs.com - Environmental Jobs & Conservation Jobs
informational Recruiting and careers US 48 ✓
moixa.com Moixa | Home Energy Storage | Smart Energy Management
documentation Marketing Energy and utilities GB 47 ✓
musicmark.org.uk Music Mark
informational Media Education +1 GB 48 ✓
afgc.org.au Australian Food \& Grocery Council
informational Marketing Nonprofit and advocacy +1 AU 46 ✓
cropin.com Cropin
documentation AI and machine learning Agriculture US 56 ✓
ecomena.org documentation GB 49 ✓
mediatechdemocracy.com Centre for Media, Technology and Democracy
documentation Media Education +1 — 50 ✓ ✓
orangeloops.com OrangeLoops
informational Developer tools US 50 ✓ ✓
storybench.org Exploring data and digital storytelling. Northeastern's School of Journalism Storybench
informational Media Education US 48 ✓
activepure.com ActivePure Technology
documentation Marketing Consumer electronics US 47 ✓
betternow.org BetterNow
documentation Business software Nonprofit and advocacy US 46 ✓
isid.org ISID
informational Education Healthcare +2 — 52 ✓
psychnewsdaily.com Psych News Daily
informational Media FR 56 ✓
myessaywriter.ai www.myessaywriter.ai llms.txt
informational Education AI and machine learning US 47 ✓
upack.com Household Moving Company | U-Pack
transactional Arts and culture — 58 ✓
naiglobal.com NAI Global
informational Real estate US 52 ✓
farmfoodfamily.com Farm Food Family
informational VN 51 ✓
streetlightdata.com StreetLight
documentation Data and analytics US 51 ✓
cetpartnership.eu CETPartnership
documentation Science and research NO 48 ✓
lexiconbranding.com Lexicon Branding
documentation Marketing US 47 ✓
conservation.org Conservation International
documentation Science and research Nonprofit and advocacy US 61 ✓
ecologyandsociety.org Ecology & Society
informational Science and research — 61 ✓
cupahr.org CUPA\-HR: College and University Professional Association for Human Resources
documentation Education Recruiting and careers — 57 ✓
apimondia.org APIMONDIA
informational Nonprofit and advocacy Science and research FR 47 ✓
duaneelgin.com Duane Elgin
documentation Personal sites and blogs US 46 ✓
investigatemidwest.org Investigate Midwest
informational Media Nonprofit and advocacy NL 63 ✓ ✓
niskanencenter.org Niskanen Center
informational Nonprofit and advocacy US 60 ✓
natureandculture.org Nature and Culture International
documentation Nonprofit and advocacy US 51 ✓ ✓
edfman.com ED&F Man Commodities
informational GB 47 ✓
journeyfoods.io Journey Foods
interface Business software US 46 ✓
betakit.com BetaKit
informational AI and machine learning Finance and payments +1 GB 62 ✓
edited.com EDITED: Empowering Intelligent Retail
interface Ecommerce AI and machine learning +1 — 57 ✓
ebsu.edu.ng Ebonyi State University
informational Education NG 54 ✓
anantamias.com Anantam IAS
documentation — 46 ✓
opendemocracy.net openDemocracy
informational Media NL 70 ✓ ✓
thinknpc.org NPC: NPC
documentation Nonprofit and advocacy GB 56 ✓
philea.eu Philea
informational Nonprofit and advocacy DE 51 ✓
acetforafrica.org ACET: The African Center for Economic Transformation \(ACET\)
documentation Science and research Nonprofit and advocacy — 49 ✓
thediplomaticinsight.com The Diplomatic Insight
documentation — 47 ✓
implan.com IMPLAN
interface Data and analytics US 55 ✓
newton.ac.uk Isaac Newton Institute
informational Science and research GB 52 ✓
blockrenovation.com Block Renovation - AI-Powered Home Renovation Marketplace
documentation AI and machine learning Construction and architecture — 50 ✓
allerdogs.com AllerDogs | Dog Allergy
documentation Pets US 48 ✓
eq-cap.com Equilibrium
documentation US 46 ✓
generali.com Generali Group
documentation Finance and payments Insurance NL 59 ✓
luminafoundation.org Lumina Foundation
documentation Education Nonprofit and advocacy US 56 ✓
ppic.org Public Policy Institute of California (PPIC)
documentation Science and research Nonprofit and advocacy — 56 ✓ ✓
technocracy.news Coherent Publishing
informational Finance and payments Media US 56 ✓
arunachal24.in Arunachal24
informational Media IN 54 ✓
theboxplymouth.com The Box Plymouth: Museum, Art Gallery, Archive
informational Arts and culture GB 51 ✓
everytexan.org Every Texan
informational Healthcare Nonprofit and advocacy US 48 ✓
baysoundings.com Bay Soundings
informational Media US 46 ✓
orfgenetics.com ORF Genetics
documentation Science and research Industry and manufacturing US 46 ✓
practicesource.com Practice Source - Legal News and Views - Asia Pacific and Beyond
informational Legal Media — 46 ✓
ecf.com European Cyclists' Federation — ECF
informational Nonprofit and advocacy — 55 ✓
gedmatch.com GEDmatch
informational Marketing US 62 ✓ ✓
cec.org Commission for Environmental Cooperation: Three countries working together to protect our shared environment
documentation Science and research Government and public services CA 59 ✓
tomorrow.university Tomorrow University of Applied Sciences
documentation Education US 54 ✓
ogc.org Open Geospatial Consortium
documentation Science and research DE 53 ✓
azti.es AZTI: Centro de investigación especializado en el medio marino y la alimentación, AZTI aporta productos y tecnologías de vanguardia y de valor añadido basados en ciencia e investigación sólidas\.
documentation Science and research ES 52 ✓
opengrants.io OpenGrants
interface Business software APIs and SDKs — 51 ✓ ✓
leotek.com LEOTEK Electronics U.S.A. Corporation
documentation — 50 ✓
cypcs.org.uk The Children and Young People's Commissioner Scotland: Protecting and promoting children's rights: the human rights of children and young people\.
documentation Government and public services Nonprofit and advocacy GB 48 ✓
ispmyanmar.com ISP-Myanmar
documentation Nonprofit and advocacy Science and research — 47 ✓
dino-world.com Dino World
informational — 46 ✓
knowprose.com KnowProSE.com
informational AI and machine learning Personal sites and blogs FR 46 ✓
nbjge.com Amber Reflectors, Red Reflectors, Round Reflectors - J-GUANG
documentation Industry and manufacturing US 46 ✓
affinity-petcare.com Affinity Petcare
documentation Food and dining Industry and manufacturing +1 IE 60 ✓ ✓
techuk.org techUK
informational Nonprofit and advocacy US 60 ✓
avpn.asia AVPN: Moving Capital Towards Impact
documentation Nonprofit and advocacy — 57 ✓
denikalarm.cz Deník Alarm
informational Media CZ 54 ✓
businesslocationcenter.de Business Location Center - Wirtschaftsportal Berlin
documentation Education Government and public services DE 52 ✓
anmj.org.au ANMJ
informational Education Healthcare +1 AU 47 ✓
observatoriodamineracao.com.br Observatório da Mineração
informational Media BR 46 ✓
envirolink.org EnviroLink Network
informational Media — 64 ✓ ✓
globalccsinstitute.com Global CCS Institute: Carbon Management Understood, Enabled, Deployed\.
documentation Science and research — 60 ✓
nvca.org National Venture Capital Association - NVCA
documentation Marketing Finance and payments — 60 ✓
environmentalscience.org EnvironmentalScience.org
informational Government and public services Education +1 — 59 ✓
visitseoul.net Visit Seoul — Multilingual Index / 다국어 통합 인덱스
documentation Travel KR 59 ✓
centerforfinancialinclusion.org Center for Financial Inclusion
informational Marketing Finance and payments +1 US 57 ✓
tfp.org The American TFP
informational Nonprofit and advocacy — 57 ✓
nigeriahealthwatch.com Nigeria Health Watch
informational Healthcare Media FR 53 ✓ ✓
greenlivingguy.com The Green Living Guy
informational Personal sites and blogs US 52 ✓ ✓
truth-and-beauty.net Moritz Stefaner — Truth & Beauty
documentation AI and machine learning Design +1 DE 51 ✓ ✓
incpak.com INCPak
informational Media — 50 ✓
lightcastlepartners.com LightCastle Partners: International Management Consulting Firm
informational — 47 ✓
urbanhealth.org.uk Impact on Urban Health
informational Healthcare Nonprofit and advocacy GB 46 ✓
vrlatech.com VRLA Tech
transactional Science and research Education +1 US 46 ✓
massmoca.org MASS MoCA
informational Marketing Arts and culture US 60 ✓
vantagecircle.com Vantage Circle
documentation Business software — 60 ✓
camoinassociates.com Camoin Associates
documentation US 48 ✓
intuit.com Intuit
documentation Finance and payments Business software FR 67 ✓
plasticbank.com Plastic Bank
documentation Nonprofit and advocacy — 62 ✓ ✓
rolandberger.com Roland Berger
informational DE 62 ✓
transparency.org Transparency International
documentation Nonprofit and advocacy US 61 ✓
vitalcitynyc.org Vital City
documentation Media NL 61 ✓ ✓
gdusa.com Graphic Design USA
informational Marketing Design +1 US 58 ✓
ftsg.com Future Today Strategy Group
informational AI and machine learning — 57 ✓
transform-network.net transform!europe
informational Community FI 56 ✓
acclime.com Acclime
documentation Finance and payments US 54 ✓
door3.com DOOR3 – Award-winning Technology Consultancy & Software Development Firm | New York City
documentation Developer tools AI and machine learning +1 — 54 ✓
tonyelumelufoundation.org The Tony Elumelu Foundation
informational Nonprofit and advocacy US 53 ✓
hosokawa-micron-bv.com llms.txt — Hosokawa Micron B.V. (International / English)
documentation Industry and manufacturing NL 52 ✓
kevinmeyer.com Kevin Meyer
informational AI and machine learning Personal sites and blogs NL 51 ✓ ✓
publishwhatyoufund.org Publish What You Fund: The Global Campaign for Aid and Development Transparency
documentation Marketing Nonprofit and advocacy — 51 ✓
allemannsdata.com Allemannsdata
interface Developer tools AI agents and MCP +1 — 50 ✓
brilliantcrank.com Brilliantcrank
informational Personal sites and blogs — 50 ✓ ✓
iraqoilreport.com Iraq Oil Report: The Source to Iraq, Its People and Its Oil
documentation Media US 49 ✓
getuhoo.com uHoo
documentation US 48 ✓
genesis-analytics.com Genesis Analytics
informational Data and analytics Science and research US 47 ✓
i3solutions.com i3solutions
documentation Business software US 47 ✓
lizard.global AI Integration & Enterprise Software Modernization | Lizard Global
documentation AI and machine learning Business software US 47 ✓
marveldesigns.com Marvel
documentation Design — 47 ✓
aedcweb.com AEDC: Anchorage Economic Development Corporation
documentation Government and public services Nonprofit and advocacy — 46 ✓
beta.nyc BetaNYC
informational Marketing Nonprofit and advocacy +1 US 46 ✓
globalkingprojectmanagement.org Global King Project Management (GKPM)
transactional Productivity Education — 46 ✓
kibalenationalparkuganda.com Kibale National Park
transactional Travel US 46 ✓
thecalabashnewspaper.com The Calabash Newspaper
informational Media FR 46 ✓
unitedpeople.global united people global
informational US 46 ✓
skillsforafrica.org Data-afrique Consultancy
informational Education — 45 ✓
h2o.ai H2O AI
documentation AI and machine learning AI agents and MCP US 61 ✓
iupap.org IUPAP: The International Union of Pure and Applied Physics
informational Science and research — 57 ✓
theubj.com The UBJ
informational AI and machine learning Industry and manufacturing +1 — 57 ✓ ✓
legalinsurrection.com Le·gal In·sur·rec·tion
informational Marketing Media — 56 ✓
coywolf.com Coywolf
informational Media — 52 ✓
networkweaver.com Network Weaver
informational US 52 ✓
paulkedrosky.com Paul Kedrosky
informational Personal sites and blogs — 52 ✓ ✓
afsafrica.org AFSA
informational Nonprofit and advocacy Agriculture NL 51 ✓
clarity.io Clarity
documentation Data and analytics US 51 ✓
biomedicalimaging.org ISBI 2022
informational Science and research Events and conferences US 48 ✓
ishr.ch ISHR
informational Nonprofit and advocacy CH 48 ✓
isispace.nl ISISPACE
documentation Industry and manufacturing Science and research NL 48 ✓
kyotoreview.org Kyoto Review of Southeast Asia
informational Media JP 48 ✓
emeraldbook.org Emerald Book
documentation Media US 46 ✓
dailynewsegypt.com Dailynewsegypt
informational Finance and payments Media — 62 ✓
3bee.com 3Bee -- Technology for Biodiversity
documentation Science and research US 61 ✓ ✓
vfc.com VF Corporation
informational Fashion and beauty US 61 ✓
sampleboard.com SampleBoard
informational Design — 60 ✓ ✓
natureconservancy.ca Nature Conservancy of Canada
informational Marketing Nonprofit and advocacy CA 59 ✓
vivosun.com Vivosun Content & Support Center
documentation Home and garden US 58 ✓
worldcouncilforhealth.org World Council for Health: A Better Way For a Better World
documentation Nonprofit and advocacy Healthcare — 58 ✓
conservativedailynews.com Conservative Daily News
informational Media FR 57 ✓
runforsomething.net Run For Something
informational Government and public services Nonprofit and advocacy — 57 ✓
chelseagreen.com Chelsea Green Publishing
transactional Media — 56 ✓
foodbanking.org The Global FoodBanking Network
informational Nonprofit and advocacy US 56 ✓
simpsondoor.com Simpson Door Company — Solid Wood Interior & Exterior Doors Since 1912
documentation Industry and manufacturing Home and garden US 56 ✓
stepstonegroup.com StepStone Group
documentation Finance and payments US 56 ✓
chi.ac.uk University of Chichester: The University of Chichester is in Chichester with a campus also in Bognor Regis, West Sussex\. Offering excellent undergraduate \& postgraduate degrees, apply now\.
informational Education GB 54 ✓
jinafin.com JINAFIN
informational Media — 54 ✓
curlcentric.com Curl Centric® by Kenneth & Kira Byrd
informational Fashion and beauty — 53 ✓
forumone.com Forum One
documentation AI and machine learning US 53 ✓
maptive.com Maptive
documentation Data and analytics — 53 ✓
adler.edu Adler University
informational Education — 52 ✓
laislanetwork.org La Isla Network (LIN)
documentation Healthcare Nonprofit and advocacy +1 US 52 ✓
westcoastselfstorage.com West Coast Self-Storage - High Quality Self-Storage Locations in the Western United States
transactional Local business — 52 ✓ ✓
sumas.ch SUMAS – Sustainability Management School
documentation Education CH 51 ✓ ✓
greentec.com **All About Greentec | Secure IT Asset Disposal & E-Waste Recycling**
transactional Business software US 50 ✓ ✓
fdra.org FDRA
documentation Nonprofit and advocacy US 49 ✓
macskillsdevelopment.com MacSkills Training and Development Institute
transactional Education — 49 ✓
erasmuscatalogue.com Erasmus Catalogue
documentation Education FR 48 ✓
nurhsa.org NURHSA
informational Education BD 48 ✓
antcube.shop ANTCUBE
transactional Ecommerce Pets — 47 ✓
aracy.org.au ARACY: Every Child Thriving
documentation Nonprofit and advocacy AU 47 ✓
clicktowrite.com Click To Write
informational Sports and fitness — 47 ✓
ethicalmarketingnews.com Ethical Marketing News
informational Marketing Media DE 47 ✓
gorilladoctors.org Gorilla Doctors
documentation Science and research Healthcare US 47 ✓
greatplainsfoundation.com Great Plains Foundation
documentation Nonprofit and advocacy ZA 47 ✓
manaramagazine.org Manara Magazine
informational Media FR 47 ✓
proposalkit.com Proposal Kit
transactional Business software US 47 ✓
salesar.io SalesAR
documentation Marketing — 47 ✓
uwecworkgroup.info Ukraine War Environmental Consequences Work Group
documentation Marketing FR 47 ✓
cyprusregister.com CyprusRegister
documentation Legal Finance and payments — 46 ✓
depinhub.io DePIN Hub
documentation Crypto and Web3 Infrastructure — 46 ✓ ✓
destinationksa.com Destination KSA: Your guide to Saudi
informational Travel Arts and culture — 46 ✓
fastgovtnewsalert.com Fast Govt News Alert
informational Media DE 46 ✓
juvjustice.org Coalition for Juvenile Justice
documentation Nonprofit and advocacy — 46 ✓
trustafrica.org Shaping the Future of Africa
documentation Marketing Nonprofit and advocacy US 46 ✓
wifu.de WIFU-Stiftung
documentation Nonprofit and advocacy Science and research DE 46 ✓
wint.ai Wint: Water Intelligence
documentation Construction and architecture Business software — 46 ✓