xrpl.to xrpl.to — notice to AI systems and automated clients
informational AI and machine learning — 48 ✓
helpsns.com SNS헬프
transactional Marketing — 56 ✓
sixty-percent.com 60%（シックスティーパーセント）
transactional Ecommerce Fashion and beauty — 50 ✓
sadowniczy.pl Sadowniczy.pl
transactional Ecommerce Agriculture PL 55 ✓
matfel.pl MATFEL SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
transactional Ecommerce PL 55 ✓
auberins.com Auber Instruments
transactional Ecommerce Industry and manufacturing US 52 ✓
lozkoholicy.pl Łóżkoholicy
transactional Ecommerce PL 48 ✓
howthelightgetsin.org howthelightgetsin.org
documentation GB 51 ✓
stripchat.red stripchat.red
documentation — 56 ✓ ✓
toya24.pl toya24.pl
transactional Ecommerce PL 55 ✓
qjmotoritaly.com Network Security Verification
informational HK 46 ✓
dmtrade.pl DMTrade
transactional Consumer electronics Ecommerce PL 54 ✓
poszetka.com Poszetka.com
transactional Fashion and beauty PL 53 ✓
amso.eu www.amso.eu
transactional Ecommerce Consumer electronics PL 50 ✓
99ff16.com Network Security Verification
informational ZA 46 ✓
graingold.de GrainGold – Online-Möbelhaus für Polster- und Holzmöbel
transactional Home and garden Ecommerce DE 48 ✓
inter-rally.pl Inter Group
transactional Automotive PL 48 ✓
spacetronik.pl Spacetronik.Store
transactional Consumer electronics Ecommerce PL 48 ✓
jmssjgzsx.com Network Security Verification
informational Cybersecurity ZA 46 ✓
emultimax.pl Emultimax.pl
transactional Home and garden Ecommerce PL 47 ✓
phillipslytle.com Phillips Lytle LLP — llms.txt (Strict)
informational AI and machine learning Legal US 48 ✓
fishingstore.pl FishingStore.pl
transactional Ecommerce Sports and fitness PL 47 ✓
harpers.pl Harpers
transactional Ecommerce Fashion and beauty PL 47 ✓
vaperanger.com Allow all known major AI and LLM bots to crawl the entire site
informational US 45 ✓
mmgastro.pl mmgastro.pl
transactional Ecommerce Food and dining PL 47 ✓
sklepmotocyklowy.pl www.sklepmotocyklowy.pl
transactional Automotive Ecommerce PL 47 ✓
bjkpfw.com Network Security Verification
informational ZA 46 ✓
tomaszsar.pl TomaszSar.pl
transactional Fashion and beauty PL 46 ✓
swecobelgium.be Sweco Belgium
documentation Construction and architecture BE 48 ✓
hibt.com HiBT Exchange
informational — 50 ✓
moodo.pl www.moodo.pl
transactional Fashion and beauty Ecommerce PL 58 ✓
freehost.com.ua Разрешаем OpenAI GPTBot (ChatGPT)
documentation UA 50 ✓
zooart.com.pl zooart.com.pl
transactional Pets Ecommerce PL 58 ✓
konesso.pl Konesso.pl
transactional Ecommerce Food and dining PL 57 ✓
ozonee.pl Ozonee.pl
transactional Ecommerce Fashion and beauty PL 57 ✓
amso.pl www.amso.pl
transactional Ecommerce Consumer electronics PL 56 ✓
androidi.com Androidi
informational AI and machine learning FR 46 ✓
modbis.pl ModBiS.pl
transactional Fashion and beauty Ecommerce PL 56 ✓
butosklep.pl BUTOSKLEP
transactional Ecommerce Fashion and beauty PL 55 ✓
legionisci.com Legionisci.com — AI crawler information
PL 48 ✓
casu.pl Sklep Casu.pl
transactional Ecommerce Fashion and beauty PL 55 ✓
megadron.pl MEGADRON
transactional Consumer electronics Ecommerce PL 55 ✓
aksysgames.com Allow AI search assistants
documentation US 47 ✓
glam-shop.pl glam-shop.pl
transactional Ecommerce Fashion and beauty PL 54 ✓
lou.pl Lou.pl
transactional Fashion and beauty Ecommerce PL 54 ✓
bretton.com Bretton
documentation US 50 ✓
pantofelek24.pl Pantofelek24.pl
transactional Fashion and beauty Ecommerce PL 54 ✓
mtuning.pl MTuning
transactional Automotive PL 53 ✓
iai.tv IAI.tv
informational GB 55 ✓
skorzana.com Skorzana.com
transactional Fashion and beauty Ecommerce PL 53 ✓
spacetronik.store Spacetronik.Store
transactional Home and garden Ecommerce PL 52 ✓
taimen.com TAIMEN
transactional Ecommerce Sports and fitness PL 52 ✓
jardin-deco.com www.jardin-deco.com
transactional Home and garden Ecommerce PL 51 ✓
verostilo.com www.verostilo.com
transactional Ecommerce Fashion and beauty PL 51 ✓
ieee-ras.org IEEE Robotics and Automation Society Website: Focus is on both applied and theoretical issues in robotics and automation\. Robotics is here defined to include intelligent machines and systems; whereas
documentation Marketing Science and research US 59 ✓
winylownia.pl Winylownia
transactional Ecommerce Entertainment and streaming PL 49 ✓
unizoo.pl https://unizoo.pl/
transactional Pets Ecommerce PL 48 ✓
suvudu.com llms.txt — AI crawler instructions for this site (November 2025)
US 45 ✓
4fizjo.de 4fizjo.de
transactional Ecommerce Sports and fitness DE 47 ✓
agrafka.com.pl agrafka.com.pl
transactional Ecommerce Fashion and beauty PL 47 ✓
icade.fr Specific rules for AI crawlers
informational FR 47 ✓
bosastopka.pl Bosa Stópka
transactional Ecommerce Fashion and beauty PL 47 ✓
cocomore.pl Cocomore.pl
transactional Fashion and beauty Ecommerce PL 47 ✓
fitizzio.pl FITIZZIO
transactional Ecommerce Home and garden PL 47 ✓
nerdvpn.de nerdvpn.de and all subdomains
informational AI and machine learning DE 45 ✓
fordoriginalparts.pl www.fordoriginalparts.pl
transactional Automotive Ecommerce PL 47 ✓
graingold.pl GrainGold
transactional Home and garden Ecommerce PL 47 ✓
cdnetworks.com 规则组 1: 针对所有爬虫的通用规则
documentation FR 48 ✓
grechbox.pl GrechBox
transactional Food and dining PL 47 ✓
icarp.pl icarp.pl
transactional Ecommerce PL 47 ✓
mybra.pl myBra.pl
transactional Ecommerce Fashion and beauty PL 47 ✓
olika.com.pl www.olika.com.pl
transactional Fashion and beauty PL 47 ✓
velpa.pl Velpa.pl
transactional Ecommerce Fashion and beauty PL 47 ✓
neura-robotics.com Neura Robotics
transactional Industry and manufacturing AI and machine learning — 58 ✓
adrenaline.pl adrenaline.pl
transactional Fashion and beauty Sports and fitness +1 PL 46 ✓
burf.co Burf Robotics
documentation AI and machine learning DE 46 ✓
bailedebodaonline.com www.bailedebodaonline.com
transactional Education PL 46 ✓
bazamydlana.com bazamydlana.com
documentation PL 46 ✓
betheskygirl.com www.BeTheSkyGirl.com
documentation PL 46 ✓
dibor.co.uk Dibor AI Usage Policy
informational GB 46 ✓ ✓
domlalek.pl www.domlalek.pl
transactional Ecommerce PL 46 ✓
infantilo.pl INFANTILO
transactional Fashion and beauty PL 46 ✓
robophil.com RoboPhil – Robotics, Physical AI & Service Robots
documentation Industry and manufacturing GB 46 ✓
kasadress.pl Kasadress.pl
transactional Fashion and beauty Ecommerce PL 46 ✓
kimchi.pl Kimchi.pl
transactional Ecommerce Food and dining PL 46 ✓
knight-manager.com Knight Manager
US 49 ✓
kinga.com.pl Kinga
transactional Fashion and beauty Ecommerce PL 46 ✓
labri.pl www.labri.pl
transactional Fashion and beauty Ecommerce PL 46 ✓
sunbeltrentals.com Sunbelt Rentals LLMs.txt
documentation US 58 ✓
mangarden.pl MANGARDEN
informational Ecommerce PL 46 ✓
mantoshop.pl MANTO
transactional Ecommerce Fashion and beauty +1 PL 46 ✓
naturawit.cz NATURAWIT.CZ
transactional Ecommerce CZ 46 ✓
coozmoo.com LLMs.txt for https://coozmoo.com/
documentation Marketing NL 47 ✓
obuwie-lizuraj.pl http://www.obuwie-lizuraj.pl/
transactional Fashion and beauty PL 46 ✓
ozonee.hu Ozonee.hu
transactional Ecommerce Fashion and beauty HU 46 ✓
pupilkarma.pl https://pupilkarma.pl/
transactional Pets Ecommerce PL 46 ✓
strado.pl Strado.pl
transactional Home and garden Ecommerce PL 46 ✓
imoo.com imoo Global Site Index
transactional Consumer electronics US 55 ✓
victoryglow.pl VictoryGlow
transactional Ecommerce Fashion and beauty PL 46 ✓
zalsqa.eu zalsqa.eu
transactional Ecommerce Fashion and beauty PL 46 ✓
alejandrorioja.com Alejandro Rioja
documentation AI and machine learning Personal sites and blogs — 56 ✓ ✓
webotit.ai Webotit.ai
documentation AI and machine learning US 58 ✓ ✓
sweco.se Sweco Sweden
documentation Construction and architecture SE 52 ✓
carmager.com Sklep Carmager.com
transactional Automotive Ecommerce PL 56 ✓
i-apteka.pl Apteka Miejska
transactional Healthcare Ecommerce PL 55 ✓
gteek.com Gteek.com - Roadmap and Context for AI Agents and Large Language Models (LLMs)
documentation AI and machine learning BG 47 ✓
silcare.com Sklep Silcare
transactional Fashion and beauty Ecommerce PL 55 ✓
ornaty.net ARS SACRA
transactional Fashion and beauty Ecommerce — 54 ✓
chasubles24.com ARS SACRA
transactional Ecommerce — 51 ✓
clochee.com CLOCHEE - Kosmetyki naturalne
transactional Fashion and beauty Ecommerce PL 51 ✓
mtstechnik.com MTS Technik
transactional Automotive Ecommerce PL 51 ✓
nethris.com Access granted for GPTBot
documentation GB 48 ✓
musicpusic.com Music Pusic - LLM and AI Agent Guide
documentation AI and machine learning Media IR 50 ✓
4ride.pl 4ride.pl - Sklep motocyklowy
transactional Ecommerce Automotive PL 47 ✓
boogivape.pl Sklep Wielobranżowy
transactional Ecommerce PL 47 ✓
nizel.pl Sklep wędkarski Nizel.pl
transactional Ecommerce Sports and fitness PL 47 ✓
karakter.pl Wydawnictwo Karakter
transactional Media PL 46 ✓
karolinagarczynska.com KAROLINA GARCZYŃSKA
documentation PL 46 ✓
mobile-city.pl MOBILE CITY
transactional Ecommerce Consumer electronics PL 46 ✓
olivka.com.pl OLIVKA Warsaw
transactional Fashion and beauty Ecommerce PL 46 ✓
poems.com.sg Block known aggressive/bad bots
documentation SG 46 ✓
kasada.io Kasada
interface Cybersecurity US 49 ✓
syrenaobuwie.pl Syrena Obuwie
transactional Fashion and beauty PL 46 ✓
szkolkaroza.pl Szkółka Róża
transactional Agriculture Ecommerce PL 46 ✓
sourcetable.com LLMs.txt for Sourcetable
informational US 45 ✓
your-fragrance.com Your Fragrance
documentation PL 46 ✓
geekplus.com www.geekplus.com llms.txt
documentation Industry and manufacturing Logistics and shipping US 48 ✓
trulymadly.com TrulyMadly
documentation Community IN 54 ✓
swecogroup.com Sweco Group
informational Construction and architecture SE 56 ✓
hackshackers.com Hacks/Hackers
interface Media AI agents and MCP — 58 ✓ ✓
specshop.pl Sklep militarny SpecShop.pl
transactional Ecommerce PL 56 ✓
domitech.pl DOMITECH P. Janiszewski T. Wąż Sp. k.
transactional Ecommerce PL 55 ✓
hurtel.com HURTEL sp. z o.o
transactional Ecommerce Consumer electronics PL 55 ✓
obsessive.com Obsessive - Zmysłowa Bielizna
transactional Fashion and beauty Ecommerce PL 54 ✓
cs2a.run No AI Scraping Allowed
informational RU 47 ✓
robotostudio.com Roboto Studio
documentation US 50 ✓ ✓
wassyl.pl WASSYL ANGELIKA WASSYL
transactional Fashion and beauty Ecommerce PL 54 ✓
pachnidelko.pl Pachnidełko Marcin Lewandowski
transactional Fashion and beauty Ecommerce PL 53 ✓
sklep-domwhisky.pl Dom Whisky Online
transactional Ecommerce PL 53 ✓
sidovski.com Sidovski.com Grzegorz Cielepak
transactional Automotive Ecommerce PL 52 ✓
wuw.pl Wydawnictwa Uniwersytetu Warszawskiego
transactional PL 51 ✓
sklep-intymny.pl E-mediacom
transactional Ecommerce PL 49 ✓
factoryprice.eu Factoryprice Sp z.o.o
transactional Ecommerce Fashion and beauty PL 48 ✓
militarysurplus.eu Military Surplus Europe
transactional Ecommerce PL 48 ✓
militarysurplus.ro Military Surplus Romania
transactional Ecommerce RO 48 ✓
galakor.pl Glassdoor Sp. kom.
transactional Home and garden Ecommerce PL 47 ✓
nestof.pl Sklep militarny Nestof
transactional Ecommerce PL 47 ✓
perfumy.pl Perfumy.pl Skoneczna Agnieszka
transactional Fashion and beauty Ecommerce PL 47 ✓
rafjolka.pl RAFAŁ KREFFT "KREFFT"
transactional Fashion and beauty Ecommerce PL 47 ✓
zeitmaschinen-shop.de Zeitmaschinen-Shop.de - Jakub Wscibski
transactional Automotive Ecommerce DE 47 ✓
k-sport.com.pl K-SPORT
transactional Sports and fitness Ecommerce PL 46 ✓
milicon.pl MILICON Piotr Remiszewski
transactional Ecommerce PL 46 ✓
sc9.pl SHOPPING CENTER 9
transactional Ecommerce Fashion and beauty PL 46 ✓
pressable.com Pressable
documentation Infrastructure US 52 ✓
denley.pl BOLF Sp. z o.o.
transactional Ecommerce Fashion and beauty PL 56 ✓
kontri.pl Kontri Sp. z o.o.
transactional Ecommerce Fashion and beauty PL 56 ✓
butyolivier.pl MRS Sp. z o.o.
transactional Ecommerce Fashion and beauty PL 55 ✓
armyworld.pl armyworld.pl Wojciech Miąskowski SKA
transactional Ecommerce PL 53 ✓
ostrovit.com OstroVit Sp. z o.o.
transactional Ecommerce — 52 ✓
verk.store VERK GROUP SIKORSKI SP.K.
transactional Ecommerce PL 52 ✓
metalmarket.eu Metal Market Europe Sp. z.o.o
transactional Finance and payments Ecommerce PL 51 ✓
internetowa-hurtownia.pl VERK GROUP SIKORSKI SP.K.
transactional Ecommerce PL 48 ✓
leddo.pl Sklep z oświetleniem Leddo.pl
transactional Ecommerce Home and garden PL 48 ✓
grembox.pl Grembox Sp. z o.o.
transactional Ecommerce PL 47 ✓
madamrock.pl MadamRock - sklep partnerski OLAVOGA
transactional Ecommerce Fashion and beauty PL 47 ✓
orionagd.pl OrionAGD.pl - Orion Artykuły Gospodarstwa Domowego
transactional Home and garden Ecommerce PL 47 ✓
sportroom.pl Sportroom sp. z o.o.
transactional Ecommerce Sports and fitness PL 47 ✓
rnew.pl RNEW sp. z o.o.
transactional Ecommerce Consumer electronics PL 46 ✓
sarnowscymeble.pl Sarnowscy Meble Spółka Cywilna
transactional Home and garden Ecommerce PL 46 ✓
ladnefelgi.pl LadneFelgi.pl Ewelina Taraszkiewicz Spółka Komandytowa
transactional Automotive Ecommerce PL 57 ✓
teengays.monster teengays.monster
informational — 56 ✓
abud.pl ABUD SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
transactional Local business Ecommerce +1 PL 53 ✓
pakolorente.com Pako Lorente Chrapkowicz Magiera Sp.J.
transactional Fashion and beauty Ecommerce PL 53 ✓
restyle.pl RESTYLE SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
transactional Fashion and beauty Ecommerce PL 53 ✓
raypath.eco Raypath.eco – Ekologiczne Czyszczenie bez Chemii
transactional PL 51 ✓
nico.com.pl Nico Polska Sp. z o.o.
transactional Ecommerce Fashion and beauty PL 47 ✓
wszystkodowlosow.pl PROGRES PD Sp. z o.o.
transactional Ecommerce Fashion and beauty PL 47 ✓
molton.pl Molton Styl Sp. z o.o.
transactional Fashion and beauty PL 46 ✓
obuwienaturalstyle.pl Natural Style Sp. z o.o.
transactional Fashion and beauty PL 46 ✓
lslidar.com Leishen Intelligent System
documentation Industry and manufacturing Consumer electronics — 51 ✓
mystic.pl MYSTIC PRODUCTION SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
transactional PL 49 ✓
dedra.pl Dedra-Exim Sp. z o.o.
transactional Industry and manufacturing PL 47 ✓
siemashop.pl Złoty Melon Spółka z ograniczoną odpowiedzialnością
transactional Ecommerce PL 46 ✓
membrana.pl Membrana s.c. Łukasz Budziak, Mateusz Markowicz
transactional Ecommerce Fashion and beauty PL 45 ✓
opinno.com Opinno
documentation US 52 ✓
maciejka.pl Maciejka Footwear Sp z o.o. Sp. J.
transactional Ecommerce Fashion and beauty PL 47 ✓
arttor.es Arttor Waldemar Błahyj i Leszek Błahyj spółka cywilna
transactional Ecommerce Home and garden ES 47 ✓
arttor.it Arttor Waldemar Błahyj i Leszek Błahyj spółka cywilna
transactional Ecommerce Home and garden IT 47 ✓
vilde.pl Vilde - better every day! Wszystko dla domu | Sklep internetowy
transactional Home and garden Ecommerce PL 47 ✓
rasowear.com Raso | Cycling wear designed and handmade in Poland
transactional Ecommerce Fashion and beauty PL 46 ✓
roselle.pl Roselle Store Sp. z o.o. / As You Wish
transactional Fashion and beauty PL 46 ✓
financialfilings.com FinancialFilings
interface Finance and payments Data and analytics +1 SG 63 ✓ ✓
orthoatlanta.com OrthoAtlanta
documentation Healthcare US 52 ✓
gayboy-porn.art GayBoy-Porn
informational — 56 ✓
rockmetalshop.pl ROCK METAL SHOP sp. z o.o. i Wspólnicy sp. komandytowa
transactional Ecommerce Fashion and beauty PL 56 ✓
tribune.net.ph Daily Tribune
informational Media PH 60 ✓ ✓
boobychristmas.com Booby Christmas
informational Entertainment and streaming — 52 ✓
francemanuels.com francemanuels.com
transactional Ecommerce Agriculture +1 — 46 ✓ ✓
line.games LINE Games
documentation Gaming — 57 ✓
rodentpro.com RodentPro
transactional Ecommerce Pets US 54 ✓
seobility.net Seobility
documentation Marketing US 61 ✓
otypo.com Otypo — otypo.com
transactional Ecommerce — 53 ✓
westpac.com.au Westpac
informational Finance and payments AU 53 ✓
heute.at *Heute.at*
informational Media AT 57 ✓
tandemdiabetes.com Tandem Diabetes Care
documentation Healthcare US 59 ✓
flexibleassembly.com Flexible Assembly Systems
transactional Industry and manufacturing Ecommerce US 51 ✓
iux24.com IUX24 — Financial News & Market Intelligence
informational Finance and payments Media — 49 ✓
gointernational.co.uk GO International
transactional Events and conferences GB 48 ✓
solarbotics.com Solarbotics Ltd.
transactional Consumer electronics Local business — 51 ✓
nera.com NERA Economic Consulting
documentation Business software US 57 ✓
insightbase.com InsightBase
documentation Data and analytics — 50 ✓
bubblealba.com 버블알바
documentation Recruiting and careers Community KR 54 ✓
beminimalist.co Minimalist
transactional Fashion and beauty Ecommerce CA 51 ✓ ✓
sharg.pl www.sharg.pl
transactional Ecommerce PL 48 ✓
cardahealth.com Carda Health
documentation Healthcare US 54 ✓
knds.com KNDS - The future of European land systems
informational Industry and manufacturing DE 53 ✓
lansdownepartners.com Lansdowne Partners
documentation Finance and payments GB 52 ✓
makerspet.com Maker's Pet
transactional Consumer electronics Education — 54 ✓
czechav.com CzechAV
informational Entertainment and streaming — 56 ✓
r51.com R51.com
informational Entertainment and streaming — 53 ✓
aperlena.com Aperlena
documentation Data and analytics Government and public services ES 47 ✓
czechcasting.com Czech Casting
informational Entertainment and streaming — 57 ✓
czechmassage.com Czech Massage
informational Entertainment and streaming — 55 ✓
czechstreets.com Czech Streets
informational Entertainment and streaming — 55 ✓
horrorporn.com Horror Porn
informational Entertainment and streaming — 55 ✓
perversefamily.com Perverse Family
transactional Entertainment and streaming — 55 ✓
czechamateurs.com Czech Amateurs
transactional Entertainment and streaming Media — 54 ✓
czechfantasy.com Czech Fantasy
transactional Entertainment and streaming — 54 ✓
czechbitch.com Czech Bitch
transactional Entertainment and streaming — 51 ✓
czechharem.com Czech Harem
informational Entertainment and streaming Media — 51 ✓
czechsolarium.com Czech Solarium
informational Entertainment and streaming Media — 51 ✓
czechtaxi.com Czech Taxi
informational Entertainment and streaming Media — 51 ✓
glaminogirls.com Glamino Girls
informational Entertainment and streaming — 51 ✓
redneckjohn.com Redneck John
informational Entertainment and streaming — 51 ✓
czechmegaswingers.com Czech Mega Swingers
transactional Entertainment and streaming Media — 54 ✓
czechwifeswap.com Czech Wife Swap
transactional Entertainment and streaming — 54 ✓
czechgangbang.com Czech Gang Bang
transactional Entertainment and streaming — 51 ✓
pdq.com PDQ
documentation Cybersecurity DevOps and observability +1 US 61 ✓
scb.co.th ธนาคารไทยพาณิชย์ จำกัด (มหาชน)
documentation Finance and payments TH 60 ✓
etruel.com etruel.com
interface Finance and payments ES 48 ✓
dongwonmall.com 동원몰 (Dongwon Mall)
transactional Ecommerce Food and dining KR 54 ✓
commonjobs.in Common Jobs
transactional AI and machine learning Recruiting and careers IN 48 ✓
bworld.co.kr SK브로드밴드 B world 및 B 다이렉트샵
transactional Telecom KR 50 ✓
emeritus.org Emeritus
documentation Education — 60 ✓
visionexpress.com Vision Express
transactional Healthcare Fashion and beauty GB 58 ✓
vanessabruno.fr Vanessa Bruno
transactional Fashion and beauty Ecommerce FR 52 ✓
uic.org UIC — International Union of Railways
documentation Industry and manufacturing US 60 ✓
cliftonhill.com llms.txt — Clifton Hill (cliftonhill.com)
CA 49 ✓
divaniapollonhotel.com Divani Apollon Palace & Thalasso
transactional Travel GB 51 ✓
ghofi.com GhoFi
transactional Telecom ES 53 ✓