Websites that block ClaudeBot

7,262 of the 67,673 readable sites in the census (10.7%) disallow ClaudeBot (Anthropic, training) from the site root in robots.txt. Disallowing these keeps a site's content out of future model training. It does not remove what was already collected.

SitePopularityrobots.txtRead on
cialssis.comTop 100,0008 disallowed2026-10-13
thearda.comTop 100,0008 disallowed2026-10-13
onderzoeksraad.nlTop 100,0008 disallowed2026-10-13
movieinsider.comTop 100,00011 disallowed2026-10-13
koamnewsnow.comTop 100,00014 disallowed2026-10-13
captimes.comTop 100,00014 disallowed2026-10-13
lege5.roTop 100,00021 disallowed2026-10-13
groupon.deTop 100,0008 disallowed2026-10-13
all-in.deTop 100,00018 disallowed2026-10-13
sjdm.orgTop 100,00021 disallowed2026-10-13
jingleidz.comTop 100,00021 disallowed2026-10-13
lookoutlanding.comTop 100,00017 disallowed2026-10-13
brownstoner.comTop 100,00013 disallowed2026-10-13
doteasy.comTop 100,0008 disallowed2026-10-13
undertheradarmag.comTop 100,0004 disallowed2026-10-13
zefix.chTop 100,00022 disallowed2026-10-13
virginiadot.orgTop 100,00020 disallowed2026-10-13
boomstarter.ruTop 100,0009 disallowed2026-10-13
liveandletsfly.comTop 100,0009 disallowed2026-10-13
amasty.comTop 100,0006 disallowed2026-10-13
gqjapan.jpTop 100,00016 disallowed2026-10-13
elaph.comTop 100,00012 disallowed2026-10-13
bloggingtheboys.comTop 100,00017 disallowed2026-10-13
independentmail.comTop 100,00020 disallowed2026-10-13
bmwpower.lvTop 100,00011 disallowed2026-10-13
printedmatter.orgTop 100,0005 disallowed2026-10-13
camsexcity.comTop 100,0001 disallowed2026-10-13
data.gov.uaTop 100,00013 disallowed2026-10-13
zumarestaurant.comTop 100,0008 disallowed2026-10-13
ketk.comTop 100,00013 disallowed2026-10-13
ruhr24.deTop 100,00014 disallowed2026-10-13
isthmus.comTop 100,00010 disallowed2026-10-13
supplychain247.comTop 100,00011 disallowed2026-10-13
campmor.comTop 100,00011 disallowed2026-10-13
zalando.nlTop 100,0008 disallowed2026-10-13
thetimesherald.comTop 100,00020 disallowed2026-10-13
robotvacuummops.ukTop 100,00010 disallowed2026-10-13
qchron.comTop 100,00014 disallowed2026-10-13
wacoal.jpTop 100,0001 disallowed2026-10-13
diariodeburgos.esTop 100,00018 disallowed2026-10-13
blizko.ruTop 100,0004 disallowed2026-10-13
mfa.gov.cyTop 100,00021 disallowed2026-10-13
wlw.deTop 100,00014 disallowed2026-10-13
asiaplustj.infoTop 100,00011 disallowed2026-10-13
sportbuzzer.deTop 100,0007 disallowed2026-10-13
sakigake.jpTop 100,00019 disallowed2026-10-13
opentable.deTop 100,00013 disallowed2026-10-13
indianacapitalchronicle.comTop 100,00012 disallowed2026-10-13
legistorm.comTop 100,0002 disallowed2026-10-13
rainbowpushwallstreetproject.orgTop 100,0004 disallowed2026-10-13
www.robotvacuummops.ukTop 100,00010 disallowed2026-10-13
eltelegrafo.com.ecTop 100,0007 disallowed2026-10-13
dfl.deTop 100,00020 disallowed2026-10-13
schoener-wohnen.deTop 100,00011 disallowed2026-10-13
udisc.comTop 100,0004 disallowed2026-10-13
asknature.orgTop 100,00011 disallowed2026-10-13
geelongadvertiser.com.auTop 100,00020 disallowed2026-10-13
closeronline.co.ukTop 100,00020 disallowed2026-10-13
politics-prose.comTop 100,0005 disallowed2026-10-13
zalando.frTop 100,0008 disallowed2026-10-13
dnj.comTop 100,00020 disallowed2026-10-13
metapedia.orgTop 100,0008 disallowed2026-10-13
whatech.comTop 100,00020 disallowed2026-10-13
finimize.comTop 100,00012 disallowed2026-10-13
lovevda.itTop 100,00015 disallowed2026-10-13
tela-botanica.orgTop 100,00019 disallowed2026-10-13
interment.netTop 100,00011 disallowed2026-10-13
adslgr.comTop 100,00014 disallowed2026-10-13
skiresort.infoTop 100,0007 disallowed2026-10-13
gearslutz.comTop 100,00011 disallowed2026-10-13
iagua.esTop 100,00011 disallowed2026-10-13
wigle.netTop 100,00020 disallowed2026-10-13
trellis.lawTop 100,0005 disallowed2026-10-13
bemergroup.comTop 100,00020 disallowed2026-10-13
hmetro.com.myTop 100,00015 disallowed2026-10-13
davisenterprise.comTop 100,00014 disallowed2026-10-13
tctmd.comTop 100,0002 disallowed2026-10-13
bookbeat.comTop 100,00010 disallowed2026-10-13
medischcontact.nlTop 100,0007 disallowed2026-10-13
sane.org.ukTop 100,0009 disallowed2026-10-13
bordermail.com.auTop 100,00014 disallowed2026-10-13
evergreen-marine.comTop 100,00020 disallowed2026-10-13
blazersedge.comTop 100,00017 disallowed2026-10-13
tripadvisor.dkTop 100,0009 disallowed2026-10-13
dorsetecho.co.ukTop 100,00018 disallowed2026-10-13
westchestermagazine.comTop 100,00015 disallowed2026-10-13
melissa.comTop 100,00011 disallowed2026-10-13
komiinform.ruTop 100,0001 disallowed2026-10-13
tmdb.orgTop 100,00020 disallowed2026-10-13
litteratureaudio.comTop 100,00021 disallowed2026-10-13
lettera43.itTop 100,0009 disallowed2026-10-13
crimeworld.comTop 100,00018 disallowed2026-10-13
glassdoor.deTop 100,00010 disallowed2026-10-13
gtreview.comTop 100,0009 disallowed2026-10-13
blogspot.esTop 100,00020 disallowed2026-10-13
wtov9.comTop 100,0007 disallowed2026-10-13
dailymontanan.comTop 100,00012 disallowed2026-10-13
magiran.comTop 100,00020 disallowed2026-10-13
steamboatpilot.comTop 100,00020 disallowed2026-10-13
startupdaily.netTop 100,00012 disallowed2026-10-13
canodrom.barcelonaTop 100,00014 disallowed2026-10-13
gebilaoli.comTop 100,0002 disallowed2026-10-13
acmepackingcompany.comTop 100,00017 disallowed2026-10-13
blockfi.comTop 100,00010 disallowed2026-10-13
quackwatch.comTop 100,00021 disallowed2026-10-13
chargedevs.comTop 100,00013 disallowed2026-10-13
gofan.coTop 100,00020 disallowed2026-10-13
easywebcamsex.comTop 100,0001 disallowed2026-10-13
unpo.orgTop 100,0008 disallowed2026-10-13
gmtoday.comTop 100,00014 disallowed2026-10-13
gq.com.mxTop 100,00016 disallowed2026-10-13
quicket.co.zaTop 100,00022 disallowed2026-10-13
elgg.orgTop 100,0003 disallowed2026-10-13
franchisetimes.comTop 100,00014 disallowed2026-10-13
fxleaders.comTop 100,00021 disallowed2026-10-13
serienjunkies.deTop 100,00014 disallowed2026-10-13
wctrib.comTop 100,00020 disallowed2026-10-13
nutritionvalue.orgTop 100,00011 disallowed2026-10-13
hectorsanchezfotografia.comTop 100,0004 disallowed2026-10-13
fgdc.govTop 100,00020 disallowed2026-10-13
buffalorumblings.comTop 100,00017 disallowed2026-10-13
chronicleonline.comTop 100,00014 disallowed2026-10-13
bardeen.aiTop 100,0008 disallowed2026-10-13
qbet-casino.ioTop 100,00020 disallowed2026-10-13
voetbalzone.nlTop 100,00013 disallowed2026-10-13
techdirectory.ioTop 100,00021 disallowed2026-10-13
filmz.ruTop 100,0003 disallowed2026-10-13
tacomaworld.comTop 100,0008 disallowed2026-10-13
secularhumanism.orgTop 100,00021 disallowed2026-10-13
cqhot.cnTop 100,00021 disallowed2026-10-13
kalb.comTop 100,0009 disallowed2026-10-13
joemonster.orgTop 100,0001 disallowed2026-10-13
worldpokertour.comTop 100,00011 disallowed2026-10-13
sudbury.comTop 100,0006 disallowed2026-10-13
healthyseminars.comTop 100,0001 disallowed2026-10-13
notre-planete.infoTop 100,00014 disallowed2026-10-13
thesudburystar.comTop 100,00011 disallowed2026-10-13
priuschat.comTop 100,00011 disallowed2026-10-13
4plebs.orgTop 100,00013 disallowed2026-10-13
ocbj.comTop 100,0005 disallowed2026-10-13
liverpool.comTop 100,0007 disallowed2026-10-13
ingame.deTop 100,00014 disallowed2026-10-13
aphorismen.deTop 100,00011 disallowed2026-10-13
kezi.comTop 100,00014 disallowed2026-10-13
watfordobserver.co.ukTop 100,00018 disallowed2026-10-13
qucosa.deTop 100,0007 disallowed2026-10-13
steadyhealth.comTop 100,0009 disallowed2026-10-13
earthmom.orgTop 100,00021 disallowed2026-10-13
backchannel.comTop 100,00016 disallowed2026-10-13
glassdoor.com.brTop 100,00010 disallowed2026-10-13
armchairjournal.comTop 100,00015 disallowed2026-10-13
nwemail.co.ukTop 100,00018 disallowed2026-10-13
enidnews.comTop 100,00014 disallowed2026-10-13
netdoktor.atTop 100,0007 disallowed2026-10-13
beefmagazine.comTop 100,00011 disallowed2026-10-13
clinicalmicrobiologyandinfection.comTop 100,00013 disallowed2026-10-13
manga-no.comTop 100,00010 disallowed2026-10-13
llcuniversity.comTop 100,0006 disallowed2026-10-13
researchcatalogue.netTop 100,00013 disallowed2026-10-13
esportsmag.itTop 100,00018 disallowed2026-10-13
nezavisne.comTop 100,0008 disallowed2026-10-13
kulr8.comTop 100,00013 disallowed2026-10-13
morningagclips.comTop 100,00016 disallowed2026-10-13
stanleybets.netTop 100,00020 disallowed2026-10-13
rpp.com.peTop 100,0009 disallowed2026-10-13
catholicvote.orgTop 100,00011 disallowed2026-10-13
vinted.co.ukTop 100,0005 disallowed2026-10-13
dicebreaker.comTop 100,00019 disallowed2026-10-13
threadsmagazine.comTop 100,0008 disallowed2026-10-13
ciao.deTop 100,00021 disallowed2026-10-13
multicare.orgTop 100,00011 disallowed2026-10-13
shivtr.comTop 100,00020 disallowed2026-10-13
neuepresse.deTop 100,0007 disallowed2026-10-13
elperiodic.comTop 100,0008 disallowed2026-10-13
toolshero.comTop 100,0003 disallowed2026-10-13
blogpost.comTop 100,00020 disallowed2026-10-13
373news.comTop 100,00019 disallowed2026-10-13
airbnb.mxTop 100,0003 disallowed2026-10-13
radiodrei.deTop 100,0009 disallowed2026-10-13
punknews.orgTop 100,00020 disallowed2026-10-13
blackpearlbitcoin.comTop 100,0006 disallowed2026-10-13
univ-avignon.frTop 100,00020 disallowed2026-10-13
celiac.comTop 100,0008 disallowed2026-10-13
wordsmyth.netTop 100,0008 disallowed2026-10-13
investmentexecutive.comTop 100,0009 disallowed2026-10-13
geniuskitchen.comTop 100,0005 disallowed2026-10-13
dreamsongs.comTop 100,0007 disallowed2026-10-13
wflx.comTop 100,0009 disallowed2026-10-13
iwmi.orgTop 100,0004 disallowed2026-10-13
aftvnews.comTop 100,00017 disallowed2026-10-13
cutoutandkeep.netTop 100,0008 disallowed2026-10-13
hamhigh.co.ukTop 100,00018 disallowed2026-10-13
feedster.comTop 100,00011 disallowed2026-10-13
eventhubs.comTop 100,00015 disallowed2026-10-13
brothers-brick.comTop 100,00011 disallowed2026-10-13
jotform.coTop 100,00022 disallowed2026-10-13
kpvi.comTop 100,00014 disallowed2026-10-13
internshala.comTop 100,00014 disallowed2026-10-13
leonoticias.comTop 100,00016 disallowed2026-10-13
themandarin.com.auTop 100,00012 disallowed2026-10-13
lek.comTop 100,00010 disallowed2026-10-13
kdrv.comTop 100,00014 disallowed2026-10-13
kimt.comTop 100,00014 disallowed2026-10-13
db.lvTop 100,0004 disallowed2026-10-13
corwin.comTop 100,0009 disallowed2026-10-13
jamda.comTop 100,00013 disallowed2026-10-13
thenassauguardian.comTop 100,00014 disallowed2026-10-13
dpg-physik.deTop 100,00015 disallowed2026-10-13
ethiovisit.comTop 100,00011 disallowed2026-10-13
cbs4indy.comTop 100,00013 disallowed2026-10-13
nojitter.comTop 100,00011 disallowed2026-10-13
postguam.comTop 100,00014 disallowed2026-10-13
freetour.comTop 100,00011 disallowed2026-10-13
fichier-pdf.frTop 100,0006 disallowed2026-10-13
offenbach.deTop 100,0001 disallowed2026-10-13
fuw.chTop 100,00010 disallowed2026-10-13
pubpeer.comTop 100,0003 disallowed2026-10-13
d.designTop 100,00020 disallowed2026-10-13
gayot.comTop 100,00010 disallowed2026-10-13
schedulicity.comTop 100,00011 disallowed2026-10-13
lufkindailynews.comTop 100,00014 disallowed2026-10-13
winchesterstar.comTop 100,00014 disallowed2026-10-13
rtlz.nlTop 100,00020 disallowed2026-10-13
slotsuk.casinoTop 100,00020 disallowed2026-10-13
rtcg.meTop 100,0008 disallowed2026-10-13
readings.com.auTop 100,0002 disallowed2026-10-13
yourlocalguardian.co.ukTop 100,00018 disallowed2026-10-13
1911encyclopedia.orgTop 100,00021 disallowed2026-10-13
townsvillebulletin.com.auTop 100,00020 disallowed2026-10-13
tripadvisor.clTop 100,0009 disallowed2026-10-13
tide.coTop 100,0007 disallowed2026-10-13
newburyportnews.comTop 100,00014 disallowed2026-10-13
candlepowerforums.comTop 100,00012 disallowed2026-10-13
gg.dealsTop 100,00012 disallowed2026-10-13
thecalifornian.comTop 100,00020 disallowed2026-10-13
hometogo.comTop 100,0001 disallowed2026-10-13
wikidiff.comTop 100,0008 disallowed2026-10-13
uusisuomi.fiTop 100,00020 disallowed2026-10-13
1stconcretecontractor.comTop 100,00011 disallowed2026-10-13
nationalmortgagenews.comTop 100,00012 disallowed2026-10-13
typology.comTop 100,0007 disallowed2026-10-13
ba.noTop 100,00019 disallowed2026-10-13
hireahelper.comTop 100,00011 disallowed2026-10-13
mrexcel.comTop 100,00014 disallowed2026-10-13
bigcountryhomepage.comTop 100,00013 disallowed2026-10-13
gazette-news.co.ukTop 100,00018 disallowed2026-10-13
standard.net.auTop 100,00014 disallowed2026-10-13
purdueexponent.orgTop 100,00014 disallowed2026-10-13
hortidaily.comTop 100,0008 disallowed2026-10-13
ktxs.comTop 100,0007 disallowed2026-10-13
milled.comTop 100,0008 disallowed2026-10-13
lest-eclair.frTop 100,00018 disallowed2026-10-13
turfshowtimes.comTop 100,00017 disallowed2026-10-13
thephinsider.comTop 100,00017 disallowed2026-10-13
gamblii.orgTop 100,00020 disallowed2026-10-13
nnn.co.jpTop 100,00019 disallowed2026-10-13
autoscout24.nlTop 100,0005 disallowed2026-10-13
religionfacts.comTop 100,00011 disallowed2026-10-13
quiztimes.nlTop 100,0004 disallowed2026-10-13
zeslotscasino.orgTop 100,00020 disallowed2026-10-13
msn.caTop 100,00020 disallowed2026-10-13
nn.deTop 100,00011 disallowed2026-10-13
falk.deTop 100,0004 disallowed2026-10-13
talouselama.fiTop 100,00020 disallowed2026-10-13
oxfordamerican.orgTop 100,0008 disallowed2026-10-13
kidney-international.orgTop 100,00013 disallowed2026-10-13
ecranlarge.comTop 100,00018 disallowed2026-10-13
list-org.comTop 100,0009 disallowed2026-10-13
antenna.grTop 100,0007 disallowed2026-10-13
takeshobo.co.jpTop 100,0008 disallowed2026-10-13
wvnstv.comTop 100,00013 disallowed2026-10-13
amvnews.ruTop 100,00020 disallowed2026-10-13
22betscasino.netTop 100,00020 disallowed2026-10-13
koreatimes.comTop 100,0008 disallowed2026-10-13
shieldsgazette.comTop 100,0008 disallowed2026-10-13
covenantuniversity.edu.ngTop 100,00011 disallowed2026-10-13
govdata.deTop 100,00020 disallowed2026-10-13
redlandsdailyfacts.comTop 100,00018 disallowed2026-10-13
oiseaux.netTop 100,0007 disallowed2026-10-13
absolutearts.comTop 100,0003 disallowed2026-10-13
senat.czTop 100,00020 disallowed2026-10-13
thedailystar.comTop 100,00014 disallowed2026-10-13
cw33.comTop 100,00013 disallowed2026-10-13
upmedia.mgTop 100,00022 disallowed2026-10-13
lusa.ptTop 100,00021 disallowed2026-10-13
getopstarturl.onlineTop 100,00020 disallowed2026-10-13
insidehalton.comTop 100,00020 disallowed2026-10-13
giglon.comTop 100,0001 disallowed2026-10-13
fussballdaten.deTop 100,0006 disallowed2026-10-13
pomorska.plTop 100,0008 disallowed2026-10-13
golos.com.uaTop 100,0005 disallowed2026-10-13
thomasmore.beTop 100,0001 disallowed2026-10-13
viamichelin.co.ukTop 100,0002 disallowed2026-10-13
agrinews.co.jpTop 100,00011 disallowed2026-10-13
dksh.comTop 100,0003 disallowed2026-10-13
overthemonster.comTop 100,00017 disallowed2026-10-13
dbushell.comTop 100,00020 disallowed2026-10-13
bclaws.caTop 100,00020 disallowed2026-10-13
jetsetter.comTop 100,00022 disallowed2026-10-13
greylock.comTop 100,0008 disallowed2026-10-13
electrive.netTop 100,0008 disallowed2026-10-13
xs8.cnTop 100,0003 disallowed2026-10-13
csdb.dkTop 100,00014 disallowed2026-10-13
iafor.orgTop 100,0007 disallowed2026-10-13
letmejerk.comTop 100,00012 disallowed2026-10-13
fireplacesandstove.comTop 100,00010 disallowed2026-10-13
firstonline.infoTop 100,00011 disallowed2026-10-13
wfxrtv.comTop 100,00013 disallowed2026-10-13
new.frTop 100,00020 disallowed2026-10-13

The list shows the sites that have a page here, most popular first. This reports what the file asks. It does not show whether a crawler can actually reach the site: many sites also block crawlers at their CDN or firewall, and some crawlers ignore robots.txt.

page 1 page 2 page 3 page 4 page 5