yarn @<lyse https://lyse.isobeef.org/twtxt.txt> "(#jpnguzwxid63) @david@daiwei.me Some entries can be probably simplified with just `*bot*`. :-) (But I don't use Caddy, so no idea about case (i ..."

Missing start of conversation

The start of this conversation is missing — it may have been edited or deleted. The replies are shown below.

lyse.isobeef.org

@david@daiwei.me Some entries can be probably simplified with just *bot*. :-) (But I don’t use Caddy, so no idea about case (in)sensitivity.

That reminds me, I should do something similar with my Nginx.

⤋ Read More

bender

twtxt.net

Tue, Jul 7 7:14PM (1w ago)

@lyse@lyse.isobeef.org simplified it a little bit. Using only *bot* will bring collateral damage I want to avoid (there are, still some “good” bots):

@aibots {
      header_regexp User-Agent (?i)(GPTBot|ChatGPT|OAI-Search|anthropic|Claude|Google-Extended|FacebookBot|CCBot|Perplexity|Applebot-Extended|cohere|Omgili|Bytespider)
}
abort @aibots

⤋ Read More

Participate

Login or Register to join in on this yarn.