This site is being used to train AI, should we ban all crawlers, i.e. GoogleBot, Bing, Yandex, etc?

If they pivot to quality.

If they want some niche bicycle conversations.
If they want copious use of the word cunt.

Ftfy.

Hmm, yes, something's not right. Even if I clone the UA of my browser. I'll DM the string I've been using...

Just added it to the allow list.

Is this why I had to VPN to see the site from two separate train company wi-fis today?

Oh... That's it.

Corporate and public networks are running proxies and inspecting your traffic.

That's why the requests are coming from Amazon.

The world is fucked. I'm going to just permanently run Mullvad now

a great resource for a lot of slightly niche bike knowledge and regularly seems to be near the top if you search about how to fix something

If people are going to ask an AI questions instead of using a search engine, our commitment to helping strangers from the future extends to allowing our content to be used to train the AI

Yeah, that's kinda what I meant.

Eeew... you mean you've been using other people's dirty wifi without a VPN?

I am getting this a lot today, is it related?

1 Attachment

Be more human

I will ask Chatgpt how to do that.

It might actually be my Yandex browser on the phone causing it.

are you human though? 🤔

You mentioned Bing at 10x previous crawl rates. Do you know if Google has also upped crawl rates?