Also... since blocking those AS numbers barely an hour ago... all systems are reporting better performance.
Bing alone was sending 47K requests per day(!) as they've massively increased their crawl recently — my speculation here is that it is due to them realising that AI/ML provides a second value on top of the search index, and that if they bet big enough that Microsoft can challenge Google on search and advertising. This Bing crawl rate was double the Google one.
47,000 of anything is a lot, but, for a scale, how many requests in total was the site receiving?
Also, thanks for being on top of this and allowing those with better knowledge of the subject to opine.
Also... since blocking those AS numbers barely an hour ago... all systems are reporting better performance.
Bing alone was sending 47K requests per day(!) as they've massively increased their crawl recently — my speculation here is that it is due to them realising that AI/ML provides a second value on top of the search index, and that if they bet big enough that Microsoft can challenge Google on search and advertising. This Bing crawl rate was double the Google one.