• Also... since blocking those AS numbers barely an hour ago... all systems are reporting better performance.

    Bing alone was sending 47K requests per day(!) as they've massively increased their crawl recently — my speculation here is that it is due to them realising that AI/ML provides a second value on top of the search index, and that if they bet big enough that Microsoft can challenge Google on search and advertising. This Bing crawl rate was double the Google one.

  • 47K requests per day(!)

    47,000 of anything is a lot, but, for a scale, how many requests in total was the site receiving?
    Also, thanks for being on top of this and allowing those with better knowledge of the subject to opine.

  • Bing was about 5% of the total requests for pages yesterday, there were 970K page requests.

    Though with a long-tail of bots now being squashed, and Misc & Meaningless now going private, I expect the page view count to go down significantly and to better represent page views by members of the community rather than just a big total including bots and guests.

About

Avatar for mespilus @mespilus started