I would err towards block but I do regularly use google and/or duckduckgo to do targeted searches on lfgss.com when I can't find what I want using built-in search.
Would definitely block Yandex regardless of AI.
If it was my site I'd maybe leave duckduckgo alone but it's not my site.
Actually not even sure I've ever seen a duckduckgo crawler in logs. But it's been a while since I've dealt with web server logs or SEO questions.
I would err towards block but I do regularly use google and/or duckduckgo to do targeted searches on lfgss.com when I can't find what I want using built-in search.
Would definitely block Yandex regardless of AI.
If it was my site I'd maybe leave duckduckgo alone but it's not my site.
Actually not even sure I've ever seen a duckduckgo crawler in logs. But it's been a while since I've dealt with web server logs or SEO questions.