You are reading a single comment by @Velocio and its replies.
Click here to read the full conversation.
-
All bots are blocked, all scrapping is blocked.
It wasn't originally, but there's a thread somewhere and I slammed closed the gates.
Velocio-
I have DM'd you...
-
How are you blocking them? You have any kind of rate limiting?
Coz these guys appear to be ignoring robot restrictions and crawling stuff anyway using IPs they're not publishing
"WIRED was able to confirm that a server at the IP address Knight observed—44.221.181.252—will, on demand, visit and download webpages when a user asks Perplexity about the webpage, regardless of what the site’s robots.txt says."
https://www.wired.com/story/perplexity-is-a-bullshit-machine/
-
Seems to work, on here at least.
I put in my profile url and asked ChatGPT to tell me skydancer views on bicycles.
rhb
hippy
skydancer
. edited out