Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This is just a spoofed UA, because Amazon has a publicly available range of their bots and they are not in Singapore.




That makes sense. I wonder why Amazonbot specifically as a target to spoof.

I hoped to get them not stuck using a robots.txt but they refuse to obey it and keep hitting that page with various params. No problem for me, but they are going nowhere.


Perhaps result of A/B testing, because web masters less frequently block them.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: