Ugh, people using FrogFind to scrape things AGAIN :(
Conversation
Notices
-
Action Retro :apple_inc: (actionretro@bitbang.social)'s status on Friday, 15-Mar-2024 09:24:00 JST Action Retro :apple_inc: -
Vintage Developer (mconrad@bitbang.social)'s status on Friday, 15-Mar-2024 14:21:26 JST Vintage Developer @ActionRetro That is googlebot scraping you for Gogole's search engine, right? Nothing nefarious I think.
-
Sidde (sidde@bitbang.social)'s status on Friday, 15-Mar-2024 20:25:16 JST Sidde @ActionRetro
Maybe create an external site to register to get a token, or just a function to generate a token that is valid for x hours/days.And upon usage of the site, validate to token if needed. Like the VPN Mullvad. No real IDs, just a string that sets an header.
And only enforce if the site has some form of increased usage. Like a threshold of some sort.
-
Action Retro :apple_inc: (actionretro@bitbang.social)'s status on Friday, 15-Mar-2024 23:13:43 JST Action Retro :apple_inc: @mconrad @ActionRetro seems so - I’ve decided to just serve all google IPs 503 errors now haha
-