Conversation

Notices

1. pistolero (p@fsebugoutzone.org)'s status on Wednesday, 27-Nov-2024 11:46:19 JST pistolero

   in reply to

   • Matt Hamilton
   @eriner
   
   > I have no problem with people scraping stuff for archival or whatever,
   
   If they do it without flooding my machine, I don't notice and thus don't complain. This is 7 attempts per second, with 100% of them returning 429. Unless they're paying my overages, fuck them. The easy way to get the data is to just follow the goddamn relay endpoint and get the posts delivered to your own instance instead of making it everyone else's problem.
   
   > that they're using it as part of some undergrad's "Misinformation and hate speech on the Fediverse" thing
   
   This is an NSF cluster; odds are good that it's related to the NSF's "combating misinformation" deal. The last time that publicly bumped into fedi, it wasn't an undergrad, it was a psychology professor at MIT Sloane.
   • † top dog :pedomustdie: likes this.
   • Matt Hamilton (eriner@noauthority.social)'s status on Wednesday, 27-Nov-2024 11:46:20 JST Matt Hamilton

     @p thanks for the notice. I blocked the /24 because I'm lazy. I'm also too lazy to inspect what little logs I keep to know if they've been scraping NAS, but I've done my part to throw a wrench. Hopefully it hits one of them.

     I have no problem with people scraping stuff for archival or whatever, but when it comes from a University like this, the odds that they're using it as part of some undergrad's "Misinformation and hate speech on the Fediverse" thing is pretty high, so fuck 'em.