Notices where this attachment appears
-
@Herman_Hetherington @gnarley_boot
> There was a company pulling every post off TWKN feed of FSE for quite a while specifically for the feds.
That was Boardreader.com, which is owned by SocialGist. They were monitoring for threats against "Blackrock Executives".
Very recently some dickhead professor from the Sloane Business School at MIT was scraping a large number of fedi instances. He turns out to have been on fedi ( @Drand ) and he says he's really sorry and swears that it was an accident that he deliberately changed his scraper's user-agent to pretend to be a browser and then hammered the shit out of fedi. Some time later, he turns out to have shown up in the pitch deck for a grant from the NSF, he's on a team that wanted to help social media companies avoid the PR blowback when they get caught censoring "misinformation". ( https://screamshitter.club/rvl/full/835374c1bfa10895663d4d1c94500049823ea928fb7e9c47b01a6b7f8f07c091 ). There's a thread about it: https://nya.social/notes/818c3d1bdb3e20788eb08e25
Tangentially related, NATO SC was scraping nitter.poast.org, but they were only scraping their own account UA belonged to an electronic sign or something, probably they were just trying to get their Twitter posts onto a sign in the lobby without having to go through the Twitter API.
There have been other IP addresses that belong to government buildings sniffing around, a lot of them are just browsing. There are a handful of scrapers that remain mysterious. Probably more are coming, which is retarded because you don't even need to scrape fedi to get all of the posts.