Conversation

Notices

1. pistolero (p@fsebugoutzone.org)'s status on Wednesday, 27-Nov-2024 11:29:05 JST pistolero

   • pistolero
   Apparently, these are the statuses of the accounts they are scraping:
   
   406425 "completed"
   1533427 "pending"
   53541 "read"
   
   Here's a 7MB gzip'd JSON file that indicates the current status of the *instances*. The account metadata is too big to attach. Anyway, this is their view of fedi:
   instances-p.json.gz
   • :btrfly: anime graf mays 🛰️🪐 (graf@poa.st)'s status on Wednesday, 27-Nov-2024 11:29:03 JST :btrfly: anime graf mays 🛰️🪐

     in reply to

     • Dave Rand
     • Rob Ricci
     @p @ricci @c92a979036ccbbe62736de83ec9258fe2fc5608f5d51b2185bf2611210523e28 @Drand I wonder if he's got us blocked or if I can call him a nigger for acting like a nigger (gibs me dat data in dis case)
   • pistolero (p@fsebugoutzone.org)'s status on Wednesday, 27-Nov-2024 11:29:03 JST pistolero

     in reply to

     • :btrfly: anime graf mays 🛰️🪐
     • Dave Rand
     • Rob Ricci
     @graf @ricci @c92a979036ccbbe62736de83ec9258fe2fc5608f5d51b2185bf2611210523e28 @Drand You can probably call him whatever you want. Scholar.social blocks us, so I can't see @eeide@scholar.social , but I don't know if discuss.systems does.
     
     (It still pisses me off that places that block FSE have the gall to scrape FSE.)
   • pistolero (p@fsebugoutzone.org)'s status on Wednesday, 27-Nov-2024 11:29:04 JST pistolero

     in reply to
     This is their view of fsebugoutzone.org. There's a lot of interesting information in there. They've got, for example, `"processing_status": "completed"`, but they never launched any successful requests as far as I can tell. (I will have to look through the logs again.) They have `"connections": "33435"`, and this appears to be the peer count. They are using instances.social for the `thumbnail_proxy`, maybe that's where they got the list of instances. They have 16,795 on the list, and all of them have `"processing_status": "completed"`, so the queue is probably stored somewhere else.
     
     {
     "_id": {
     "$oid": "673f10ac2aa5fd2484163e28"
     },
     "id": "6628f572b42b8088be06b2fb",
     "name": "fsebugoutzone.org",
     "added_at": "2024-04-24T12:05:06.281Z",
     "updated_at": "2024-11-21T10:02:14.842Z",
     "checked_at": "2024-11-21T10:02:14.842Z",
     "uptime": {
     "$numberInt": "1"
     },
     "up": true,
     "dead": false,
     "version": null,
     "ipv6": false,
     "https_score": {
     "$numberInt": "10"
     },
     "https_rank": "E ",
     "obs_score": {
     "$numberInt": "70"
     },
     "obs_rank": "B ",
     "users": "1733",
     "statuses": "2072037",
     "connections": "33435",
     "open_registrations": false,
     "info": {
     "short_description": null,
     "full_description": "FSE temporary bugout zone until the new code is ready, but mostly a development instance, so it will not run like regular FSE: closed registrations (but if you had an account, your old username/password will work), I will shoot anything that annoys me while I am hacking (and if you are hoping for a warning shot, please do not annoy me until ammo prices drop), etc. Lots of things will be broken periodically because this is a development instance. Direct complaints to your friendly local anarchist @p, or if you are a total dick, just #fediblock us based on rumors/assumptions without trying to reach out, just like you did with FSE! Full explanation here: https://blog.freespeechextremist.com/blog/update-and-roadmap.html",
     "topic": "Free Speech Extremist",
     "languages": [],
     "other_languages_accepted": true,
     "federates_with": "all",
     "prohibited_content": [],
     "categories": []
     },
     "thumbnail": "/instance/thumbnail.jpeg",
     "thumbnail_proxy": "https://camo.instances.social/6079b328d69223bfa89de4e89dbfa2a691fbefdc/2f696e7374616e63652f7468756d626e61696c2e6a706567",
     "active_users": null,
     "email": "fedi@freespeechextremist.com",
     "admin": null,
     "loadtime": {
     "$date": {
     "$numberLong": "1732161080203"
     }
     },
     "processing_status": "completed"
     },
   • pistolero (p@fsebugoutzone.org)'s status on Wednesday, 27-Nov-2024 11:29:04 JST pistolero

     in reply to

     • Dave Rand
     • Rob Ricci
     On the "Cloudlab Team" ( https://cloudlab.us/#team ) from the University of Utah:
     
     @ricci
     @eeide@scholar.social
     Jacobus (Kobus) Van der Merwe (no fedi account, interesting background, https://users.cs.utah.edu/~kobus/ )
     Jason Wiese (link goes to a department page)
     
     From that same page:
     
     > CloudLab is part of the National Science Foundation's NSFCloud program.
     
     You may remember that @drand got caught using address space allocated to him specifically, and later that he was part of the teams presenting to the NSF on how to remove misinformation from the internet and get away with censorship.
     externalizing_the_difficult_responsibility_of_censorship.png
     nyanide :nyancat_rainbow::nyancat_body::nyancat_face: repeated this.
   • :btrfly: anime graf mays 🛰️🪐 (graf@poa.st)'s status on Wednesday, 27-Nov-2024 11:29:51 JST :btrfly: anime graf mays 🛰️🪐

     in reply to

     • silverpill
     • Dave Rand
     • Rob Ricci
     @p @ricci @c92a979036ccbbe62736de83ec9258fe2fc5608f5d51b2185bf2611210523e28 @Drand Our timelines return 401 for all of their requests from that address space so if they got anything to/about poast it wasn't directly from us. There was only two instances in that JSON you posted and both of them are tied to us being in the bio of @silverpill as his backup account
   • pistolero (p@fsebugoutzone.org)'s status on Wednesday, 27-Nov-2024 11:30:03 JST pistolero

     in reply to
     @e3a59924933c9f9f2df83449055eb3858f1480fdd0c5edb95df08bedcd2e6624 The accounts have islocal and ismastodon flags on them. islocal is true for some accounts on androiddev.social, which is interesting.
     † top dog :pedomustdie: likes this.
   • laurel (laurel@fsebugoutzone.org)'s status on Wednesday, 27-Nov-2024 11:30:11 JST laurel

     in reply to
     @p @e3a59924933c9f9f2df83449055eb3858f1480fdd0c5edb95df08bedcd2e6624
     
     How did you get this? Does their shitty software they use for scraping provide some sort of status endpoint?
   • pistolero (p@fsebugoutzone.org)'s status on Wednesday, 27-Nov-2024 11:30:11 JST pistolero

     in reply to

     • laurel
     @laurel Whispers in the wind.
     † top dog :pedomustdie: likes this.
   • pistolero (p@fsebugoutzone.org)'s status on Wednesday, 27-Nov-2024 13:19:32 JST pistolero

     in reply to

     • Rob Ricci
     @ricci Oh, wow, I didn't expect a response; FSE gets blocked a lot so it's a surprise if people see it. (FSE is "working blue".)
     
     The response is appreciated. I'll send an email.
     † top dog :pedomustdie: likes this.
   • Rob Ricci (ricci@discuss.systems)'s status on Wednesday, 27-Nov-2024 13:19:33 JST Rob Ricci

     in reply to

     @p Thanks for the heads up, I will check into what this user is up to.

     Please report this through our formal channels (support at cloudlab dot us) so that we have a record of the complaint.

     nyanide :nyancat_rainbow::nyancat_body::nyancat_face: likes this.