Conversation

Notices

1. jesu (jesu@pl.kotobank.ch)'s status on Friday, 04-Oct-2024 15:36:56 JST jesu
   I thought of this a number of months ago, and I wonder, if server softwares would be somehow able to stop fetching posts for a dead account that lingers (until they log in) it would probably save quite a bit of resources (disk/ram/cpu), and it would also probably help with reducing overall network load... It loads so many posts from people following users, and also related activities from friends of friends.....
   
   Say, 50 people are on an instance, and they all follow 100 people avg., this would mean 5000 users are being followed on that instance. This is acceptable for a 5$ vps, but if it's something like mastodon.social, it's very bad.. The accounts aren't used for many years at times, yet the softwares all waste resources and fetch posts which might never be seen. If mastodon.social has 2 million users, and only 250 thousand are actually active, that results in 85% of users being dead accounts, and the entire idea of fedi is "host it yourself" so why shouldn't we lessen the cost and reduce the resource usage.. It wouldn't only be good for resources, it would also be good for network effects when a buggy post comes into play, crashing servers, or an exploit shows up--it won't be passed around as much..
   
   I also wonder about domain greylisting for keeping spam away... Not that it would get rid of spam completely, but if an instance had a new peer that had never been seen before, it might make sense to put federating with them "on-hold" until it could be verified someway. I am thinking something like verifying that "friends" and maybe "friends of friends," on existing peers could be a verification source.. maybe a manual verification button could be used... Send a "federation request" maybe? Both toggleable, one or the other on, or both off or on...
   
   If someone wanted to make a spam network, or spam instance, it may take a few days or a week or two to get through to someone.. A legitimate new instance might have to fight to federate.. but once they do, they would propagate more normally after 5-20 servers are connected due to network effects of friends of friends...
   
   Not too sure about the greylist, maybe it could simply check the life of the instance *from* related servers or so... don't know.... I hope spam doesn't become a problem here... I'm thinking of ways to increase the difficulty of spam cannons federating widely... Increase the difficulty of servers being bad and they might waste time and money on domains and servers and setup for nothing.
   • jesu (jesu@pl.kotobank.ch)'s status on Friday, 04-Oct-2024 15:36:55 JST jesu

     in reply to

     • pistolero
     cc @p hope this is coherent and I would like your thoughts, if you don't mind...
   • pistolero (p@fsebugoutzone.org)'s status on Friday, 04-Oct-2024 15:37:00 JST pistolero

     in reply to
     @jesu That doesn't create much load unless there is a flood; media takes more bandwidth. The main performance issue is the DB growing without bounds and there's not a good way to figure out which things need to stay and which can go.
     † top dog :pedomustdie: likes this.
   • pistolero (p@fsebugoutzone.org)'s status on Friday, 04-Oct-2024 15:37:01 JST pistolero

     in reply to
     @jesu
     
     > I thought of this a number of months ago, and I wonder, if server softwares would be somehow able to stop fetching posts for a dead account that lingers (until they log in) it would probably save quite a bit of resources (disk/ram/cpu), and it would also probably help with reducing overall network load...
     
     I don't think it's much of a deal unless they have overlap with other ones. Being able to expire/refetch objects would be massive, though. This is part of Revolver's point, pieces can be discarded as long as there are enough copies of them, so some of the nodes keep *everything*.
     
     Anyway, the rest of it, I think probabilistic per-user spam filters are the way to go.
     † top dog :pedomustdie: likes this.
   • jesu (jesu@pl.kotobank.ch)'s status on Friday, 04-Oct-2024 15:37:01 JST jesu

     in reply to

     • pistolero
     @p :) Idk, wondering about stereophonic which has 4 active users and 2k accounts... seems a waste–also the KJV post.. The servers spend 99.95% of resources essentially harvesting data lol
     
     Yeah, it would severely interfere with federation... I wouldn't know much about the ability for these servers to talk to each other to verify spam filters/greylists but it seems useful to build networks of trust since fedi servers and mutuals are usually tightly connected (usually)...
   • pistolero (p@fsebugoutzone.org)'s status on Friday, 04-Oct-2024 16:14:47 JST pistolero

     in reply to
     @jesu Well, until it's fetched you don't really know, right? Maybe a half-life for posts. Anyway, the thing I'm doing, this stuff won't matter, so I wanna burn my braintrons on that instead. If I'm hacking on Pleroma, I'm adding the object refetcher and having it ask Revolver.
     † top dog :pedomustdie: likes this.
   • jesu (jesu@pl.kotobank.ch)'s status on Friday, 04-Oct-2024 16:14:48 JST jesu

     in reply to

     • pistolero
     @p This would seem to help that, as unneeded data wouldn't be fetched..? Helps to purge old posts too