Conversation

Notices

1. Marco Rogers (polotek@social.polotek.net)'s status on Thursday, 03-Oct-2024 11:33:45 JST Marco Rogers

   • Fediverse Report
   • Erin Kissane

   @kissane @fediversereport I always thought of this as the fundamental technical problem to solve for distributed social networks. And we're just... not solving it. People are talking about everything else besides this. And it's so weird to me.

   • poswald (poswald@mastodon.social)'s status on Thursday, 03-Oct-2024 11:33:33 JST poswald

     in reply to

     • Fediverse Report
     • Erin Kissane

     @polotek @kissane @fediversereport I remember when twitter first launched and everyone in that community were discovering the work needed to get RoR to scale to a global “firehose” size. Feels like we're back there again but in different ways.

   • Eugen Rochko (gargron@mastodon.social)'s status on Thursday, 03-Oct-2024 11:33:50 JST Eugen Rochko

     in reply to

     • Fediverse Report
     • Erin Kissane
     • poswald

     @polotek @poswald @kissane @fediversereport No, that’s not true. A post is only delivered once per domain. And we use keep-alive connections to shave off request setup time for repeat deliveries. If you have 5k followers from 2 domains, 2 requests will be made. Only if you have one follower per domain does it become 5k requests.

   • Marco Rogers (polotek@social.polotek.net)'s status on Thursday, 03-Oct-2024 11:34:00 JST Marco Rogers

     in reply to

     • Fediverse Report
     • Erin Kissane
     • poswald

     @poswald @kissane @fediversereport As far as I understand, mastodon's implementation is particularly naive today. If you have 5000 followers, every post creates 5000 jobs. There are many optimizations they can make today that will help. But I believe the problem of scaling of decentralized message delivery is going to be a huge bugbear if the fediverse keeps growing.

   • Marco Rogers (polotek@social.polotek.net)'s status on Thursday, 03-Oct-2024 11:34:12 JST Marco Rogers

     in reply to

     • Fediverse Report
     • Erin Kissane
     • poswald

     @poswald @kissane @fediversereport I should be more clear about which issue I'm referring to. There are many technical issues to solve. I'm talking specifically about an issue that is specific to the decentralized nature of the fediverse. There are many optimizations that a company like twitter can do to scale fanouts, because they control both the source and the destination. Fediverse servers do not have that advantage. And more so, many servers are likely to be under resourced.

   • Eugen Rochko (gargron@mastodon.social)'s status on Thursday, 03-Oct-2024 17:43:31 JST Eugen Rochko

     in reply to

     • Fediverse Report
     • Erin Kissane
     • poswald

     @polotek @poswald @kissane @fediversereport It’s really easy to make mistakes in computing that make a massive difference in performance. For example a database query that runs inside a loop vs outside. And it’s easy to miss when your code runs once but becomes really obvious once it has to run multiple times per second. I would not make any assumptions about the protocol itself based on Ghost’s work in progress implementation.

   • Marco Rogers (polotek@social.polotek.net)'s status on Thursday, 03-Oct-2024 17:43:41 JST Marco Rogers

     in reply to

     • Eugen Rochko
     • Fediverse Report
     • Erin Kissane
     • poswald

     @Gargron @poswald @kissane @fediversereport feel free to explain the actual reason this is such a persistent problem. I don't mind being corrected. But please don’t let that be the only reason you pop in.