Aral Balkan
“We rebuilt the Mastodon backend from scratch and made it able to handle Twitter-scale (500M users, 20M writes/second, unbalanced social graph, etc.)”
Congratulations, you reinvented Big Tech.
Did you stop to consider that fediverse (emphasis “diverse”) servers should not be trying to reach “Twitter scale?” That they should be kept small on purpose? That the goal isn’t to recreate Twitter but with some other asshole in charge?
(Of course, it’s a VC-backed startup.)
Aral Balkan
@koen_hufkens It is but they state they rebuilt it from scratch. If so, it doesn’t apply. There isn’t much you can hit them with. These things were always going to happen given that ActivityPub has the same inherent economies of scale that the Big Web has. The only chance the fediverse had of resisting enclosure with its current architecture was social pressure but we’ve all but thrown that away with some of the most prominent folks rolling out the red carpet for Silicon Valley.
Koen Hufkens, PhD
@aral Next question would be: is Mastodon's backend (A)GPLv3. Might be mighty fine to slap VC bros with some licensing.
Aral Balkan
@Paul100 @koen_hufkens Indeed. Thank fuck for Facebook/Meta, Twitter, heck ExxonMobil and let’s not forget the Saudi Royal family… where would be without the billionaires and trillion-dollar corporations?
Paul100
@koen_hufkens@mastodon.social @aral@mastodon.ar.al
If someone wants to become big, why clip his wings?
Opportunities are good.
Aral Balkan
@kdekooter Doesn’t sound good to me in any way.
Kees de Kooter 🍋
@aral if it sounds too good to be true...
Aral Balkan
@snaggen Yeah, that’s exactly what I’m complaining about. Clearly nothing gets by you, Mattias. Good chap! Let’s just add them to long list of VC-funded philanthropically enterprises, shall we?
Mattias Eriksson 🦀🚵♂️
@aral
So, you are complaining that they are not consuming enough electricity and resources per user?
Just think it is a weird thing to rant about, that they claim to be performant. They also seems to intend to go opensource by Aug 29, and if so it sounds like a good thing to have someone using VC money to improve the mastodon ecosystem.
nicolas ⁂
@aral Their terms of service if someone was considering trying out their instance…
Aral Balkan
@nclm Nothing that a VC-funded corporation does is meant to make life easier for the little guy. Factory farms aren’t spas for the livestock.
nicolas ⁂
@aral And yes, they are completely missing the point.
One question is if a server that capable means that it’s lighter and cheaper to run for small instances? In that case it could still be somewhat interesting…
All in all it seems that this is just a tech demo for their “Rama” product, whatever that is.
Aral Balkan
@nil This is not that.
Anil
@aral I think there's a balance. If mastodon could run more cheaply then e.g. community servers would be easier to maintain.
Aral Balkan
@Loeil_du_tigre With all due respect, I’m not your personal idiot whisperer.
L'oeil du tigre :flag_QC: :verified:
@aral what the actual fuck are you on about?? They literally made a much more efficient fediverse server than what we have now and youre out there complaining that their vc money is being used to make cool open source projects. Would you rather they used that money to make a privacy invading, user hostile software that is full of DRM and has a subscription tied to it?
L'oeil du tigre :flag_QC: :verified:
@aral if a company contributes to the Linux kernel, is that bad because they are a corporation and they make profits? You're not making any sense by basically just saying VC bad without any depth to your accusations
Timo Tiuraniemi
There's a difference between resource efficiency wrt scaling up vs a constant (small) scale.
What the fediverse could use (as you highlighted) is a resource-efficient server for small-to-medium scale, think max a few hundred users. While the official Rails app has problem, what Red Planet Labs has built is a JVM server that runs Clojure. That by design comes with a large memory footprint, which is not resource efficient if you don't have enough use for it.
Hrefna (DHC)
I'd also like to underscore the point there about the _cost_.
Right now mastodon is prohibitively expensive to run in terms of both time and resources. I'd see efforts to reduce this to be a net positive to the fediverse in most situations?
The lessons at large scale don't always apply at small scale and vice versa, but the point remains that right now mastodon is a bit of a trash fire in that regard and it doesn't have to be.
maegul
Their comments here (https://blog.redplanetlabs.com/2023/08/15/how-we-reduced-the-cost-of-building-twitter-at-twitter-scale-by-100x/#Our_Mastodon_instance) don't seem to me unreasonable.
They echo your point and respond that it's a community decision and shouldn't be a tech limitation (I agree, especially as they're gonna open it). Plus it mostly seems to demonstrate their Rama thing.
Dunno, bringing more tech to the ecosystem is probably a net good. Big and small places can both exist, and big ones, I'd wager, probably have value, so we should make them ourselves no?
Hrefna (DHC)
I've run plenty of JVM systems with nice memory footprints per user, especially on modern JVMs. Sure, it isn't the most memory efficient compared to C++, but that is also the least of my concerns when you compare it against:
1. A queue with rails worker processes.
2. A database.
3. An _ephemeral_ database (Redis)
3a. Times 2.
4. A rails API.
etc.
A JVM worker "not being memory efficient" is like Z on the cost list and trivial to lower costs on at small scale.
Aral Balkan
\@dschwarz Thanks man, lotsa luck to you too doing whatever it is you do.
Daniel Schwarz :toad:
@aral I’ve seen Fediverse gatekeeping but… attempting to gatekeep users of an open protocol? Lotsa luck with that.
Andrei Kucharavy
@aral tbh @mitsuhiko had a really good point that Mastodon back-end needs to be rewritten for efficiency so that 10-15$ in compute can run a 1000-10 000 person instance, making it much more easy to spin new instances for communities that want to but do not have the resources for now.
Aral Balkan
@andrei_chiffa @mitsuhiko That’s a very different kind of optimisation. And no VC-funded startup is going to be interested in solving that problem.
KielKontrovers
@aral do you think killing all mastodon servers would be better than servers that can withstand the threat. I think this is rather stupid. it's a good thing to have other servers and protocols especially if they are more robust.
Aral Balkan
@kielkontrovers Nice red herring you have there but I’m afraid I’m not hungry at the moment. Goodbye.
０７６萌ＳＮＳ is a social network, courtesy of ０７６. It runs on GNU social, version 2.0.2-beta0, available under the GNU Affero General Public License.
All ０７６萌ＳＮＳ content and data are available under the Creative Commons Attribution 3.0 license.