Conversation

Notices

1. Hrefna (DHC) (hrefna@hachyderm.io)'s status on Monday, 18-Sep-2023 16:49:59 JST Hrefna (DHC)

   Spent some time on my #ActivityPub project today getting #PSQL set up. There's a lot of random setup that goes into PSQL and it isn't especially well documented (or rather, it is so well documented there is simply too much of it).

   Whether I stick with it is a separate question. Comparing it to the other options and including the learning curve it is head and shoulders the best pick for me for right now, however, at least for a production-level database.

   Still looking at #sqlite3 for testing

   • Emelia 👸🏻 (thisismissem@hachyderm.io)'s status on Monday, 18-Sep-2023 16:49:55 JST Emelia 👸🏻

     in reply to

     • Eugen Rochko
     • Renaud Chaput

     @hrefna so far I don't think anyone's doing sharding or partitooning.. maybe mastodon.social at a stretch.

     Really a question for @Gargron or @renchap

   • Hrefna (DHC) (hrefna@hachyderm.io)'s status on Monday, 18-Sep-2023 16:49:56 JST Hrefna (DHC)

     in reply to

     Speaking of #PSQL, #mastodon, and #ActivityPub, however… 

     It seems like doing table partitioning would be an obvious choice for mastodon, but I don't see it anywhere in their setup. Does anyone know if someone has done the legwork to make this work and what their results were?

   • Hrefna (DHC) (hrefna@hachyderm.io)'s status on Monday, 18-Sep-2023 16:49:57 JST Hrefna (DHC)

     in reply to

     Others in the space:

     * MariaDB — I am familiar with the basics but only at a high level. Reasonable driver support. Some very nice features for the use case, however, something to look into later.

     * Firebase and other hosted solutions — would work well enough, but would be expensive to run at scale and most options here tie you to a specific cloud provider.

     * CockroachDB — Mostly seems like overkill and adds complexity.

     * Mongo — I've been around too long, the name is still a curse.

   • Hrefna (DHC) (hrefna@hachyderm.io)'s status on Monday, 18-Sep-2023 16:49:58 JST Hrefna (DHC)

     in reply to

     There are some other good options I may investigate later, but PSQL:

     1. Is Fast.
     2. Is Free.
     3. Is well supported.
     4. I am _intimately_ familiar with the ins and outs and how to optimize it.

     I already have a lot of things on this project I am learning fresh, so it makes sense to limit the scope to be a bit more manageable for now and I can revisit it later.

   • Renaud Chaput (renchap@oisaur.com)'s status on Monday, 18-Sep-2023 16:50:27 JST Renaud Chaput

     in reply to

     • Eugen Rochko
     • Emelia 👸🏻

     @thisismissem @hrefna @Gargron no partitioning, but there is support for a read replica. Adding partitioning would be a huge task.