０７６萌ＳＮＳ
  • Login

  • Public

    • Public
    • Network
    • Groups
    • Popular
    • People

Conversation

Notices

  1. Lunarised (lunarised@fsebugoutzone.org)'s status on Thursday, 04-Jul-2024 19:10:13 JST Lunarised Lunarised
    • pistolero
    Hey, Pleroma nerds.

    I finished a db prune and my db is still 68GB for what i thought was a small instance. I did the vacuum afterwards


    Am i fucked?

    cc @p
    In conversation about 5 months ago from fsebugoutzone.org permalink
    •  (mint@ryona.agency)'s status on Thursday, 04-Jul-2024 19:10:10 JST  
      in reply to
      • pistolero
      @Lunarised @p It's normal, my DB is around 60 gigs as well and that's after deleting most of the unneccesary objects.
      In conversation about 5 months ago permalink
    • pistolero (p@fsebugoutzone.org)'s status on Thursday, 04-Jul-2024 19:22:36 JST pistolero pistolero
      in reply to
      • 
      @mint @Lunarised
      please_wait_patiently.png
      In conversation about 5 months ago permalink

      Attachments


      1. https://fsebugoutzone.org/media/f22fc1b1-cf67-4403-bd50-6595b8a045ca/please_wait_patiently.png?name=please_wait_patiently.png
       likes this.
    • lunarised (lunarised@whinge.town)'s status on Thursday, 04-Jul-2024 19:40:33 JST lunarised lunarised
      in reply to
      • 
      • pistolero
      @mint @Lunarised @p I got it down to 40GB, which gives me more breathing room I guess. Might reindex it all sometime
      In conversation about 5 months ago permalink
       likes this.
    • pistolero (p@fsebugoutzone.org)'s status on Thursday, 04-Jul-2024 20:04:27 JST pistolero pistolero
      in reply to
      • lunarised
      @lunarised @Lunarised Until we moved to our own box, I used to just make regular backups and I'd dump/restore when it got too big, because that took us down for less time than a full vacuum. People allegedly have a good time with pg_repack, but I have used it once and it fucks up if it is interrupted (like if you are running low on disk space and you attempt to run it to free up disk space and then it runs out of disk space), and even fucks up the *dump*.
      In conversation about 5 months ago permalink
      † top dog :pedomustdie: likes this.
    • pistolero (p@fsebugoutzone.org)'s status on Thursday, 04-Jul-2024 20:04:28 JST pistolero pistolero
      in reply to
      @Lunarised

      > I finished a db prune and my db is still 68GB for what i thought was a small instance. I did the vacuum afterwards

      Well, worst-case you can dump and restore. I don't know what is being pruned, since I have never used the DB-pruning tool. You could try manually removing the activities/objects that are older than a certain date (and that are not Follow/Accept/Block), or just delete all of the Like/Announce/EmojiReact/Update/Delete activities.

      You wanna check the table sizes for all of the tables.

      Other than that, what's wrong with the DB being 68GB? That's how big they are.
      In conversation about 5 months ago permalink
    • lunarised (lunarised@whinge.town)'s status on Thursday, 04-Jul-2024 20:04:28 JST lunarised lunarised
      in reply to
      • pistolero
      @p @Lunarised just trying to keep the storage under control. Only have 120GB in the frantech box
      In conversation about 5 months ago permalink
    • pistolero (p@fsebugoutzone.org)'s status on Thursday, 04-Jul-2024 20:08:58 JST pistolero pistolero
      in reply to
      • lunarised
      @lunarised @Lunarised `pg_dump>file.sql` and `psql<file.sql`. You can put your favorite bytestream compressor in the pipeline if you like. (This is recommended.)
      In conversation about 5 months ago permalink
      † top dog :pedomustdie: likes this.
    • lunarised (lunarised@whinge.town)'s status on Thursday, 04-Jul-2024 20:08:59 JST lunarised lunarised
      in reply to
      • pistolero
      @p @Lunarised im gonna need to learn how to dump and restore sometime then!
      In conversation about 5 months ago permalink
    • pistolero (p@fsebugoutzone.org)'s status on Thursday, 04-Jul-2024 20:58:17 JST pistolero pistolero
      in reply to
      • lunarised
      • :blank:
      @i @Lunarised @lunarised

      > as it avoids the https://blog.freespeechextremist.com/blog/activities-visibility-index-slowness.html issue when restoring,

      Ah, I should update that; putting the connection into replica mode actually speeds it *way* the hell up.

      > https://gitlab.com/-/snippets/2228488

      Did Gleason seriously try to use nano on a DB dump? "Editing dumps / I have no idea." The JavaScript guy doesn't think to use awk or sed, huge shock. Someone should tell him (or, since he mercifully has gone away to Nostr, someone should maybe upload some better instructions).

      > with --rsyncable

      I didn't know about this flag, but it appears to be a Debian extension. pbzip2 does fine.

      The bigger issue with this person's approach is that you will have to copy every block every time anyway; pg_dump gives you the dump in disk-order, and in a database where there are large tables with any amount of churn (Pleroma, this database), you will get a different order every time you dump, so rsync will not be able to just move the blocks that have changed.

      (Postgres does row-versioning and deletes rows in place by marking them as deleted. To keep the data consistent during transactions, if there is an update, rows are COW'd. New rows get put into empty slots where they fit, overwriting previous deletions.)
      In conversation about 5 months ago permalink

      Attachments

      1. No result found on File_thumbnail lookup.
        activities_visibility_index Slowness — FSE Blog
      2. Pleroma database dump and restore ($2228488) · Snippets · GitLab
        GitLab.com
      † top dog :pedomustdie: likes this.
    • :blank: (i@declin.eu)'s status on Thursday, 04-Jul-2024 20:58:19 JST :blank: :blank:
      in reply to
      • lunarised
      • pistolero
      @p @Lunarised @lunarised a better guide is, https://gitlab.com/-/snippets/2228488 as it avoids the https://blog.freespeechextremist.com/blog/activities-visibility-index-slowness.html issue when restoring, and http://www.aktau.be/2014/10/23/pg-dump-and-pigz-easy-rsyncable-backups-with-postgresql/ with --rsyncable makes backing it up to another server easier

      mine compresses from 95GB to 11GB
      In conversation about 5 months ago permalink

      Attachments

      1. No result found on File_thumbnail lookup.
        activities_visibility_index Slowness — FSE Blog
      2. No result found on File_thumbnail lookup.
        pg_dump and pigz, easy rsyncable backups with PostgreSQL
        from Nicolas Hillegeer
        Research about the best way to create rsyncable backups with pg_dump
      3. Pleroma database dump and restore ($2228488) · Snippets · GitLab
        GitLab.com
      † top dog :pedomustdie: repeated this.
    • pistolero (p@fsebugoutzone.org)'s status on Thursday, 04-Jul-2024 22:38:51 JST pistolero pistolero
      in reply to
      • lunarised
      @lunarised @Lunarised I'm just talking about pipes. `pg_dump | gzip > file.sql.gz` or `bzip2` or `pbzip2` or `pigz` or `lz4` or whatever. The data going down a pipe is a bytestream, I meant something that is friendly to put in a pipeline.
      In conversation about 5 months ago permalink
    • RedTechEngineer (redtechengineer@fedi.lowpassfilter.link)'s status on Thursday, 04-Jul-2024 22:38:51 JST RedTechEngineer RedTechEngineer
      in reply to
      • lunarised
      • pistolero
      @p @Lunarised @lunarised the @p stands for plumber
      In conversation about 5 months ago permalink
       likes this.
    • lunarised (lunarised@whinge.town)'s status on Thursday, 04-Jul-2024 22:38:52 JST lunarised lunarised
      in reply to
      • pistolero
      @p @Lunarised stop speaking witch. Now I gotta learn bytestteam compression....

      I should have stuck with surveying
      In conversation about 5 months ago permalink
    • :blank: (i@declin.eu)'s status on Thursday, 04-Jul-2024 23:14:07 JST :blank: :blank:
      in reply to
      • 
      • Lina Inver:z:e :mur_close: :nuts:
      • lunarised
      • Pawlicker
      • Cocoa Hoto in real life
      • pistolero
      @PurpCat @lina @Lunarised @p @Cocoa @mint @lunarised for rebased, i don't think there's even been breaking changes to the DB schema, worth trying to just run pleroma off the same DB with no rollbacks
      In conversation about 5 months ago permalink
    • Cocoa Hoto in real life (cocoa@nekosat.work)'s status on Thursday, 04-Jul-2024 23:14:08 JST Cocoa Hoto in real life Cocoa Hoto in real life
      in reply to
      • Lina Inver:z:e :mur_close: :nuts:
      • lunarised
      • :blank:
      • Pawlicker
      • pistolero
      @lina @PurpCat @i @Lunarised @p @lunarised yeah I need to figure out how to migrate to stock Pleroma one of these days
      In conversation about 5 months ago permalink
    • Pawlicker (purpcat@clubcyberia.co)'s status on Thursday, 04-Jul-2024 23:14:08 JST Pawlicker Pawlicker
      in reply to
      • 
      • Lina Inver:z:e :mur_close: :nuts:
      • lunarised
      • :blank:
      • Cocoa Hoto in real life
      • pistolero
      @Cocoa @i @lina @Lunarised @p @lunarised cc @mint
      In conversation about 5 months ago permalink
    • Lina Inver:z:e :mur_close: :nuts: (lina@eientei.org)'s status on Thursday, 04-Jul-2024 23:14:10 JST Lina Inver:z:e :mur_close: :nuts: Lina Inver:z:e :mur_close: :nuts:
      in reply to
      • Lina Inver:z:e :mur_close: :nuts:
      • lunarised
      • :blank:
      • Pawlicker
      • pistolero
      @PurpCat @Lunarised @i @lunarised @p hey doesnt this mean copebox instances will wither away too
      In conversation about 5 months ago permalink
    • Pawlicker (purpcat@clubcyberia.co)'s status on Thursday, 04-Jul-2024 23:14:11 JST Pawlicker Pawlicker
      in reply to
      • lunarised
      • :blank:
      • pistolero
      @p @i @Lunarised @lunarised fun fact Gleason hasn't been updating copebox otp builds and he's pushing people towards his nostr (deader than bsky) fetishism this month now
      In conversation about 5 months ago permalink
    • Lina Inver:z:e :mur_close: :nuts: (lina@eientei.org)'s status on Thursday, 04-Jul-2024 23:14:11 JST Lina Inver:z:e :mur_close: :nuts: Lina Inver:z:e :mur_close: :nuts:
      in reply to
      • lunarised
      • :blank:
      • Pawlicker
      • pistolero
      @PurpCat @i @Lunarised @p @lunarised we officially outlasted the soyboy
      In conversation about 5 months ago permalink
    • Pawlicker (purpcat@clubcyberia.co)'s status on Thursday, 04-Jul-2024 23:16:17 JST Pawlicker Pawlicker
      in reply to
      • Lina Inver:z:e :mur_close: :nuts:
      • lunarised
      • :blank:
      • pistolero
      @lina @i @Lunarised @p @lunarised imagine how funny it'd be if graf came out as a chaser or furry 🤣
      In conversation about 5 months ago permalink
    • Lina Inver:z:e :mur_close: :nuts: (lina@eientei.org)'s status on Thursday, 04-Jul-2024 23:16:18 JST Lina Inver:z:e :mur_close: :nuts: Lina Inver:z:e :mur_close: :nuts:
      in reply to
      • lunarised
      • :blank:
      • Pawlicker
      • pistolero
      @PurpCat @i @Lunarised @p @lunarised lol, anyway yea i think he'll either return eventually or he'll actually stay there and copebox will die and with it will the copebox instances
      WHICH IS GOOD THERE ISN'T A SINGLE GOOD COPEBOX INSTANCE HOW THE FUCK IS THE SOFTWARE TIED TO COMPLETELY CRINGE INSTANCES UNLIKE PLEMORA
      In conversation about 5 months ago permalink
    • Pawlicker (purpcat@clubcyberia.co)'s status on Thursday, 04-Jul-2024 23:16:19 JST Pawlicker Pawlicker
      in reply to
      • Lina Inver:z:e :mur_close: :nuts:
      • lunarised
      • :blank:
      • pistolero
      @lina @i @Lunarised @p @lunarised the only person I know trying to mess with his nostr stack is a Gleason disciple with no original thoughts of his own and oh btw it also is broken as fuck and has fewer people
      In conversation about 5 months ago permalink
    • Lina Inver:z:e :mur_close: :nuts: (lina@eientei.org)'s status on Thursday, 04-Jul-2024 23:16:53 JST Lina Inver:z:e :mur_close: :nuts: Lina Inver:z:e :mur_close: :nuts:
      in reply to
      • lunarised
      • :blank:
      • Pawlicker
      • pistolero
      @PurpCat @i @Lunarised @p @lunarised its only a matter of time
      In conversation about 5 months ago permalink
    •  (mint@ryona.agency)'s status on Thursday, 04-Jul-2024 23:25:14 JST  
      in reply to
      • Lina Inver:z:e :mur_close: :nuts:
      • lunarised
      • :blank:
      • Pawlicker
      • Cocoa Hoto in real life
      • pistolero
      @Cocoa @PurpCat @i @lina @Lunarised @p @lunarised I've sent him a patch here on fedi for the report rejecting MRF to reject reports sent to third-party users (Gargron spam update, https://github.com/mastodon/mastodon/issues/27219), he accepted it but later I figured out I fucked it up and it was rejecting *all* remote report. I've made a bugfix and sent it to him twice, he acknowledged it first time but never bothered to commit it. Couldn't make a proper MR because shitlab's cloudflare check on login page dehumanizes me.
      In conversation about 5 months ago permalink

      Attachments

      1. Potential Misuse of Reporting Feature `forward_to_domains` in Mastodon v4.2.0 · Issue #27219 · mastodon/mastodon
        Steps to reproduce the problem Log in to your Mastodon account. Navigate to a toot that you wish to report. Select "Report @username." In the report interface, select the checkbox to forward the re...
    • Cocoa Hoto in real life (cocoa@nekosat.work)'s status on Thursday, 04-Jul-2024 23:25:15 JST Cocoa Hoto in real life Cocoa Hoto in real life
      in reply to
      • Lina Inver:z:e :mur_close: :nuts:
      • lunarised
      • :blank:
      • Pawlicker
      • pistolero
      @lina @PurpCat @i @Lunarised @p @lunarised back when I first started the instance copebox was the more frequently updated fork so that's what I went with

      unfortunately I failed to learn my lesson the first time with Cocoa Hoto Rocks and Foundkey and now I have no updates again :why2:
      In conversation about 5 months ago permalink
    • Lina Inver:z:e :mur_close: :nuts: (lina@eientei.org)'s status on Thursday, 04-Jul-2024 23:25:16 JST Lina Inver:z:e :mur_close: :nuts: Lina Inver:z:e :mur_close: :nuts:
      in reply to
      • lunarised
      • :blank:
      • Pawlicker
      • Cocoa Hoto in real life
      • pistolero
      @Cocoa @PurpCat @i @Lunarised @p @lunarised oh wait, you run copebox? thank God there's one good copebox instance then
      In conversation about 5 months ago permalink

Feeds

  • Activity Streams
  • RSS 2.0
  • Atom
  • Help
  • About
  • FAQ
  • TOS
  • Privacy
  • Source
  • Version
  • Contact

０７６萌ＳＮＳ is a social network, courtesy of ０７６. It runs on GNU social, version 2.0.2-beta0, available under the GNU Affero General Public License.

Creative Commons Attribution 3.0 All ０７６萌ＳＮＳ content and data are available under the Creative Commons Attribution 3.0 license.