Conversation

Notices

1. Matty-kun :Christmas_kitty_bell: (matty@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:51 JST Matty-kun :Christmas_kitty_bell:
   benis
   how should I sneed?
   slap my goobis
   chuckin' through the window
   • thefinn (thefinn@poa.st)'s status on Saturday, 09-Nov-2024 08:21:43 JST thefinn

     in reply to

     • Tyler
     • Meanwhile In Ohio...
     @tyler @MeanwhileInOhio @matty Depends how much data we're talking about, otherwise I'd just do what matty is doing now.
     
     If it was prohibitive amounts of data, then yeah
   • Tyler (tyler@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:43 JST Tyler

     in reply to

     • thefinn
     • Meanwhile In Ohio...
     Duh :pepe_nerd:
     
     Plus BTRFS CoW has significant overhead, and hardware sensitive.
     
     I had an older sata controller that HATED BTRFS and I would literally get 10mps write speed.
     † top dog :pedomustdie: likes this.
   • thefinn (thefinn@poa.st)'s status on Saturday, 09-Nov-2024 08:21:44 JST thefinn

     in reply to

     • Tyler
     • Meanwhile In Ohio...
     @matty @MeanwhileInOhio @tyler sometimes simple is better.
     
     Doing incremental backups can make retrieving things a complete pain in the ass.
   • Tyler (tyler@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:44 JST Tyler

     in reply to

     • thefinn
     • Meanwhile In Ohio...
     BTRFS makes it pretty seamless with the snapshot capability, a tool like this: https://github.com/digint/btrbk
     
     I'd try that if I wanted to try BTRFS in a low performance high reliability backup scenario
   • Meanwhile In Ohio... (meanwhileinohio@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:45 JST Meanwhile In Ohio...

     in reply to

     • Tyler
     Ain't nothin' wrong with that. If you have a lot of small files that make up a website or something and you intend to compress them and transfer them elsewhere, that's just a quick way to do it. If you have existing compressed files as part of a backup script that runs on a schedule on the server, rsync is a good way to move them.
   • Matty-kun :Christmas_kitty_bell: (matty@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:45 JST Matty-kun :Christmas_kitty_bell:

     in reply to

     • Tyler
     • Meanwhile In Ohio...
     I'll need to increase my brain cells on the Linux terminal. I'm sure there are much more creative and efficient ways I could set up my backups. Right now it's just a postgre dump, then gzip it, then send it to the offsite server.
   • Meanwhile In Ohio... (meanwhileinohio@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:46 JST Meanwhile In Ohio...

     in reply to

     • Tyler
     That tells tar to accept data from stdin from the pigz pipe.
   • Matty-kun :Christmas_kitty_bell: (matty@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:46 JST Matty-kun :Christmas_kitty_bell:

     in reply to

     • Tyler
     • Meanwhile In Ohio...
     And I thought I was smart using rsync over SSH just to dump the backups
   • Meanwhile In Ohio... (meanwhileinohio@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:47 JST Meanwhile In Ohio...

     in reply to

     • Tyler

     You'll like this...

     Backup in one command:

     ssh server “tar cv -C /folder . | pigz” > file.tar.gz

     Restore in one command:

     cat file.tar.gz | ssh server “pigz -dc | tar xv -C /folder -“

   • Matty-kun :Christmas_kitty_bell: (matty@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:47 JST Matty-kun :Christmas_kitty_bell:

     in reply to

     • Tyler
     • Meanwhile In Ohio...

     why the - at the end?

   • Meanwhile In Ohio... (meanwhileinohio@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:48 JST Meanwhile In Ohio...

     in reply to

     • Tyler
     It can multi-thread the compression, but not the decompression. Something with the way the file is structured.
   • Matty-kun :Christmas_kitty_bell: (matty@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:48 JST Matty-kun :Christmas_kitty_bell:

     in reply to

     • Tyler
     • Meanwhile In Ohio...
     Then I'll look into that for my offsite backups, regardless thank you!
   • Meanwhile In Ohio... (meanwhileinohio@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:49 JST Meanwhile In Ohio...

     in reply to

     • Tyler
     Take a look at pigz, it's multi-threaded gzip. Good for large amounts of data.
   • Matty-kun :Christmas_kitty_bell: (matty@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:49 JST Matty-kun :Christmas_kitty_bell:

     in reply to

     • Tyler
     • Meanwhile In Ohio...
     That might be useful for when I take backups or if I were to do a restoration in the future.
   • Matty-kun :Christmas_kitty_bell: (matty@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:50 JST Matty-kun :Christmas_kitty_bell:

     in reply to

     • Tyler
     I saw that, thank you. Whenever I create tarballs I use -czvf so I guess there's no need to gzip it
   • Tyler (tyler@nicecrew.digital)'s status on Saturday, 09-Nov-2024 08:21:51 JST Tyler

     in reply to
     Anyway Matty I answered your tar question earlier