I have about 8TB of storage that is currently only replicated through a raid array. I occasionally sync that to another USB drive and leave that in a fireproof safe (same location).
I’d really like to do an offsite backup, but I only have 10Mbps upload. We are literally talking months to do a full backup.
How do others handle situations like this?
You must log in or register to comment.
Backblaze and AWS can send you a NAS device you can put on your lan. You can copy your data into the device, then send them back and have them load those data into your account.
Pre-seed your backup location and then hope that your change rate is small enough to fit into 10 mb. For example, if you’re using AWS you can get a snowball to load data into S3.
Idk what’s offsite to you but if it’s a controlled place for you (like from a friend or family member) you could simply bring your device one day and do the first copy there.
Otherwise maybe rsync a folder at a time.
I don’t do offsite backup, but if your backup system supports it, you could physically take your backup drive to some location with a lot of bandwidth to toss the initial full backup up there.
Yeah, that is what I am thinking. I am using duplicity for backups, so I can probably back up to a hard-drive, take that to work, sync it to my backup provider, then just do incremental backups from then on.
However, I think duplicity really wants to do full backups every X months, so I’m not sure the best way to handle that.
I don’t know whether it’s important to do a full backup for performance, but you’d need to do that if you wanted to remove old backups. It looks like the term for a full backup that reuses already pushed-over data is a “synthetic full” backup, and duplicity can’t do those – when it does a full, it pushes all the data over again.
I have never used it, but Borg Backup does appear to support this, if you wanted an alternate that can do this.
EDIT: However, Borg requires code that runs on the remote end, which may not be acceptable for some; you can’t just aim it at a fileserver. duplicity can do this.
I have also never used it, but duplicati looks to my quick glance to be able to work without code running on the remote end and also to do synthetic full backups.
Another alternative is to setup a backup server at a willing friend/family members house so that you can physically take the drive and just upload any new changes later.
Or, pick up 2 backup drives, keep one at a friend/relative’s house, then just swap them every time you visit.
I keep a drive at my parent’s house in case of emergencies. Backup frequency is essentially every few months, but I also have the local portable drive with real-time sync I can snag on my way out.
I very recently started using borgbackup. I’m extremely impressed with how much it compressed the data before sending, and how well it detects changes and only sends the difference. I have not yet attempted a proper restore from backup, though.
I have much less data I’m currently securing (~50gb) and much more uplink bandwidth (~115mbps) so my situation isn’t nearly as dire. But it was able to compress that down to less than 25gb before sending, and after the initial upload, the next week’s backup only required about 100mb of data transfer.
If you can find a way to seed your data from a faster location, reduce the amount you need to back up, and/or break it up into multiple smaller transfers, this might be an effective solution for you.
Borgbase’s highest plan has an upper limit of 8TB, which you would be brushing right up against, but Hetzner storage boxes go up to 20TB and officially support Borg.
Outside of that, if you don’t expect the data to change often, you might be looking for some sort of cheap S3 storage from AWS or other similar large datacenter company. But you’ll still need to find a way to actually get them the data safely, and I’m not sure if they support differential uploads like Borg does.
Backblaze b2 has a seeding option. Fireball. According to the Internet at least
I used backblaze and they sent me a 10tb external drive so I could ship it back to start the backup.
How do others handle situations like this?
A company I worked for had an external storage drive with the needed capacity stored in a safe deposit locker and every Friday someone drove to the bank, got the drive, drove back to the office, performed the backup and brought the drive back to the bank.
I’m planning on doing this, but every 6mo not 1w lol. My upload speed is abysmal as well and I only have absolutely critical things uploaded to off site storage, then I have a full backup locally and physically disconnect it until next backup (to guard against ransomware); am about to get a 20TB drive for this ‘catastrophic event’ backup plan, stored at the bank, just undecided which drive manufacturer to go with.
I figure if the house explodes or something, max 6mo data loss is acceptable vs almost all data loss. And avoids this bandwidth issue.
I’d love to know how to deal with this. Currently sitting on 12TB used. Decent upload but cloud storage for that much is expensive. I have 5 8TB HDDs, 2 of which act as redundancy in RAID6 config.
One thought I had was convince a friend to setup the same, and dedicate half of each other’s storage as redundancy for the other person.
Usually hosting servers offer some sort of dedicated storage for longterm/backup solutions which is different to cloud storage. It’s also alot cheaper. For example hetzner storage box
Hetzner storage server. like 24 dollars a month for 10tb
