What do people use for a shelf-stable backup
-
Btrfs and zfs are self-healing.
You can make a script to check for errors and autocorrection yourself but that needs at least a second hdd. On both drives are the same data and a file or database with the checksums of the data. The script then compares the actual checksums of the two copies and the db checksum. If they match -> perfect. If they don't match the file where there are two matching checksum is the good one and replaces the faulty one or corrects the db entry, whichever is defect. That's it. It doesn't have to be more complicated.
-
-
Yip I think this is the setup I will want (probably both - zfs + a custom script for validation, just to be sure). Two mirrored drives. I do need to read up some about zfs mirroring to understand it a bit more but I think I have a path to follow now.
-
-
-
The printed photos are only there as an extra layer of redundancy in case everything else fails. It's ok if they get discoloured a bit, it never put me off going through my grandparents' suitcases of photos. Ideally the digital files survive, if not then at least there is something rather than nothing.
Is SSD really necessary? Everything I search up says SSDs have worse retention than HDD in cold storage. A couple TB of HDD is pretty cheap these days, and seems like a better cold storage option.
You can’t exactly make it fool-proof. Outside people will never know what you did to create your backup and what to do to access it. Who knows if the drives file system or file types are still readable after 20 years? Who knows if SATA and USB connectors are still around after that time?
Yes, so now I'm thinking a rotation cycle. About every 5 years replace the drives with new ones, copy over all data. If newer technology exists then I can move to that newer technology. This way I'm keeping it up to date as long as I can.
For example it is very likely that SATA will disappear within the next 10-15 years as hdds are becoming more and more an enterprise thing and consumers are switching to M.2 ssds.
Does this matter if I have a SATA->USB cable stored with it? Other than if USB A standards change or get abandoned for USB C, but that should be covered by the review every 5 years.
-
-
-
I've decided I should have a small number of physical prints, as extra redundancy. I'm thinking I'll print 100 each year to store with the hard drive backup.
-
I decided instead to use ZFS. Better protection than just letting something sit there. Your backups are only as good as your restores. So, if you are not testing your restores, those backups may be useless anyway.
ZFS with snapshots, replicated to another ZFS box. The replicated data also stores the snapshots and they are read-only. I have snapshots running every hour.
I have full confidence that my data is safe and recoverable.
-
-
-
Reminds me of project Silica. Media historically was more durable (stone/ ink and cloth paper, etc) but had a low data density. As density increased, so did fragility
-
If you need something which can withstand some bitrot on single drive, just use par2. As long is filesystem is readable, you can recover files even if bit of data get corrupted
-
-
-
-
That sounds like a really good idea. You basically get the best of everything.
The cool thing about ZFS is the pool information is stored on the disks themselves. You can just plug them in and import the pools.
-
Basically, I specifically want cold storage, and not cloud. I will only add, not delete from it. And I don't want it encrypted.
I have a client with a photographic studio. To give you an estimate, his data is around 14TB of mostly camera pictures with approximately 20 years or history and the owner believe it or not, relies on multiple external hard drives for cold storage, he has a 2TB Seagate thats like 2011-2012 old which still works.
To put in a cupboard tho, M disc is your best bet.
-
