Looking for recommendations for a multi home NAS solution
-
Hello all! As the title suggests, I'm looking for some help and recommendations for starting a NAS storage/backup between a few households in my family.
Apologies if this isn't the right place to ask this. This will be my first entry into something something like this, so I'm not entirely sure where to go.
What I would like to do is have an enclosure in each house and have them all sync together. Two drives will be necessary since I'll use one drive just on my own since I have a lot of files to store. The other drive I would like to partition so that each household can be given a set amount of storage.
The rest of my family isn't very tech savvy, so I would prefer a solution that is relatively straight forward to setup and troubleshoot in the rare case I might need them to do something remotely.
I would like to keep the price of the enclosure reasonable since the rest of my family is pitching in on the costs.
Some extra info I copied from one of my comments:
- At this point, will have 2 houses, but likely 3 by next year.
- The first two will be a short drive away, but the third will be hours away.
- The houses are on 100/50Mb fiber. Very stable internet.
- Me being the tech person, I'll access them every way that's available. For the rest of my family I'll likely set them up either with a hardwire or local network.
- We will be using them as part of a 3-2-1 backup for all of our files like photos or documents. I'll be using the second drive for occasional video backup storage.
- The shared drive will probably be 5-10 TB, depending on how much storage each household wants. The second drive for me will be around 20TB.
- We want multiple units so we have multiple copies of all our important files in the event of something like a house burning down.
Another clarification:
We do want to access files from each NAS individually instead of having everyone connect to one master NAS. The storage will be used mainly for archival and backup, so version conflicts of individual files wont be much of a concern.
one nas device with a lot of power and a vpn for the other houses might be better.
-
Hello all! As the title suggests, I'm looking for some help and recommendations for starting a NAS storage/backup between a few households in my family.
Apologies if this isn't the right place to ask this. This will be my first entry into something something like this, so I'm not entirely sure where to go.
What I would like to do is have an enclosure in each house and have them all sync together. Two drives will be necessary since I'll use one drive just on my own since I have a lot of files to store. The other drive I would like to partition so that each household can be given a set amount of storage.
The rest of my family isn't very tech savvy, so I would prefer a solution that is relatively straight forward to setup and troubleshoot in the rare case I might need them to do something remotely.
I would like to keep the price of the enclosure reasonable since the rest of my family is pitching in on the costs.
Some extra info I copied from one of my comments:
- At this point, will have 2 houses, but likely 3 by next year.
- The first two will be a short drive away, but the third will be hours away.
- The houses are on 100/50Mb fiber. Very stable internet.
- Me being the tech person, I'll access them every way that's available. For the rest of my family I'll likely set them up either with a hardwire or local network.
- We will be using them as part of a 3-2-1 backup for all of our files like photos or documents. I'll be using the second drive for occasional video backup storage.
- The shared drive will probably be 5-10 TB, depending on how much storage each household wants. The second drive for me will be around 20TB.
- We want multiple units so we have multiple copies of all our important files in the event of something like a house burning down.
Another clarification:
We do want to access files from each NAS individually instead of having everyone connect to one master NAS. The storage will be used mainly for archival and backup, so version conflicts of individual files wont be much of a concern.
I really wish NAS discussions had their own community.
-
one nas device with a lot of power and a vpn for the other houses might be better.
I have had good luck with self hosted Headscale server and Tailscale clients on Pfsense routers creating a mesh network. But I am trusting other people's networks. So Tailscale clients on each computer and the NAS would be lower risk.
-
I think you already know, AIOs are the go-to, just make sure you can connect in. I've done this with Synology, works fine, I used sftp to sync things. If you want cheaper you can look into a standard linux host and mergerfs/snapraid, but it's going to be a much higher learning curve, and a much higher risk of failure. If you're just getting up and started don't overthink it. It's good to plan for tomorrow, but think about how much data everyone has, and how much you'll use today, and then double that. That'll be a good baseline.
If you're US based, a trick, buy the WD Elements drives from Best Buy. They go on sale regularly pretty much whenever there is a holiday sale and "shuck" them (plenty of videos on Youtube for how to do this). You'll save probably double the cost on drives.
Is Synology still a good option? I remember them getting some flack a bit ago. Something about hard drives I think?
I'll kept a look out for deals like that.
-
We want multiple devices so we can have extra backups of our important files. Power isn't really a major concern since this will be mostly for long term storage.
-
I really wish NAS discussions had their own community.
wrote last edited by [email protected]That would be nice. Sadly, it doesn't seem like there's enough relevant people here on Lemmy to keep it active. At least not yet.
-
Hello all! As the title suggests, I'm looking for some help and recommendations for starting a NAS storage/backup between a few households in my family.
Apologies if this isn't the right place to ask this. This will be my first entry into something something like this, so I'm not entirely sure where to go.
What I would like to do is have an enclosure in each house and have them all sync together. Two drives will be necessary since I'll use one drive just on my own since I have a lot of files to store. The other drive I would like to partition so that each household can be given a set amount of storage.
The rest of my family isn't very tech savvy, so I would prefer a solution that is relatively straight forward to setup and troubleshoot in the rare case I might need them to do something remotely.
I would like to keep the price of the enclosure reasonable since the rest of my family is pitching in on the costs.
Some extra info I copied from one of my comments:
- At this point, will have 2 houses, but likely 3 by next year.
- The first two will be a short drive away, but the third will be hours away.
- The houses are on 100/50Mb fiber. Very stable internet.
- Me being the tech person, I'll access them every way that's available. For the rest of my family I'll likely set them up either with a hardwire or local network.
- We will be using them as part of a 3-2-1 backup for all of our files like photos or documents. I'll be using the second drive for occasional video backup storage.
- The shared drive will probably be 5-10 TB, depending on how much storage each household wants. The second drive for me will be around 20TB.
- We want multiple units so we have multiple copies of all our important files in the event of something like a house burning down.
Another clarification:
We do want to access files from each NAS individually instead of having everyone connect to one master NAS. The storage will be used mainly for archival and backup, so version conflicts of individual files wont be much of a concern.
It's possible there is dedicate system to do this, I haven't researched it. But if not setting up syncthing would work. And if its a lot of data sync it local first then mail or drive the remote drive to them.
-
Hello all! As the title suggests, I'm looking for some help and recommendations for starting a NAS storage/backup between a few households in my family.
Apologies if this isn't the right place to ask this. This will be my first entry into something something like this, so I'm not entirely sure where to go.
What I would like to do is have an enclosure in each house and have them all sync together. Two drives will be necessary since I'll use one drive just on my own since I have a lot of files to store. The other drive I would like to partition so that each household can be given a set amount of storage.
The rest of my family isn't very tech savvy, so I would prefer a solution that is relatively straight forward to setup and troubleshoot in the rare case I might need them to do something remotely.
I would like to keep the price of the enclosure reasonable since the rest of my family is pitching in on the costs.
Some extra info I copied from one of my comments:
- At this point, will have 2 houses, but likely 3 by next year.
- The first two will be a short drive away, but the third will be hours away.
- The houses are on 100/50Mb fiber. Very stable internet.
- Me being the tech person, I'll access them every way that's available. For the rest of my family I'll likely set them up either with a hardwire or local network.
- We will be using them as part of a 3-2-1 backup for all of our files like photos or documents. I'll be using the second drive for occasional video backup storage.
- The shared drive will probably be 5-10 TB, depending on how much storage each household wants. The second drive for me will be around 20TB.
- We want multiple units so we have multiple copies of all our important files in the event of something like a house burning down.
Another clarification:
We do want to access files from each NAS individually instead of having everyone connect to one master NAS. The storage will be used mainly for archival and backup, so version conflicts of individual files wont be much of a concern.
I'll share my experience with my very unprofessional but working setup.
I have two locations, both using retired PCs. I don't need anything fancy, but some considerations could be GPU/encoding hardware if you wanted something like jellyfin/Plex. I use proxmox and proxmox backup server for managing everything and so far it's been working well. Definitely not plug and play like an aio nas but that's because a nas wasn't my only goal as I needed cameras (frigate) and homeassistant.
I would highly recommend headscale/tailscale (as others have suggested) as it "just works" when setup in my experience. This enables safe remote access without opening any ports on your families networks so you can troubleshoot if something did break.
Regardless of which solution you decide to use, the most important part about having a backup is testing. If you can't see when your backups fail or don't know how to recover you may as well not have a backup.
-
Is Synology still a good option? I remember them getting some flack a bit ago. Something about hard drives I think?
I'll kept a look out for deals like that.
oh yeah.... they're "white labeling" their own brand of drives and if you use anything else it'll bitch at you. I think for now it still lets you, but their OS definitely shows you're not using a "proper" drive. May want to keep an eye on that.
-
Hello all! As the title suggests, I'm looking for some help and recommendations for starting a NAS storage/backup between a few households in my family.
Apologies if this isn't the right place to ask this. This will be my first entry into something something like this, so I'm not entirely sure where to go.
What I would like to do is have an enclosure in each house and have them all sync together. Two drives will be necessary since I'll use one drive just on my own since I have a lot of files to store. The other drive I would like to partition so that each household can be given a set amount of storage.
The rest of my family isn't very tech savvy, so I would prefer a solution that is relatively straight forward to setup and troubleshoot in the rare case I might need them to do something remotely.
I would like to keep the price of the enclosure reasonable since the rest of my family is pitching in on the costs.
Some extra info I copied from one of my comments:
- At this point, will have 2 houses, but likely 3 by next year.
- The first two will be a short drive away, but the third will be hours away.
- The houses are on 100/50Mb fiber. Very stable internet.
- Me being the tech person, I'll access them every way that's available. For the rest of my family I'll likely set them up either with a hardwire or local network.
- We will be using them as part of a 3-2-1 backup for all of our files like photos or documents. I'll be using the second drive for occasional video backup storage.
- The shared drive will probably be 5-10 TB, depending on how much storage each household wants. The second drive for me will be around 20TB.
- We want multiple units so we have multiple copies of all our important files in the event of something like a house burning down.
Another clarification:
We do want to access files from each NAS individually instead of having everyone connect to one master NAS. The storage will be used mainly for archival and backup, so version conflicts of individual files wont be much of a concern.
wrote last edited by [email protected]I strongly recommend ZFS as a filesystem for this as it can handle your sync, backup, and quota needs very well. It also has data integrity guarantees that should frankly be table stakes in this application. Truenas is an easy way to accomplish this, and it can run docker containers and VMs if you like.
Tailscale is a great way to connect them all, and connect to your nas when you aren’t home. You can share devices between tailnets, so you don’t all have to be on the same Tailscale account.
I’ll caution against nextcloud, it has a zillion features but in my experience it isn’t actually that good at syncing files. It’s complicated to set up, complicated to maintain, and there are frequent bugs. Consider just using SMB file sharing (built into truenas), or an application that only syncs files without trying to be an entire office suite as well.
For your drive layouts, I’d go with big drives in a mirror. This keeps your power and physical space requirements low. If you want, ZFS can also transparently put metadata and small files on SSDs for better latency and less drive thrashing. (These should also be mirrored.) Do not add an L2ARC drive, it is rarely helpful.
The boxes are kinda up to you. Avoid USB enclosures if at all possible. Truenas can be installed on most prebuilt NAS boxes other than synology, presuming it meets the requirements. You can also build your own. Hot swap is nice, and a must-have if you need normies to work on it. Label the drive serial number on the outside so you can tell them apart. Don’t go for less than 4 bays, and more is better even if you don’t need them yet. You want as much RAM as feasibly possible; ZFS uses it for caching, and it gives you room to run containers and VMs.
-
oh yeah.... they're "white labeling" their own brand of drives and if you use anything else it'll bitch at you. I think for now it still lets you, but their OS definitely shows you're not using a "proper" drive. May want to keep an eye on that.
Having read some stuff on that drama, I got looking into Asustor NAS units. Their entry one looks perfect for our general use and has all the apps and features I think I could use.
-
Hello all! As the title suggests, I'm looking for some help and recommendations for starting a NAS storage/backup between a few households in my family.
Apologies if this isn't the right place to ask this. This will be my first entry into something something like this, so I'm not entirely sure where to go.
What I would like to do is have an enclosure in each house and have them all sync together. Two drives will be necessary since I'll use one drive just on my own since I have a lot of files to store. The other drive I would like to partition so that each household can be given a set amount of storage.
The rest of my family isn't very tech savvy, so I would prefer a solution that is relatively straight forward to setup and troubleshoot in the rare case I might need them to do something remotely.
I would like to keep the price of the enclosure reasonable since the rest of my family is pitching in on the costs.
Some extra info I copied from one of my comments:
- At this point, will have 2 houses, but likely 3 by next year.
- The first two will be a short drive away, but the third will be hours away.
- The houses are on 100/50Mb fiber. Very stable internet.
- Me being the tech person, I'll access them every way that's available. For the rest of my family I'll likely set them up either with a hardwire or local network.
- We will be using them as part of a 3-2-1 backup for all of our files like photos or documents. I'll be using the second drive for occasional video backup storage.
- The shared drive will probably be 5-10 TB, depending on how much storage each household wants. The second drive for me will be around 20TB.
- We want multiple units so we have multiple copies of all our important files in the event of something like a house burning down.
Another clarification:
We do want to access files from each NAS individually instead of having everyone connect to one master NAS. The storage will be used mainly for archival and backup, so version conflicts of individual files wont be much of a concern.
I want to write this in a separate post because I see many questionable suggestions:
Your scenario does not allow for a simple rsync / ZFS copy. That is because those only work with 1:many. Meaning one "true" copy that gets replicated a couple of times.
As I understand you have a many:many scenario, where any location can access and upload new data. So if you have two locations that changed the same file that day, what do you do? many:many data storage is a hard problem. Because of this a simple solution unfortunately won't work. There is a lot of research that has gone into this for hyperscalers such as AWS GCP, Azure etc. They all basically came to the same solution, which is that they use distributed quorum based storage systems with a unified interface. Meaning everyone accesses the "same" interface and under the hood the data gets replicated 3 times. So it turns it back into a 1:many basically, with the advantages of many:many.
-
I strongly recommend ZFS as a filesystem for this as it can handle your sync, backup, and quota needs very well. It also has data integrity guarantees that should frankly be table stakes in this application. Truenas is an easy way to accomplish this, and it can run docker containers and VMs if you like.
Tailscale is a great way to connect them all, and connect to your nas when you aren’t home. You can share devices between tailnets, so you don’t all have to be on the same Tailscale account.
I’ll caution against nextcloud, it has a zillion features but in my experience it isn’t actually that good at syncing files. It’s complicated to set up, complicated to maintain, and there are frequent bugs. Consider just using SMB file sharing (built into truenas), or an application that only syncs files without trying to be an entire office suite as well.
For your drive layouts, I’d go with big drives in a mirror. This keeps your power and physical space requirements low. If you want, ZFS can also transparently put metadata and small files on SSDs for better latency and less drive thrashing. (These should also be mirrored.) Do not add an L2ARC drive, it is rarely helpful.
The boxes are kinda up to you. Avoid USB enclosures if at all possible. Truenas can be installed on most prebuilt NAS boxes other than synology, presuming it meets the requirements. You can also build your own. Hot swap is nice, and a must-have if you need normies to work on it. Label the drive serial number on the outside so you can tell them apart. Don’t go for less than 4 bays, and more is better even if you don’t need them yet. You want as much RAM as feasibly possible; ZFS uses it for caching, and it gives you room to run containers and VMs.
I'll caution against nextcloud [...]
It is indeed rather big and clunky sometimes, but there's one feature that I really love that I could not really live without. I just tried out Seafile, but I didn't like the whole "libraries" concept, because it made it very difficult to exclude certain subfolders that I didn't want on a certain system or to sync multiple local folders to multiple remote folders. I'm using Nextcloud to sync my Documents, Videos, Pictures and Music folders across all of my devices, but I don't need every single subfolder there downloaded to every single device that I use it on. I also use it to sometimes sync game save files for the ones that I don't have on Steam. Would you happen to know a better solution than Nextcloud for something like this? I'm currently migrating it from a Raspberry Pi 2 to an older laptop that I have laying around, and I'd happily use a different syncing solution for this, and set up other features that I used (CalDAV, CardDAV) on other containers.
P.S Syncthing looks like what I might need, but I do wonder how I can make public share/upload links with it.
-
Hello all! As the title suggests, I'm looking for some help and recommendations for starting a NAS storage/backup between a few households in my family.
Apologies if this isn't the right place to ask this. This will be my first entry into something something like this, so I'm not entirely sure where to go.
What I would like to do is have an enclosure in each house and have them all sync together. Two drives will be necessary since I'll use one drive just on my own since I have a lot of files to store. The other drive I would like to partition so that each household can be given a set amount of storage.
The rest of my family isn't very tech savvy, so I would prefer a solution that is relatively straight forward to setup and troubleshoot in the rare case I might need them to do something remotely.
I would like to keep the price of the enclosure reasonable since the rest of my family is pitching in on the costs.
Some extra info I copied from one of my comments:
- At this point, will have 2 houses, but likely 3 by next year.
- The first two will be a short drive away, but the third will be hours away.
- The houses are on 100/50Mb fiber. Very stable internet.
- Me being the tech person, I'll access them every way that's available. For the rest of my family I'll likely set them up either with a hardwire or local network.
- We will be using them as part of a 3-2-1 backup for all of our files like photos or documents. I'll be using the second drive for occasional video backup storage.
- The shared drive will probably be 5-10 TB, depending on how much storage each household wants. The second drive for me will be around 20TB.
- We want multiple units so we have multiple copies of all our important files in the event of something like a house burning down.
Another clarification:
We do want to access files from each NAS individually instead of having everyone connect to one master NAS. The storage will be used mainly for archival and backup, so version conflicts of individual files wont be much of a concern.
wrote last edited by [email protected]If I understood you correctly then you want each NAS to have two storage pools.
Pool1
- bigger pool
- only your data
- part of a distributed storage across all NAS(?)
- backup 3-2-1
Pool2
- smaller pool
- shared to the home network it is a part of
- backup 3-2-1
Is this correct?
-
I'll caution against nextcloud [...]
It is indeed rather big and clunky sometimes, but there's one feature that I really love that I could not really live without. I just tried out Seafile, but I didn't like the whole "libraries" concept, because it made it very difficult to exclude certain subfolders that I didn't want on a certain system or to sync multiple local folders to multiple remote folders. I'm using Nextcloud to sync my Documents, Videos, Pictures and Music folders across all of my devices, but I don't need every single subfolder there downloaded to every single device that I use it on. I also use it to sometimes sync game save files for the ones that I don't have on Steam. Would you happen to know a better solution than Nextcloud for something like this? I'm currently migrating it from a Raspberry Pi 2 to an older laptop that I have laying around, and I'd happily use a different syncing solution for this, and set up other features that I used (CalDAV, CardDAV) on other containers.
P.S Syncthing looks like what I might need, but I do wonder how I can make public share/upload links with it.
Yeah, syncthing can do all of that except public share links. Run an instance on your NAS so there is always a sync target online.
-
Hello all! As the title suggests, I'm looking for some help and recommendations for starting a NAS storage/backup between a few households in my family.
Apologies if this isn't the right place to ask this. This will be my first entry into something something like this, so I'm not entirely sure where to go.
What I would like to do is have an enclosure in each house and have them all sync together. Two drives will be necessary since I'll use one drive just on my own since I have a lot of files to store. The other drive I would like to partition so that each household can be given a set amount of storage.
The rest of my family isn't very tech savvy, so I would prefer a solution that is relatively straight forward to setup and troubleshoot in the rare case I might need them to do something remotely.
I would like to keep the price of the enclosure reasonable since the rest of my family is pitching in on the costs.
Some extra info I copied from one of my comments:
- At this point, will have 2 houses, but likely 3 by next year.
- The first two will be a short drive away, but the third will be hours away.
- The houses are on 100/50Mb fiber. Very stable internet.
- Me being the tech person, I'll access them every way that's available. For the rest of my family I'll likely set them up either with a hardwire or local network.
- We will be using them as part of a 3-2-1 backup for all of our files like photos or documents. I'll be using the second drive for occasional video backup storage.
- The shared drive will probably be 5-10 TB, depending on how much storage each household wants. The second drive for me will be around 20TB.
- We want multiple units so we have multiple copies of all our important files in the event of something like a house burning down.
Another clarification:
We do want to access files from each NAS individually instead of having everyone connect to one master NAS. The storage will be used mainly for archival and backup, so version conflicts of individual files wont be much of a concern.
I would probably go with a simple approach like this:
- ZFS: Each house gets a "NAS" that provides a ZFS filesystem to store the data. This gives you the ability to share the drives across your use cases (you, rest of the family), snapshots, RAIDZ support, and usage quotas. For the OS, you could use what you prefer (TrueNAS, Debian, Ubuntu, ...).
- Syncthing to synchronize the files across the servers/houses. This allows you to read and write data from anywhere and syncthing will mirror the writes to the other places. I use it to synchronize data across 5 devices and it works quite well.
There are probably more advanced (enterprise?) ways to handle the file synchronization. But, I think this hould be good enough for normal, personal use. The main disadvantage is that you're only synchronizing the current data (excluding the ZFS snapshots). On the other hand, this also allows you to mix file systems if necessary.
-
I would probably go with a simple approach like this:
- ZFS: Each house gets a "NAS" that provides a ZFS filesystem to store the data. This gives you the ability to share the drives across your use cases (you, rest of the family), snapshots, RAIDZ support, and usage quotas. For the OS, you could use what you prefer (TrueNAS, Debian, Ubuntu, ...).
- Syncthing to synchronize the files across the servers/houses. This allows you to read and write data from anywhere and syncthing will mirror the writes to the other places. I use it to synchronize data across 5 devices and it works quite well.
There are probably more advanced (enterprise?) ways to handle the file synchronization. But, I think this hould be good enough for normal, personal use. The main disadvantage is that you're only synchronizing the current data (excluding the ZFS snapshots). On the other hand, this also allows you to mix file systems if necessary.
If the data only needs to be read & written from a single server (and the others are just backups), you can also use simpler replication instead of synchthing. E.g. syncoid or TrueNAS replication. It sounds like you should be able to do that with separate datasets per household in your usecase.
-
I want to write this in a separate post because I see many questionable suggestions:
Your scenario does not allow for a simple rsync / ZFS copy. That is because those only work with 1:many. Meaning one "true" copy that gets replicated a couple of times.
As I understand you have a many:many scenario, where any location can access and upload new data. So if you have two locations that changed the same file that day, what do you do? many:many data storage is a hard problem. Because of this a simple solution unfortunately won't work. There is a lot of research that has gone into this for hyperscalers such as AWS GCP, Azure etc. They all basically came to the same solution, which is that they use distributed quorum based storage systems with a unified interface. Meaning everyone accesses the "same" interface and under the hood the data gets replicated 3 times. So it turns it back into a 1:many basically, with the advantages of many:many.
I'll keep that in mind. Since you've pointed it out I can definitely see the technical difficulties of a system like that.
One thought I just had: could each individual NAS unit have its own 1:many? For example, the NAS in one house controls the backup for those people and the NAS in the second house controls the backup for them. That way each household can still access their own files through a wire if needed.
-
If I understood you correctly then you want each NAS to have two storage pools.
Pool1
- bigger pool
- only your data
- part of a distributed storage across all NAS(?)
- backup 3-2-1
Pool2
- smaller pool
- shared to the home network it is a part of
- backup 3-2-1
Is this correct?
There will probably be several pools. Each household will get a private pool. Then there will be a shared pool for stuff like family photos. Finally I'll have the second drive as my own pool. So there will be 4-5 pools on the small drive.
Each NAS will be identical so all data is mirrored to each one. That way if a NAS dies or something worse happens like a house burning down, we won't lose any files.
-
I would probably go with a simple approach like this:
- ZFS: Each house gets a "NAS" that provides a ZFS filesystem to store the data. This gives you the ability to share the drives across your use cases (you, rest of the family), snapshots, RAIDZ support, and usage quotas. For the OS, you could use what you prefer (TrueNAS, Debian, Ubuntu, ...).
- Syncthing to synchronize the files across the servers/houses. This allows you to read and write data from anywhere and syncthing will mirror the writes to the other places. I use it to synchronize data across 5 devices and it works quite well.
There are probably more advanced (enterprise?) ways to handle the file synchronization. But, I think this hould be good enough for normal, personal use. The main disadvantage is that you're only synchronizing the current data (excluding the ZFS snapshots). On the other hand, this also allows you to mix file systems if necessary.
I'll keep Syncthing in mind.
I'll probably go with an all in one NAS just to keep things simple for the less tech savvy people of my family.
