Help Reviewing My Server Setup?
-
I'm not an expert, how many Raspberry Pi 4s does this translate to?
-
I would put truenas on the NAS, also put a VM on truenas with 16-24G of RAM.
Create a kubernetes or docker swarm cluster with server 1 and the nas vm and just have everything as containers. This way you just have one resource pool, and the containers will be started wherever there are enough resources available. The containers will mount NFS shares from truenas which truenas will create automatically as ZFS datasets. ZFS supports snapshots.
-
ZFS is an enterprise software RAID, and 1:1 RAM to TB is the minimum recommended requirement for a production server (e.g. enterprise implementations).
I've seen many users stating they have far far less than 1:1 without issues. I recall a r/DataHoarder user saying they have 100+ TB's and only 16 or 32GB RAM, which is not fully utilized, so it all depends on your usage profile and the size/scale of r/w ops occurring during peak periods.
-
I personally would avoid LXC. That seems to be a hot take but in my experience it is better to run docker/podman in a few VMs.
-
Cost wise? 1 or 2 /s
-
The GPU should be the same for most Intel systems
-
I wouldn't do that unless you have lots of money to blow on crazy hardware. Running separate virtual machines is very inefficient. Instead, run a few virtual machines with a few services in each. I would separate it out into classes based on the load and use case.
-
Not everything plays nice in Docker, and there are plenty of those services that also don't need a full VM to operate. LXC is great for those edge cases. Otherwise I agree, a few VMs for various Docker stacks is the way to go.
-
...really? I run most of my services in an LXC, and have for a while without issue.
-
I had the i5 prior to getting a NAS, and use it for Frigate. The i3 is just what came with the NAS box.
-
Maybe I'm doing it wrong then. I run LXC but has always been a much worse experience. Boot times are terrible and the controls that work for VMs don't work as well for LXC. You also can live transfer which is problematic for me.
-
Instead, run a few virtual machines with a few services in each.
That's what I meant, I guess it wasn't very clear. When I say "stack", I mean multiple services.
-
I'm also considering UnRaid instead of Proxmox for a NAS OS.
NAS just has no meaning anymore?
-
Personally I would keep it simple and just run a separate NAS and run all your services in containers across the devices best suited to them. The i3 is not going to manage for Jellyfin while sharing those other services. I tried running it on an N100 and had to move it to a beefier machine.
If you mount a NAS storage for hosting the container data, you can move them between machines with minimal issues. Just make sure you run services using a docker-compose for them and keep them on the NAS.
You completely negate the need for VMs and their overhead, can still snapshot the machine if you run debian as the OS there is timeshift. Other distros have similar.
-
Or just run them in containers and skip the need to run the VMs at all. You can do snapshots with Debian fine.
-
All the services OP has listed run great in docker, excluding Frigate (not tested personally).
-
I ran Jellyfin on a N100 for a while and it just couldn't cope despite being by itself on the machine. I mostly watch 4K h264 encoded stuff.
-
I don't like LXC personally. It seems that most of the community disagrees but for me it has been nothing but pain.
-
Might be the population on lemmy but elsewhere docker or podman are way more common. K8 in Enterprise.
-
True, I noticed that as well. Still, it's worth moving bare-metal docker installations to VMs. Easier to manage IMO.
