Help Reviewing My Server Setup?
-
Instead, run a few virtual machines with a few services in each.
That's what I meant, I guess it wasn't very clear. When I say "stack", I mean multiple services.
-
I'm also considering UnRaid instead of Proxmox for a NAS OS.
NAS just has no meaning anymore?
-
Personally I would keep it simple and just run a separate NAS and run all your services in containers across the devices best suited to them. The i3 is not going to manage for Jellyfin while sharing those other services. I tried running it on an N100 and had to move it to a beefier machine.
If you mount a NAS storage for hosting the container data, you can move them between machines with minimal issues. Just make sure you run services using a docker-compose for them and keep them on the NAS.
You completely negate the need for VMs and their overhead, can still snapshot the machine if you run debian as the OS there is timeshift. Other distros have similar.
-
Or just run them in containers and skip the need to run the VMs at all. You can do snapshots with Debian fine.
-
All the services OP has listed run great in docker, excluding Frigate (not tested personally).
-
I ran Jellyfin on a N100 for a while and it just couldn't cope despite being by itself on the machine. I mostly watch 4K h264 encoded stuff.
-
I don't like LXC personally. It seems that most of the community disagrees but for me it has been nothing but pain.
-
Might be the population on lemmy but elsewhere docker or podman are way more common. K8 in Enterprise.
-
True, I noticed that as well. Still, it's worth moving bare-metal docker installations to VMs. Easier to manage IMO.
-
Proxmox doesn't have native support for any of those. Honestly I think it would be cool for Proxmox to switch to some form of Podman.
-
That would be a smart move on their behalf I think.
-
Had issues with docker conpose mounting NFS storage.
Seemed like it got disconnected while in use by the container.
Did resolve it eventually by manually mounting it on the host.Any experience why?
Host OS: Debian 12
NFS server: Debian 12 in a Proxmox VM -
Storage appliance/service offering storage over the network to other clients.
Dunno what else you want or define under the 'NAS'-term. -
Let's be honest - in this community NAS means "my do-everything server that may have a RAID and probably also shares storage".
-
quicksync should let the i3 handle jellyfin just fine if you're not going beyond 1080p for a couple of concurrent users. Especially if you configure the Nice values to prefer jellyfin over immich.
I'm not aware of the platform for the n300 because it might be worth the initial setup, and have some room to upgrade the CPU later if it causes trouble.
If OP is going for multiple systems, I'd definitely agree on making one of them a pure NAS and let a more upgradable system run the chunky stuff.
-
The advantages you gain with running a hypervisor on something like ZFS is immeasurable, for snapshotting, replication, snapshot backups and high availability. You don't have to quiese machines to back them up and you can do instant COW snapshots before upgrades.
KVM doesn't really have overhead, that's the kernel part. Maybe a bit of RAM, but with LXCs it's negligible.
-
I think you're doing it wrong. LXCs boot almost instantaneously on a hypervisor since they hijack the host kernel, I'd be surprised if my CTs take 5 seconds.
I would agree on the live migration issue but I guess you pick your services accordingly. I have a VM that runs docker and a LXC docker host, and I pick my containers for each accordingly.
-
How on earth are you getting 5 second boot time with LXC? My containers take around 10 minutes to boot while VMs take a few seconds. Also LXC networking seems to break randomly.
-
@possiblylinux127 @ikidd Something sounds wrong there. I exclusively use LXC containers because I loathe docker and my containers boot basically instantly, and the networking is rock-solid.
-
I have no idea what you have going on, I've never seen LXCs take that long, even if I include the time it takes to down the containers and bring them up after a reboot.
What are you using for running them? I just tested my docker LXC and it took 16 seconds from when I typed "reboot" to having a login prompt. And that's on an ancient R410 server running proxmox.