Help with Home Server Architecture and Hardware Selection?

[adrianthefrog@lemmy.world]

I'm just using basic fabric stuff running through a systemd service for my MC server. It also basically just has every single performance mod I could find and nothing else (as well as geyser+floodgate) so there isn't all that much admin stuff to do. I set up RCON (I think it's called) to send commands from my computer but I just set up everything through ssh. I haven't heard of either pterodactyl or crafty controller, I'll check those out!

[krill@feddit.uk]

Pretty sure truenas scale can host everything you want so you might only want one server. Use Epyc for the pcie lanes, and a fractal design r7 XL and you could even escape needing a rack mount if you wanted. Use a pcie to m.2 adapter and you could easily host apps on them on a mirrored pool and use a special vdev to speed up the HDD storage pool

The role of the proxmox server would essentially be filled by apps and/or VM you could turn on or off as needed.

[arbiterxero@lemmy.world]

Also, there are some “former crypto miner“ boards that are configured with SUPER wide slots for video cards exactly like this.

They’re great and cheap used because nobody wants them.

If I have to build a second one, that’s my next path.

[estebiu@lemmy.dbzer0.com]

You can still run smaller models on cheaper gpus, no need for the greatest gpu ever. Btw, I use it for other things too, not only LLMs

[estebiu@lemmy.dbzer0.com]

Uhh, a lot of big words here. I mostly just play around with it.. Never used LLMs for anything more serious than a couple of test, so I don't even know now many tokens can my setup generate..