AMD vs Nvidia

[email protected]

Could be game specific, but there is no ground rendering in final fantasy. https://youtu.be/DxE-4ZxYxDA?si=ziYDWr5VAj7LV7hz

[email protected]

if you are on linux AMD is the better choice, period.

don't get me wrong, nvidia will work relatively well, ive ran it before on linux. but it isnt worth the pricetag to have tons of small issues everywhere.

[email protected]

AMD is by far the best choice for foss drivers. Intel might be an option in the future but I have no experience with their new cards. A second option would be good for Linux users but it's unlikely to be NVIDIA.

[email protected]

Honestly even on Windows I preferred AMD's software suite compared to Nvidia control panel and GeForce Experience. Currently using a 7900XTX and pretty happy with it. Also I missed Radeon Chill when I was on Nvidia, didn't expect to care about that at all, but I love it.

[email protected]

The only reason I still go Nvidia is because I self host AI, which afaik takes advantage of CUDA and just runs overall better on Nvidia cards, or at the very least is easier to set up. Really, the top reason is that it's the devil I know right now.

If I didn't self host AI, I would 100% go AMD. Especially if you don't want to use proprietary drivers. That being said, my old gaming laptop runs NixOS with Nouveau and there have definitely been improvements since I first tried it years ago, but I don't do much gaming on it. It's more a TV media station these days (so I can avoid the stupid smart TV bloat agenda, where your TV gets gradually slower and fits less increasingly-bloating apps over time).

[email protected]

If it's just about self-hosting and not training, ROCm works perfectly fine for that. I self-host DeepSeek R1 32b and FLUX.1-dev on my 7900 XTX.

You even get more VRAM for cheaper.

[email protected]

This is very good to know. I read that ROCm can be a pain to get up and running, but I read that months ago and this space is moving fast. I may switch over when I can if this is the case. My 3080 is feeling it's age already. Thank you!

[email protected]

That used to be the case, yes.

Alpaca pretty much allows running LLM out of the box on AMD after installing the ROCm addon in Discover/Software. LM Studio also works perfectly.

Image generation is a little bit more complicated.
ComfyUI supports AMD when all ROCm dependencies are installed and the PyTorch version is swapped for the AMD version.

However, ComfyUI provides no builds for Linux or AMD right now and you have to build it yourself.
I currently use a simple Docker container for ComfyUI which just takes the AMD ROCm image and installs ComfyUI ontop.

[email protected]

Definitely bookmarking this reply. I haven't tried ComfyUI yet, but I've had it starred on Github from back when it was fairly new. I'm no stranger to building from source, but I have not dived into Docker yet, which is becoming more and more of a weakness by the day. Docker is sometimes required by some really cool projects and I'm missing out.

[email protected]

Both work, just in different ways. I think AMD's value proposition is better on Linux but if you were choosing between a 6700XT and a 4080 (for sake of example) of course the latter is still gonna be faster despite the drivers being a bit weirder to manage

[email protected]

I have no beef in this argument, and I'm certainly not biased in relation to AMD/Nvidia. However, my 980Ti, my 2070S and now my 4070S have all run really well under Linux. I run KDE Neon and a quick 'sudo apt install nvidia-driver-570' installs the latest beta's in under 5 mins, if I want to roll back the driver a quick 'sudo apt install nvidia-driver-565' has me back on the latest feature branch. Yeah, Wayland adoption under Nvidia was slow, and Nvidia's choices weren't what anyone could call 'ideal' - But momentum is building, and as a result I've been using Wayland for about eight months now without issue. Before that, X11 was largely faultless running Nvidia hardware/drivers.

People say Nvidia struggle in relation to VKD3D performance. I'm not too sure what they're doing, but VKD3D runs fine here.

It's the one advantage we have over Mac users: We can run AMD, Intel and Nvidia. We also have ongoing OGL support, native Vulkan support, better game support under Steam, a larger user base under Steam, and the amazing Proton implementation.

Whether it be AMD or Nvidia, I personally think it's Linux for the win.

[email protected]

From what i've heard if your not willing to use the nvidia proprietary drivers then DON'T go for nvidia you will get terrible performance and amd will always be significantly better.

If you consider the proprietary drivers then I think it depends on your use case. For example AMD is better value if your gaming without ray tracing if you want to play with ray tracing or do any kind of productivity Nvidia is generaly the better option.
For machine learning Nvidia has much better compatibility with everything so you will have a better time and better performance, Although if you only care about running the largest models you can with the available vram then AMD gpu's will have more vram for the price.

[email protected]

ROCm

I'm curious. Say you are getting a new computer, put Debian on, want to run e.g. DeepSeek via ollama via a container (e.g. Docker or podman) and also play, how easy or difficult is it?

I know that for NVIDIA you install the (closed official) drivers, setup the container insuring you get GPU passthrough, and thanks to CUDA from the driver, you're pretty much good to go. Is it the same for AMD? Do you "just" need to install another package or is there more tinkering involved?

[email protected]

I’m curious. Say you are getting a new computer, put Debian on, want to run e.g. DeepSeek via ollama via a container (e.g. Docker or podman) and also play, how easy or difficult is it?

On the host system, you don't need to do anything. AMDGPU and Mesa are included on most distros.

For LLMs you can go the easy route and just install the Alpaca flatpak and the AMD addon. It will work out of the box and uses ollama in the background.

If you need a Docker container for it: AMD provides the handy rocm/dev-ubuntu-${UBUNTU_VERSION}:${ROCM_VERSION}-complete images. They contain all the required ROCm dependencies and runtimes and you can just install your stuff ontop of it.

As for GPU passthrough, all you need to do is add a device link for /dev/kfd and /dev/dri and you are set. For example, in a docker-compose.yml you just add this:

    devices:
      - /dev/kfd:/dev/kfd
      - /dev/dri:/dev/dri

For example, this is the entire Dockerfile needed to build ComfyUI from scratch with ROCm. The user/group commands are only needed to get the container groups to align with my Fedora host system.

::: spoiler spoiler

ARG UBUNTU_VERSION=24.04
ARG ROCM_VERSION=6.3
ARG BASE_ROCM_DEV_CONTAINER=rocm/dev-ubuntu-${UBUNTU_VERSION}:${ROCM_VERSION}-complete

# For 6000 series
#ARG ROCM_DOCKER_ARCH=gfx1030
# For 7000 series
ARG ROCM_DOCKER_ARCH=gfx1100

FROM ${BASE_ROCM_DEV_CONTAINER}

RUN apt-get update && apt-get install -y git python-is-python3 && rm -rf /var/lib/apt/lists/*
RUN pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/rocm6.3 --break-system-packages

# Change group IDs to match Fedora
RUN groupmod -g 1337 irc && groupmod -g 105 render && groupmod -g 39 video

# Rename user on newer 24.04 release and add to video/render group
RUN usermod -l ai ubuntu && \
    usermod -d /home/ai -m ai && \
    usermod -a -G video ai && \
    usermod -a -G render ai

USER ai
WORKDIR /app

ENV PATH="/home/ai/.local/bin:${PATH}"

RUN git clone https://github.com/comfyanonymous/ComfyUI .
RUN pip install -r requirements.txt --break-system-packages

COPY start.sh /start.sh
CMD /start.sh

:::

[email protected]

It's the pro driver for workstation use. If you are gaming then you don't need it. The gaming driver is only open source

[email protected]

Very cool, thanks for the in depth explanation.

[email protected]

I put a 3060Ti in my latest build. The NVidia drivers would consistently hard lock my PC after about a day of uptime no matter what I did. I spent ages trying to hunt down the issue, and waited through several kernel and driver versions in vain hope, fuelled by people insisting that the NVidia drivers were "good now". I switched to nvidia-open once that released (or once I realised it existed) to no avail. Nouveau was not available at all for those cards when I started and was still missing critical features at the end.

I think this is the first time I've ever encountered a kernel crash in nearly two decades of Linux computing. And second, and third and...

I switched to an AMD card, a 7600 (a generation newer! In case anyone thought this was a "new hardware" issue) and the problem was immediately gone, and my PC has returned to being my sanctuary.

My problem is exceptionally rare - I think i found one other person experiencing it over the course of 1-2 years. But the concept that NVidia had redeemed themselves continues to ring hollow for me.

[email protected]

A workaround's been developed for the issue regarding FFVII.

https://github.com/ValveSoftware/Proton/issues/8408#issuecomment-2657340142

[email protected]

I don't want any proprietary drivers (so I am talking about Nouveau or any other FOSS Nvidia driver if it exists)

In that case AMD, no doubt about it.

If you were considering proprietary drivers it would still be AMD but there would be some discussion about it.

[email protected]

If you're unwilling to use proprietary drivers AMD or Intel if yout friend. If you use proprietary drivers NVIDIA is mostly fine now.

agnos.is Forums

AMD vs Nvidia