Edward Snowden slams Nvidia's RTX 50-series 'F-tier value,' whistleblows on lackluster VRAM capacity

[timewarp@lemmy.world]

The main thing propping up Windows as the main OS (meaning it is running at the root layer) is exclusive hardware GPU support which is used for gaming & many apps. Otherwise, automating running Windows apps & Windows on Linux would have become much more mainstream.

[deleted@lemmy.world]

I legit tried to understand how a lackluster VRAM capacity could spy on us.

[gork@lemm.ee]

How could Snowden get a hold of one of these in Russia? Maybe through an intermediary in Kazakhstan?

Then again it's hard finding one here even in the US since they all went out of stock within 5 minutes of being listed.

[thehobbyist@lemmy.zip]

You can. I'm running a 14B deepseek model on mine. It achieves 28 t/s.

[800xl@lemmy.world]

Shut the fuck up, Snowden.You had everyone behind you until you defected to Russia. There's no free lunch and you had a lot of info Putin would like to have. Oddly enough things really started getting bad shortly therafter.

[jeena@piefed.jeena.net]

Oh nice, that's faster than I imagined.

[danitos@reddthat.com]

He was being chasen by the US government, and Assange proved that being in an US allied country will still get your arrested/tortured. What other options did Snowden had other than escaping to Russia?

IMO don't hate the player, hate the game.

[undercoverulrikhd@programming.dev]

According to russian over at r/hardware GPUs have become cheaper in Russia since the ban as they are now being smuggled instead of imported via Europe with all extra cost that implies.

[viri4thus@feddit.org]

Every one who bought the 7900xtx laughing their arse off running 20GiB models with MUCH better performance than a 4080/4080Super lol

[lipoly@lemmynsfw.com]

Think of it from Snowdens perspective. You get to choose: either be tortured for the rest of your life, or chill in Russia and pretend Putin is a nice guy. I know what I’d pick.

[viri4thus@feddit.org]

I also have a 3060, can you detail which framework (sglang, ollama, etc) you are using and how you got that speed? i'm having trouble reaching that level of performance. Thx

[viri4thus@feddit.org]

You'd fit squarely as the village idiot in a 1984 sub plot.

[viri4thus@feddit.org]

AMD, as usual, misses an opportunity here. The 5xxx series is exactly Fermi again (they even removed hotspot data so reviewers would miss the throttling). AMD could leverage the nostalgia of one of ATI's best gens and call the cards 9700 and 9700pro. Damn, those were the days. (since 4750 conflicts with current scheme)

[thehobbyist@lemmy.zip]

Ollama, latest version. I have it setup with Open-WebUI (though that shouldn't matter). The 14B is around 9GB, which easily fits in the 12GB.

I'm repeating the 28 t/s from memory, but even if I'm wrong it's easily above 20.

Specifically, I'm running this model:
https://ollama.com/library/deepseek-r1:14b-qwen-distill-q4_K_M

[alphane_moon@lemmy.world]

He is not simply pretending Putin is a nice guy, he is clearly collaborating with russian security services. Just look at his comments on internal US politics. And he also was spreading misinformation that russia wasn't going to invade Ukraine in Feb 2022.

He might be a hero for many, but if you're Ukrainian (like I am), he is clearly a piece of shit.

[manicdave@feddit.uk]

I'm running deepseek-r1:14b on a 12GB rx6700. It just about fits in memory and is pretty fast.

[levzzz@lemmy.world]

You need a pretty large context window to fit all the reasoning, ollama forces 2048 by default and more uses more memory

[naz@sh.itjust.works]

I bought my 7900XTX for $800, and have kept absolutely quiet about it.

Anyone who has asked me: "AMD sucks, CUDA better, buy NVDA stock".

The invisible hand of the market is made of invisible delicious meat

[jeena@piefed.jeena.net]

Thanks for the additional information, that helped me to decide to get the 3060 12G instead of the 4060 8G. They have almost the same price but from what I gather when it comes to my use cases the 3060 12G seems to fit better even though it is a generation older. The memory bus is wider and it has more VRAM. Both video editing and the smaller LLMs should be working well enough.

[lipoly@lemmynsfw.com]

I totally get it, I live next to that big pain in the ass as well. Luckily, he hasn’t invaded us yet, but I feel it’s only a matter of time. And what Snowden does here certainly doesn’t help.

But he could have just done nothing and lived a very happy life. Instead, he chose to give up his happy life to uncover the NSA scandal, knowing full well that it will absolutely wreck his life.

Personally, I think he did enough for the greater good there. This isn’t his war, and if he has to post some lies to get a bit of normalcy back in his life, I can understand that. I wish it wasn’t that way, but I can understand it.