Edward Snowden slams Nvidia's RTX 50-series 'F-tier value,' whistleblows on lackluster VRAM capacity

[viri4thus@feddit.org]

AMD, as usual, misses an opportunity here. The 5xxx series is exactly Fermi again (they even removed hotspot data so reviewers would miss the throttling). AMD could leverage the nostalgia of one of ATI's best gens and call the cards 9700 and 9700pro. Damn, those were the days. (since 4750 conflicts with current scheme)

[thehobbyist@lemmy.zip]

Ollama, latest version. I have it setup with Open-WebUI (though that shouldn't matter). The 14B is around 9GB, which easily fits in the 12GB.

I'm repeating the 28 t/s from memory, but even if I'm wrong it's easily above 20.

Specifically, I'm running this model:
https://ollama.com/library/deepseek-r1:14b-qwen-distill-q4_K_M

[alphane_moon@lemmy.world]

He is not simply pretending Putin is a nice guy, he is clearly collaborating with russian security services. Just look at his comments on internal US politics. And he also was spreading misinformation that russia wasn't going to invade Ukraine in Feb 2022.

He might be a hero for many, but if you're Ukrainian (like I am), he is clearly a piece of shit.

[manicdave@feddit.uk]

I'm running deepseek-r1:14b on a 12GB rx6700. It just about fits in memory and is pretty fast.

[levzzz@lemmy.world]

You need a pretty large context window to fit all the reasoning, ollama forces 2048 by default and more uses more memory

[naz@sh.itjust.works]

I bought my 7900XTX for $800, and have kept absolutely quiet about it.

Anyone who has asked me: "AMD sucks, CUDA better, buy NVDA stock".

The invisible hand of the market is made of invisible delicious meat

[jeena@piefed.jeena.net]

Thanks for the additional information, that helped me to decide to get the 3060 12G instead of the 4060 8G. They have almost the same price but from what I gather when it comes to my use cases the 3060 12G seems to fit better even though it is a generation older. The memory bus is wider and it has more VRAM. Both video editing and the smaller LLMs should be working well enough.

[lipoly@lemmynsfw.com]

I totally get it, I live next to that big pain in the ass as well. Luckily, he hasn’t invaded us yet, but I feel it’s only a matter of time. And what Snowden does here certainly doesn’t help.

But he could have just done nothing and lived a very happy life. Instead, he chose to give up his happy life to uncover the NSA scandal, knowing full well that it will absolutely wreck his life.

Personally, I think he did enough for the greater good there. This isn’t his war, and if he has to post some lies to get a bit of normalcy back in his life, I can understand that. I wish it wasn’t that way, but I can understand it.

[evil_shrubbery@lemm.ee]

Still it's 100.0% USAs decisions that pushed him to Russia, it's not like he went there immediately (2013), he was on the run and in shitty conditions for years before he finally had enough and went to Russia (2022).

USA still wanted to disappear (torture) him, not even allowing him to stay in NATO or non-NATO countries.

A USA hero is safer in Russia, and Putin had nothing to do with setting that situation up (safe for not deporting him to USA ofc, which otc lol).

[gamingchairmodel@lemmy.world]

"Whistleblows" as if he's some kind of NVIDIA insider.

[alphane_moon@lemmy.world]

The issue is that he is supporting russian genocidal imperialism. His messaging clearly aligns with russian propaganda goals.

Is it not reasonable for me to consider him my enemy (he directly supports doing harm to me, my family and my fellow citizens)?

As far I am concerned, I hope Snowden and his family will one day be on the recieving end of russian brutality.

I don't buy the logic of "he did one good thing, so it's fine for him to promote russian genocidal imperialism".

If he can't stay consistent, he should have never got involved in the NSA issue in the first place.

He clearly enjoys the attention (just look at this post). He could have simply shut up and not worked with russian security services (the russians wouldn't kill him, they need him alive).

[alphane_moon@lemmy.world]

And how does this justify Snowden promoting russian genocidal imperialism in Ukraine?

He did a good thing, so now he is an untouchable saint?

[vhstape@lemmy.sdf.org]

Every time I see a headline that contains the word “slams,” I want to slam my head on the table

[sugar_in_your_tea@sh.itjust.works]

I'm guessing that was a deal Russia made with him, he gets to live as long as he's useful to Russia.

I don't think anyone is calling him a saint. He's a whistleblower whose best option was to defect to Russia, after a period of trying not to do that.

[sugar_in_your_tea@sh.itjust.works]

His messaging clearly aligns with russian propaganda goals.

Well yeah, he's in Russia. What's he supposed to do?

He did one good thing. Now he's in Russia, so ignore pretty much anything he days says that could in some way benefit Russia.

[astro_ray@piefed.social]

Just wanna say, cool username

[viri4thus@feddit.org]

Ty. I'll try ollama with the Q-4-M quantization. I wouldn't expect to see a difference between ollama and SGlang.

[grandwolf319@sh.itjust.works]

But that’s assuming there is actual high demand for running big models locally, so far I’ve only seen hobbyists do it.

I agree with you in theory that they just want more money but idk if they actually think locally run AI is that big of a threat (I hope it is).

[secret300@lemmy.sdf.org]

Swear next he's gonna review hentai games

Oh wait... https://www.youtube.com/watch?v=fAf1Syz17JE

[amir@lemmy.ml]

I'll keep believing this is a theonion post