DeepSeek's AI breakthrough bypasses industry-standard CUDA, uses assembly-like PTX programming instead

[vegeta@lemmy.world]

This post did not contain any content.

[corngood@lemmy.ml]

[mormund@feddit.org]

[imgonnatrythis@sh.itjust.works]

[filister@lemmy.world]

What is amazing in this case is that they achieved spending a fraction of the inference cost that OpenAI is paying.

Plus they are a lot cheaper too. But I am pretty sure that the American government will ban them in no time, citing national security concerns, etc.

Nevertheless, I think we need more open source models.

Not to mention that NVIDIA also needs to be brought to earth.

[demesisx@infosec.pub]

[mesamunefire@lemmy.world]

[sinceasdf@lemmy.world]

This is why Nvidia stock has been hit so hard. CUDA is their moat

[capsicones@lemmy.blahaj.zone]

[toffi@feddit.org]

Never forget kids the market can stay irrational much longer than you can stay solvent.

[demesisx@infosec.pub]

True.
Thats why I tend to make small plays instead of being an absolute degenerate gambler.

[eager_eagle@lemmy.world]

I don't think anyone is saying CUDA as in the platform, but as in the API for higher level languages like C and C++.

[capsicones@lemmy.blahaj.zone]

Some commenters on this post are clearly not aware of PTX being a part of the CUDA environment. If you know this, you aren't who I'm trying to inform.

[eager_eagle@lemmy.world]

aah I see them now

[eager_eagle@lemmy.world]

I wish that was true, but this doesn't threaten any monopoly

[demesisx@infosec.pub]

It certainly does.
Until last week, you absolutely NEEDED an NVidia GPU equipped with CUDA to run all AI models.
Today, that is simply not true. (watch the video at the end of this comment)

https://www.tomshardware.com/tech-industry/artificial-intelligence/deepseeks-ai-breakthrough-bypasses-industry-standard-cuda-uses-assembly-like-ptx-programming-instead

I watched this video and my initial reaction to this news was validated and then some: this video made me even more bearish on NVDA.

[pr06lefs@lemmy.ml]

This specific tech is, yes, nvidia dependent. The game changer is that a team was able to beat the big players with less than 10 million dollars. They did it by operating at a low level of nvidia's stack, practically machine code. What this team has done, another could do. Building for AMD GPU ISA would be tough but not impossible.

[eager_eagle@lemmy.world]

mate, that means they are using PTX directly. If anything, they are more dependent to NVIDIA and the CUDA platform than anyone else.

[eager_eagle@lemmy.world]

you absolutely NEEDED an NVidia GPU equipped with CUDA

also not true

[demesisx@infosec.pub]

Ahh. Thanks for this insight.