Perplexity open sources R1 1776, a version of the DeepSeek R1 model that CEO Aravind Srinivas says has been “post-trained to remove the China censorship”.
-
LLMs are gigantic bias reproduction machines, so it will never be perfect.
-
Seems like almost everyone understands that it hallucinates.
-
It's really an extension of "Would some really do that? Just lie on the Internet?" But now "Would AI, which is built to create content like what people post on the Internet, really just lie?"
-
Listen, I'm highly critical of the CCP, but LLMs aren't facts machines, they are make text like what they are trained on machines.
They have no grasp of truth, and we can only get some sense of truth of what the average collective text response of its dataset (at best!).
-
I'm talking about the example texts
-
Why would a Chinese-made AI have American censorship and propaganda in it?
-
I believe this is what was added
-
My god, could he have chosen a name more cringe than this? Fuck.
-
They can add stuff too. At least it seems so, this model still give biased answers now but more in favor of the US... So who knows ?
-
not remove, replace.
Also, stop calling releasing binary blobs of weights as open source
-
Ctrl + F
Find: Chinese
Replace: God-damned Chinese
New model's ready!
-
I run an uncensored version on my PC since weeks, there are multiple ones on HuggingFace.
-
An attempt to appeal to U.S. conservatives maybe? You know all that 1776, 3%, ΜΟΛΩΝ ΛΑΒΕ etc. sticker suckers.
-
From what I gather from the Perplexity CEO, he is just that type of Musk-tier cringelord, so yes, probably
-
"Pat'rats"
-
It's honestly not that big a deal, as it's not like knowing anything about how it was trained (beyond the config) would help you modify it. It's still highly modifiable. It's not like anyone can afford to replicate it.
It would be nice to publish the hyperparameters for research purposes, but... shrug.
I think a subset of the exact training data/hyperparameters would help with quantization-aware-training, maybe, but that's all I got.
-
Not full R1, which is developed differently than any of the distillations.
-
My chatgpt will list the questionable human righfs record of Israel ad agree with the conclusion that they are, under the same standards and logic, likely guilty of their accused atrocities as thenlikes of China or Russia.
-
T [email protected] shared this topic
