Perplexity open sources R1 1776, a version of the DeepSeek R1 model that CEO Aravind Srinivas says has been “post-trained to remove the China censorship”.
-
Can't wait to try a distillation. The full model is huge.
In the 32B range? I think we have plenty of uncensored thinking models there, maybe try fusion 32B.
I'm not an expert though, as models trained from base Qwen have been sufficient for that, for me.
-
I think we can all agree that modifications to these models which remove censorship and propaganda on behalf of one particular country or party is valuable for the sake of accuracy and impartiality, but reading some of the example responses for the new model I honestly find myself wondering if they haven’t gone a bit further than that by replacing some of the old non-responses and positive portrayals of China and the CPC with a highly critical perspective typified by western governments which are hostile to China (in particular the US). Even the name of the model certainly doesn’t make it sound like neutrality and accuracy is their primary aim here.
Well you can merge it with the original model, to any degree, to get any sliding scale of “bias” you want.
Practically, though, I guess that’s not super practical, as very few have the hardware or cash to deploy a custom full R1 themselves.
-
This post did not contain any content.
Great. Has it also removed American censorship and propaganda?
-
In the 32B range? I think we have plenty of uncensored thinking models there, maybe try fusion 32B.
I'm not an expert though, as models trained from base Qwen have been sufficient for that, for me.
I just want to mess with this one too. I had a hard time finding an abliterated one before that didn't fail the Tiananmen Square question regularly.
-
I think we can all agree that modifications to these models which remove censorship and propaganda on behalf of one particular country or party is valuable for the sake of accuracy and impartiality, but reading some of the example responses for the new model I honestly find myself wondering if they haven’t gone a bit further than that by replacing some of the old non-responses and positive portrayals of China and the CPC with a highly critical perspective typified by western governments which are hostile to China (in particular the US). Even the name of the model certainly doesn’t make it sound like neutrality and accuracy is their primary aim here.
What part is highly critical of China? Facts can't be critical
-
This post did not contain any content.
IDK, but this seems like wankery to me. Just google it if you want to know about it, the AI isn't an "all knowing being" nor "the arbitrer of truth".
I have a feeling that a new logical fallacy will soon emerge (if it isn't already widespread on certain places of the internet), that will be "X is true because the LLM said so".
-
I think we can all agree that modifications to these models which remove censorship and propaganda on behalf of one particular country or party is valuable for the sake of accuracy and impartiality, but reading some of the example responses for the new model I honestly find myself wondering if they haven’t gone a bit further than that by replacing some of the old non-responses and positive portrayals of China and the CPC with a highly critical perspective typified by western governments which are hostile to China (in particular the US). Even the name of the model certainly doesn’t make it sound like neutrality and accuracy is their primary aim here.
LLMs are gigantic bias reproduction machines, so it will never be perfect.
-
IDK, but this seems like wankery to me. Just google it if you want to know about it, the AI isn't an "all knowing being" nor "the arbitrer of truth".
I have a feeling that a new logical fallacy will soon emerge (if it isn't already widespread on certain places of the internet), that will be "X is true because the LLM said so".
Seems like almost everyone understands that it hallucinates.
-
IDK, but this seems like wankery to me. Just google it if you want to know about it, the AI isn't an "all knowing being" nor "the arbitrer of truth".
I have a feeling that a new logical fallacy will soon emerge (if it isn't already widespread on certain places of the internet), that will be "X is true because the LLM said so".
It's really an extension of "Would some really do that? Just lie on the Internet?" But now "Would AI, which is built to create content like what people post on the Internet, really just lie?"
-
What part is highly critical of China? Facts can't be critical
Listen, I'm highly critical of the CCP, but LLMs aren't facts machines, they are make text like what they are trained on machines.
They have no grasp of truth, and we can only get some sense of truth of what the average collective text response of its dataset (at best!).
-
Listen, I'm highly critical of the CCP, but LLMs aren't facts machines, they are make text like what they are trained on machines.
They have no grasp of truth, and we can only get some sense of truth of what the average collective text response of its dataset (at best!).
I'm talking about the example texts
-
Great. Has it also removed American censorship and propaganda?
Why would a Chinese-made AI have American censorship and propaganda in it?
-
Great. Has it also removed American censorship and propaganda?
I believe this is what was added
-
This post did not contain any content.
My god, could he have chosen a name more cringe than this? Fuck.
-
Why would a Chinese-made AI have American censorship and propaganda in it?
They can add stuff too. At least it seems so, this model still give biased answers now but more in favor of the US... So who knows ?
-
This post did not contain any content.
not remove, replace.
Also, stop calling releasing binary blobs of weights as open source
-
This post did not contain any content.
Ctrl + F
Find: Chinese
Replace: God-damned Chinese
New model's ready!
-
This post did not contain any content.
I run an uncensored version on my PC since weeks, there are multiple ones on HuggingFace.
-
My god, could he have chosen a name more cringe than this? Fuck.
An attempt to appeal to U.S. conservatives maybe? You know all that 1776, 3%, ΜΟΛΩΝ ΛΑΒΕ etc. sticker suckers.
-
An attempt to appeal to U.S. conservatives maybe? You know all that 1776, 3%, ΜΟΛΩΝ ΛΑΒΕ etc. sticker suckers.
From what I gather from the Perplexity CEO, he is just that type of Musk-tier cringelord, so yes, probably