You must log in or register to comment.
For anyone wondering, distillation means you take a big model and generate outputs with it and then you take a small model and train it on those outputs so it pretends to be the big model. The end result uses less processing power while pretending to be the big model so you still get better quality responses.
They cut it with large amounts of Marxism or so I hear.
Not really. This is DeepSeek:
Maybe Marxism isn’t censored, just Maoism. Sometimes, if you ask it more complicated questions, it starts to answer, notices it gets into a maoist direction, then deletes the whole answer and says “that’s out of scope”. I’m not even any kind of Maoist (because I don’t know much about Maoism), but it’s still very noticeable to the point that general Marxist queries get censored, just in case.
Idk I have used it to discuss Marxism before. I have uploaded PDFs of the various volumes of capital and asked it about the concepts contained within. Mao just seems to be more what it won’t talk about then Marxism itself.
Yes, what I’m saying is, that if you ask a general question about Marxism, not even mentioning Maoism, sometimes (and not too rarely, this happened multiple times), it starts giving an answer and aborts and deletes its answer instead. What I can’t prove (but suspect) is, that it was about to give an answer that leans towards maoism, noticed and aborted. Discussing capital is probably save, because it’s not about revolutionary praxis, imperialism, revisionism, cultural revolution or the Soviet Union. All topics where Maoist takes could come up.
deepseek Flash from API does not censor, also you can check final result from what you get in inspect elements network ta
Generally it just deletes it for whatever reason, it is still highly anti-communist unless the user is expressly one, and even then it generally is anti-soviet with the exception of Lenin, and it will refuse discussion about Stalin
They’re less egregious if you use Chinese, and the reason behind this is extremely clear, it is probabilistic, and as a result highly syncopathic, though for things like Stalin (where essentially nearly all the large sources that the AI has trained on equate it to Hitler, with a minority giving reason behind it) it will refuse all discussions, Mao isn’t as bad, likely thanks to the lack of post mortem condemnation
AI will never be Marxist as it is being trained now, the vast majority of the sources ai trains on support US Hegemony, thus it’ll always be pro-western until the user shifts the best response another direction
Why would a Chinese company want to block discussion of Maoism? Do they just want to avoid discussing anything related to modern Chinese politics?
I don’t know why, but you can totally ask it about “socialism with Chinese characteristics” and that does involve current politics. You can also ask about Marxism in general. Also, it’s not just about the modern version of Maoism, that emerged in Peru. What’s being censored is also Mao Zedong Thought:
Actually, Mao as a historical person is being censored:
Very odd. I don’t know how taboo it is to say negative or incorrect things about Mao in China, but perhaps they don’t want their model accidentally doing that?
Maoists might be seen as dangerous ultra leftists.
Given the chaos of the cultural revolution and the poverty worship of the gang of four and their supporters definitely possible but honestly unlikely.
The most likely reason in my opinion is simply due to how LLMs are trained knowing the general vibe of the training data especially in English (full of atrocity propaganda) when it comes to sensitive people or events it’s best to simply censor it so those most likely to fall for said propaganda can’t be made use of and those who wouldn’t can simply do the research. (There’s a similar train of thought with regards to the firewall and the necessity of a VPN to access western “news” discouraging most who could be made use of to even bother while those who make the effort are less likely to fall for it.)
It’s actually just Mao getting scun7horped as collateral damage from the CCP preventing another outbreak of Party Rock Anthem.
