DHS has ordered all US federal civilian agencies to remove DeepSeek and third-party tools built on it, and to stop buying them. Here's what the order says.
I’m not aware of any realistic way to vet published model weights like that.
It works for some open-source software, because you can download the source and compile it yourself. But most of the “open” models don’t publish their entire training set, or enough details on the training for it to be truly reproducible. DeepSeek doesn’t publish their data sets, and they probably couldn’t, legally, since they “collaborate with third-party data providers to obtain proprietary datasets”. And even if they did, it would be prohibitively expensive to train it on your own, unlike simply compiling open-source code.
The actual code for training LLMs is relatively trivial. The secret sauce is the training data and fine-tuning.
You have agents classify what each portion of the network responds to and how. One compares it to filling out a very large crossword puzzle: https://already-clean.goodfire.com/
That’s the theory anways, not sure if it will stand the test of time…
I’m not aware of any realistic way to vet published model weights like that.
It works for some open-source software, because you can download the source and compile it yourself. But most of the “open” models don’t publish their entire training set, or enough details on the training for it to be truly reproducible. DeepSeek doesn’t publish their data sets, and they probably couldn’t, legally, since they “collaborate with third-party data providers to obtain proprietary datasets”. And even if they did, it would be prohibitively expensive to train it on your own, unlike simply compiling open-source code.
The actual code for training LLMs is relatively trivial. The secret sauce is the training data and fine-tuning.
You have agents classify what each portion of the network responds to and how. One compares it to filling out a very large crossword puzzle: https://already-clean.goodfire.com/
That’s the theory anways, not sure if it will stand the test of time…
Sounds interesting, thanks for the link. It’s a little over my head tbh but I’ll definitely take a closer look.