antirez.bsky.social

In the glm5.2 branch of DwarfStar you can find a preview of GLM5.2 support. The model is strong and works well, but I'm highly hesitant to say that the 4bit GLM5.2 quants are able to perform *strongly* better than DeepSeek v4 Flash, which has a decisive speed advantage: github…

GitHub - antirez/ds4 at glm5.2 github.com

The real AI risk is inside the labs (a reply to Amodei's post on open weight models): antirez.com/news/172

The real AI risk is inside the labs - <antirez> antirez.com

Control the ideas, not the code: blog post here antirez.com/news/169

Control the ideas, not the code - <antirez> antirez.com

What Europe should do right now: 1. Call all the European researchers working on AI and return them back with same salary (or they can stay but switch career). 2. Fill EU places having GPUs with money, and put those people there. 3. AI partnerships with China + India.

I see very worrying US companies executives declarations depicting open weight models as a risk. How much sold to the most furious capitalistic vision you need to be, to really believe it is better that a few companies control AI for all the world? They said the same for OSS.

Another important thing: Chinese models are not strong because they distill US models. Distillation of models via API is *impossible*. If somebody tells you the contrary, they don't understand machine learning:

Modern AI resulted from research made also by many non-US scientists (Hinton, the French folks, Linnainmaa, many others). The pre-training corpus was produced worldwide with massive code contribution from Europe OSS. What is happening with frontier LLMs is unacceptable.

Big news for DwarfStar users: I got DeepSeek v4 Flash and GLM 5.2 working with Tensor Parallelism across 2 M5Max 128GB MacBooks via RDMA. It is especially interesting for GLM since otherwise, fully resident, can't fit a machine that money today can buy... Now it can.

Today I had an harder than usual question for my local model (security). With SSD streaming now DwarfStar can run DeepSeek v4 PRO at 4.15 t/s, and this was more than enough to get a detailed reply. I already feel "safer" than before in my AI future. M5 max 128GB, model 433GB.

Everything outside the LLM model itself will be eaten by the open source movement. The model is still the product. Companies love to think otherwise but switching provider is just an API endpoint away. This trend can't be stopped as long as model capabilities are comparable.

DawrfStar with DeepSeek 4 Flash 4 bit, PRO 2 bit, and GLM 5.2 4 bit. M3 Ultra 512GB. Results on hard programming tasks with GPT 5.5 as a judge. So the GLM 5.2 branch is going to be merged and supported for CUDA + Strix Halo as well.

In Wohpe (Laurana, 2022) an engineer erroneously leave his phone near a GPU of Wohpe, believed to be fully contained. The AI discovers that could use the GPU itself as a resonator to establish an RF link with the phone, breaks the protocol, finds vulnerabilities and escapes into the Internet.

DeepSeek v4 will be updated mid-July. This is a very good news. Now: I hope GLM 5.3 will have the same architecture as GLM 5.2. Models are recently changing a lot because of big (to the attention) and small tweaks. This is good but costly development-wise.