https://developers.openai.com/api/docs/guides/latest-model
https://x.com/levie/status/2075287443411222628, https://xcancel.com/levie/status/2075287443411222628
Hacker News
Latest
Garnix Is Joining Shopify
2026-07-10 @ 16:21:18Points: 12Comments: 10
QuadRF can spot drones and see WiFi through my wall
2026-07-10 @ 15:59:53Points: 99Comments: 37
A Love Letter to Flashcards
2026-07-10 @ 15:30:44Points: 49Comments: 17
Computation as a Universal and Fundamental Concept
2026-07-10 @ 15:23:42Points: 11Comments: 2
The Annotated JEPA
2026-07-10 @ 13:45:05Points: 15Comments: 0
ActivityPub over ATProto
2026-07-10 @ 13:40:01Points: 45Comments: 20
Write code like a human will maintain it
2026-07-10 @ 13:33:00Points: 218Comments: 189
Successful Companies Go Blind
2026-07-10 @ 13:31:08Points: 80Comments: 34
Show HN: Runloom – Go-style coroutines for Python free-threaded
2026-07-10 @ 13:07:38Points: 25Comments: 13
Laylo (YC S20) Is Hiring a Head of Finance
2026-07-10 @ 12:00:36Points: 1
Late Bronze Age Collapse
2026-07-10 @ 11:59:55Points: 211Comments: 121
EU Commission: addictive design Instagram and Facebook in breach of the DSA
2026-07-10 @ 11:00:15Points: 193Comments: 134
Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can't
2026-07-10 @ 10:40:26Points: 47Comments: 38
Good Tools Are Invisible
2026-07-10 @ 10:32:41Points: 180Comments: 106
In Emacs, Everything Looks Like a Service
2026-07-10 @ 08:21:10Points: 122Comments: 68
AI-generated videos to maximally drive a target brain region
2026-07-10 @ 07:39:11Points: 216Comments: 204
How RCA Victor sold Sound Service to classrooms in 1939
2026-07-09 @ 20:37:43Points: 12Comments: 3
Interview with Mitchell Hashimoto about Ghostty and Zig
2026-07-09 @ 17:17:16Points: 337Comments: 187
GPT-5.6
2026-07-09 @ 17:04:14Points: 1478Comments: 1042
Hy3
2026-07-09 @ 15:27:48Points: 536Comments: 113
My burner email blocklist blocked me
2026-07-09 @ 14:54:34Points: 43Comments: 46
EU Parliament greenlights Chat Control 1.0
2026-07-09 @ 11:03:54Points: 1552Comments: 785
Show HN: Getting GLM 5.2 running on my slow computer
2026-07-09 @ 08:05:04Points: 809Comments: 200
But then I thought, "I wonder how it would work on a normal computer like mine," and above all, "I wonder if it would work without going into OOM on a computer like mine." So I started working with the help of agents to test this possibility.
I started converting the model to int4, understanding MTP usage, and if possible implementing DSA for long context. How it responds in int4 and whether the quality is maintained or not. Until I got to the point, on my computer with 32GB of RAM, I was able to communicate with GLM 5.2 with times that, of course, aren't high in cold start, but even then, we're talking about 0.1 tok/s, but that wasn't important to me. The important thing was the journey to reach this goal. I just wanted it to work at all costs, even slowly.
So I created Colibrì, which was born from a very simple idea, to be honest, but tested in every way, where a 744B Mixture-of-Experts model activates only ~40B parameters per token—and only ~11 GB of those change from token to token (the routed experts). So:
The dense part (attention, shared experts, embeddings—~17B params) stays resident in RAM at int4 (~9.9 GB); The 21,504 routed experts (75 MoE layers × 256 experts + the MTP head, ~19 MB each at int4) live on disk (~370 GB) and are streamed on demand, with a per-layer LRU cache, an optional pinned hot-store, and the OS page cache as a free L2.
The engine is a single C file (c/glm.c, ~1,300 lines) plus small headers. No BLAS, no Python at runtime, no GPU.No GPU or serious hardware because I don't have that hardware so I can't test it on hardware that is more powerful than my computer.Colibrì is a one-person project, written and tested entirely on a 12-core laptop with 25 GB of RAM — the numbers above are the ceiling of what I can measure at home.
Any feedback is welcome! (and if anyone wanted to participate in the project I would be delighted)