the tiny corp
@__tinygrad__ · May 28, 2026
tinygrad will write that C for you. Our new driver compiles all interaction with the GPU to C, so once it's running the CPU does next to nothing.
Elon Musk@elonmusk· May 28, 2026SpaceX has almost finished writing V1.0 of an in-house AI training stack in C that exact-maps to 220k GB300s with 800G NICs, making heavy use of pipeline parallelism and getting as close to bare metal as possible.
The potential speed improvement vs JAX for large training runs is
Elon Musk
@elonmusk
Agreed, the CPU cores on the GB300 should be tasked with agentic jobs. Very little of their compute is needed for GPU management.
07:57 PM · May 28, 2026 · 137.5K views
148
156
2.2K