Awni Hannun
@awnihannun · Mar 5, 2026
Inference compute is on track to be a massive computational workload by the end of this decade. I think it will be much bigger than training (especially if you consider RL rollouts / inference needs for training).
And it's still an open playing field in terms of the hardware,
Elon Musk
@elonmusk
The future is overwhelmingly inference
01:46 AM · March 5, 2026 · 137.5K views
200
158
2K