Beyond Staging

Systems · AI · Infrastructure · Computing

Understanding what happens beneath the software we build.

I learn by understanding systems from first principles, building things to test those ideas, and seeing what happens when they meet reality.

I'm trying to understand how LLM inference actually works.

prefilldecodekv cachebatching
Follow the investigation
View all