Can you build LLM infrastructure before LLM applications?

Kubernetes might have once been a new project, but it solved old problems. It was inspired by Borg, Google’s internal cluster manager, which had been in production for a decade. And the moment for Kubernetes would not have existed without the innovation from Docker. And before that, the applications motivated the design of cluster management and containerization.

The problem is amplified in MLOps — I reflected on my work in MLOp infrastructure in 2018 in lessons from the last AI cycle,

> The hypothesis that the next generation of startups would mimic the machine le