Own your inference: Building an enterprise AI factory with platform engineering

Sandeep Kaipu, engineering manager at Broadcom and an expert in enterprise infrastructure platform development, explains how platform engineering transforms legacy enterprise infrastructure into a sovereign AI factory, where inference is treated as critical infrastructure rather than an afterthought. As AI agents proliferate, inference becomes the architectural bottleneck. Kaipu presents a production-tested blueprint for embedding security, compliance, observability, and FinOps directly into opinionated golden paths and pipelines, removing silos without sacrificing governance.

Key takeaways:
• A production-ready blueprint for integrating observability and cost optimization into AI pipelines.
• Strategies for transitioning legacy stacks to AI-ready infrastructure using governed templates.
• Methods to model an AI factory centered on automation and human-in-the-loop alignment.