Turning Generative Models into Reliable System Components
Generative models are increasingly embedded in production systems, yet their outputs remain probabilistic and difficult to trust. This talk presents a systems approach to making generative AI reliable, testable, and governable. Drawing from real world implementations, it outlines how to treat model outputs as components within a controlled execution layer rather than final responses. The session introduces patterns such as deterministic validation pipelines, layered output checks for safety and accuracy, and arbitration mechanisms that enforce fixed decision rules. It also covers how to design for replayability, auditability, and consistent behavior under the same inputs. Attendees will learn how to integrate these patterns into existing services without slowing down development velocity. The focus is on practical architecture and measurable impact, including reducing production risk and improving confidence in AI driven decisions. This approach reframes generative models from unpredictable tools into dependable building blocks for critical systems.
About the speaker
Nirmal Kumar Jingar
Sr. Engineering Manager at Wayfair
Nirmal Jingar is a technology leader at Wayfair, where he drives large-scale distributed systems and AI-powered engineering initiatives. He leads the evolution of critical platforms in Supply Chain. Nirmal is passionate about applying generative AI to accelerate software development, from automated code generation to root cause analysis and system modernization. He has led initiatives to improve engineering productivity through AI-assisted coding, automation, and architectural transformation, including efforts to migrate legacy systems to modern, resilient microservices. He regularly writes and speaks about AI in engineering, system design, and building high-performing teams.