Real-Time AI Feature Pipelines: From Clickstream to Inference in Production

Real-time AI systems depend on more than model quality. In production, the value of an AI decision often depends on whether the system can capture fresh user signals, transform them into reliable features, serve them within latency limits, and recover gracefully when pipelines or models degrade.

This session presents a practical architecture for real-time AI feature pipelines, using personalization and recommendation systems as the guiding example. We will examine how clickstream events, streaming ingestion, feature derivation, online feature stores, model inference, ranking services, caching, observability, experimentation, and fallback behavior work together to support reliable AI decisions in production. The talk draws from production experience operating these systems at streaming media scale, including concrete failure modes, instrumentation patterns, and operational tradeoffs encountered when serving millions of users.

Attendees will learn how to design AI systems that balance freshness, latency, accuracy, resilience, and business value. The session is especially useful for AI engineers, ML platform teams, data engineers, backend engineers, and architects moving AI applications from prototype to production.

About the speaker

Jayakumar Ramalingam

Staff Software Engineer, Cloud Architect at SiriusXM

Jayakumar Ramalingam is a Staff Software Engineer and Cloud Architect at SiriusXM with over 16 years of experience building cloud-native platforms, distributed systems, real-time data pipelines, and AI/ML-enabled applications at production scale. His work focuses on personalization platforms, recommendation systems, event-driven workflows, and resilient APIs that move AI from experimentation into reliable production systems. An IEEE member and active contributor to the global research community, Jayakumar serves as a peer reviewer for 14+ IEEE and international conferences across the US, Germany, Japan, China, India, and Portugal. His research on AI-driven systems and cloud-native architecture has been published in the International Journal of Software Engineering. His perspective is grounded in hands-on engineering and a focus on building AI systems that perform reliably in production at streaming media scale.