Prompt + Tools = Value; Everything Else Is Infra

On a whiteboard, an agent is prompt + tools + model. In production, that equation grows a long tail: session store, streaming, state management, context compression, memory, file upload, human-in-the-loop, code execution, tracing, auth, stop/resume, multi-agent handoff, evals, security review. The first agent absorbs that cost quietly. The third one doesn’t — by then most teams have three conversation stores, three security reviews, three observability schemas, and no way for one agent to hand work to another.

This talk presents MicroAgents: a microservices-style architecture for agent fleets, drawn from the platform running ThoughtSpot’s AI analytics in production for enterprise customers. Each team owns exactly two things — an MCP server exposing its domain’s tools, and a prompt template encoding its expertise. Everything else belongs to a shared base agent service. Onboarding a new agent becomes a config entry rather than a codebase.

The session covers the microagent contract and why defining it early matters, two orchestration patterns (sub-agent as tool, and full handoff), treating memory as scoped organizational infrastructure rather than per-agent state, collaborative planning across sub-agents, and zero-instrumentation tracing. It also covers build-versus-buy decisions on managed runtimes, why framework choice matters less than the abstraction above it, and where MicroAgents diverge from the Agent Skills model.

Attendees will leave with a concrete architecture for making the marginal agent cost weeks instead of quarters.

About the speaker

Ashish Shubham

VP Engineering and Engineering Fellow at ThoughtSpot

Bio coming soon