Most multi-agent demos look impressive, but production systems often fail – not because of model quality, but due to orchestration, context handling, tool access, and evaluation. This talk presents a real-world multi-agent system for enterprise B2B marketing, including transparent agent routing, multi-level memory (session, user, org), and two key workflows: plan-and-execute and discover-and-create. It also shows how the Model Context Protocol (MCP) standardizes tool access and reduces integration complexity. A core focus is evaluation: even high-performing agents can fail together due to cascading errors. A composable evaluation framework and the “compositionality gap” are introduced to diagnose system performance. Finally, lessons on building teams are shared – emphasizing hybrid ML-engineering roles, cross-functional evaluation, and embedding trust and governance from the start.
Sanghamitra Deb is a Senior ML Manager at Adobe, leading the B2B Marketing Applications team on Adobe Experience Platform. Her team builds multi-agent agentic AI systems for enterprise marketing, including orchestration platforms, evaluation frameworks, and personalization engines. She manages a cross-functional organization of ML engineers, data scientists, backend/frontend engineers, and data engineers — and has shaped Adobe's approach to hiring hybrid ML-plus-engineering talent for agentic AI development. She drives technical vision and strategy for the team, from architecting composable evaluation pipelines to leading cross-platform LLM infrastructure migrations that enable the team to operate across multiple model providers with lean, trust-based coordination. Previously, she served as Head of Generative AI at Chegg, where she built multi-modal AI platforms serving tens of millions of students. Sanghamitra holds a Ph.D. in Astrophysics from Drexel University with postdoctoral experience at Argonne and Lawrence Berkeley National Laboratories. She is an active conference speaker — including PyData, ODSC, RecSys, and Grace Hopper — and an advocate for women in technology through WIDS and WiMLDS.
