New model? New customers? Both??? Your AI workloads are constantly changing, both inputs and outputs, and you need new ways to track success. We will explain how you can do evals at scale, track evals-as-code, and proper experimentation. Join experts from different large-scale SaaS providers to learn how you can evolve, track and constantly improve your measuring and monitoring of AI systems in production.
Max Saltonstall tells stories about the Cloud, how to tell where it’s working (or not), and what diverse solutions our customers have created. He’s part of Datadog’s Advocacy team, with a passion for storytelling, narrative and dad jokes. Max loves to juggle, eat new foods and play games of all types. He lives in New York City with his partner and two children.
Salim Virji develops reliable engineering practices and processes for Google’s SRE organization, and has built consensus and storage services for Google infrastructure. Salim’s interests include distributed systems and machine learning. He has contributed to several books on SRE, including The Site Reliability Workbook and Implementing Service Level Objectives. Salim received an AB in Classics from the University of Chicago and is a New York City Master Composter.
