LLMday

Large Language Models, Agents & AI Systems

March 6, 2026 VIAM, New York, US

1
Day
10+
Speakers
1
Track
100+
Attendees

10 Lessons from building High-Stakes Agents

Ahsan Ali
AWS
Abstract

Moving Generative AI from proof-of-concept to production in high-stakes industries like Fintech and Healthcare requires a fundamental strategic shift. Drawing from real-world deployments at the AWS GenAI Innovation Center, this session explores ten critical lessons learned building autonomous agents for complex use cases. We will dive into "Model as a Judge" evaluation frameworks, architectural trade-offs between rigid pipelines and flexible agents, and why hallucinations are essential signals for system optimization. Attendees will receive a framework for prioritizing accuracy, building auditable reasoning chains, and creating internal feedback loops for self-improving deployments.

Bio

Ahsan Ali is a Senior Applied Scientist at the AWS Generative AI Innovation Center at Amazon, where he works on applied artificial intelligence and generative AI solutions. Prior to joining AWS, he was a postdoctoral researcher in the Data Science and Learning Division at Argonne National Laboratory. Ahsan earned his Ph.D. in Computer Science and Engineering from the University of Nevada, Reno in 2021, and previously completed his M.S. and B.S. in Computer Science and Telecommunication Engineering at Koç University in Istanbul, Turkey.

Video

Sponsors & Partners

Want to become a sponsor? Get in touch!
Let's talk!
We'll email you and share prospectuses for relevant events.
We'd like to (one or more)
Pick at least one
Conferences (one or more)
Pick at least one
Regions (one or more)
Pick at least one
Budget
Pick one