LLMday

Large Language Models, Agents & AI Systems

October 14, 2026 The Sunset Room, Austin, Texas, USA

1
Day
11
Speakers
1
Track
60
Attendees

LLMday is a worldwide series of community events for engineers building with large language models, AI agents and machine learning. Across cities around the world, we bring together practitioners working on AI-powered products and systems to share real-world experience, learn from each other and explore how software engineering is changing in the age of AI.

Companies presenting:

7-Eleven, Amazon Lab126, AstraPack, Genomenon, Isiro AI, MakingFriends.app, Puplampu Consulting, RiskScout, Superbuilders, Today Mechanic, Upheal

Topics so far:

This is a past event, what's next?

Schedule

October 14, 2026 • single track • 8:30AM - 4PM • Austin, in‑person
View
Main room

08:30

Registration and coffee

Main lobby

09:00

Rahul Azmeera

Visual AI Testing Agent: Screenshot-First Mobile UI Test Automation for iOS Simulator

7-Eleven
Our research introduces Visual AI Testing Agent, an agentic framework designed to revolutionize mobile UI automation for iOS Simulators by leveraging Vision Language Models (VLMs). Unlike traditional locator-based tools like Appium or XCUITest, which often fail due to unstable identifiers or dynamic UI changes, our VLM-driven approach treats the screen as the primary interface. The agent captures the screen, processes visible elements through vision-based providers, and executes actions with human-like visual understanding. This talk will demonstrate how this agentic architecture enables predictive test case generation and provides development teams with actionable, early-stage insights. By shifting to a vision-first paradigm, we enable more robust, resilient, and intelligent automated testing cycles.... Read more

09:30

Geoff Niehaus

One LLM Call Is the Wrong Default

Today Mechanic
The typical default is one call to one model, and when that gets expensive, we cascade to something cheaper. Both accept the same premise: the input is one question. Usually, it isn't. A single photo, document or utterance carries several distinct questions, and one model answering all of them hands you its weakest answer in its most confident voice, at full price, every time. A cascade only changes the price. This talk makes the case for treating the input as a routing problem. Cheap classifiers decide which question you have, and each question goes to the model genuinely best at it, including the times the honest answer is that no model should answer. In our case we brought token spend under control, took a seventeen second wait down to under a second on the path that can prove its answer, and cut wrong answers from 25% to near zero.... Read more

10:00

Rodney Richard Puplampu

Ogummaa Agent Portal. Architecture & Security Blueprint for Long-Horizon Agents

Puplampu Consulting
The Ogummaa Agent Portal is a comprehensive, sovereign AI workspace designed for secure, long-horizon task automation and conversational knowledge retrieval. The platform utilizes a decoupled microservices architecture—comprising an Admin Portal, Central Gateway, and Ingestion Pipeline—to ensure elastic scalability and rigorous environmental isolation. Its core engine, a GraphRAG (Graph Retrieval-Augmented Generation) and VectorRAG system for analytical graph processing, geo-spacial-temporal correlation, enabling sophisticated retrieval across massive enterprise datasets. The portal enforces a robust security paradigm through per-user sandbox isolation, a four-layer guardrail system, and a "bring your own secrets" model, while supporting unattended execution for recurring routines. By blending autonomous self-improvement loops with immutable event-based telemetry, and provides an enterprise-ready infrastructure for organizations prioritizing data sovereignty, multi-agent orchestration, and resilient AI deployment.... Read more

10:30

Maryam Astero

One Thing, Many Names: Building Reliable Entity Mapping

Genomenon
LLM systems are getting very good at extracting entities from messy documents. But extracting a mention is only the beginning. The harder problem is deciding what that mention actually refers to. A single real-world entity can appear under different names, formats, abbreviations, and contexts across documents and databases. At the same time, different entities can look remarkably similar. A reliable system therefore needs more than entity extraction or similarity search. It needs a mapping step that decides which candidate, if any, represents the entity being described. This is where similarity becomes both useful and insufficient. Database search, lexical matching, and embeddings are powerful ways to generate and rank candidates. But a high similarity score does not make a candidate the correct mapping. The system still has to account for ambiguity, context, available evidence, and what happens when no candidate meets the evidence threshold. Sometimes the right decision is not to map at all. This talk looks at entity mapping as a distinct engineering problem in an LLM pipeline: using structured search and semantic similarity to find plausible candidates, understanding where those signals break down, and designing the decision layer that determines when a candidate is good enough to map, and when the system should abstain. The goal is not to replace similarity with something else. It is to understand where similarity fits, and where the identity decision begins.... Read more

11:00

Nick Smith

AI-Native, Not AI-Reactive: Rethinking How We Build Companies and Careers

AstraPack
The most resilient companies will not bolt AI onto yesterday’s operating model—they will build with AI as part of the work from day one. This AI-native approach allows new companies to design roles, workflows, and teams intentionally, reducing the need for disruptive reactions when technology advances. The same principle applies to an unconventional career: candidates can use AI to research opportunities, identify decision-makers, track applications, prepare for interviews, and strengthen their day-to-day capabilities without outsourcing their judgment or agency. Drawing on more than a decade in recruiting and his experience building AstraPack, Nicholas will show how companies and candidates can develop their “AI muscle” early and remain competitive as the nature of work continues to change.... Read more

11:30

Leila Anderson

Evaluation Without Ground Truth: Lessons from Expert Disagreement

Upheal
Most LLM evaluation assumes a gold answer exists to score against. A large and growing share of production work, however, doesn't have one: contract review, clinical documentation, incident summaries, moderation calls, research synthesis — any task where correctness is a matter of expert judgment, and where two qualified experts given the same input produce different outputs that are both defensible. If you score that as if a single right answer existed, you collapse the errors that matter — a fabricated fact, a dropped material detail — into the same number as the ones that don't, like structure, emphasis, and phrasing. This talk is about building evaluation for those systems, where the ground truth isn't a fixed key but a distribution of expert opinion, and where disagreement is built into the problem rather than a symptom of bad labeling. It unpacks three moves that improve accuracy and trustworthiness: treating inter-rater reliability among your experts as the ceiling on any eval you can build, using expert corrections as a live quality signal instead of a static gold set, and separating "genuinely wrong" from "differently right" so the score tracks the failures you actually care about.... Read more

12:00

Lunch & networking

Main lobby

13:00

Colby Mainard

Invisible Data - The Largest Problem Facing AI

RiskScout
No matter how well an AI pipeline is designed, it will always be limited by both quality and quantity of available data. However, real-world data rarely arrives nicely packaged and pre-normalized. In fact, it is probably safer to say that real-world data is the number one saboteur of existing machine learning applications. This talk will go over common data problems that have been seen in enterprise systems and the importance of curating data for pipelines of all varieties.... Read more

13:30

Kunle Olutomilayo

30% More KV Cache Headroom, 100% Accuracy

Isiro AI
Self-managed AI model deployments on-prem and in private cloud infrastructure are becoming increasingly popular, accelerated by open-weight models that rival frontier models. But deploying them needs accelerators (such as GPUs) with large and expensive memory. The usual ways to save that memory quantize or approximate the model, thereby changing its output and affecting accuracy. This talk removes that tradeoff. It covers lossless compression of both model weights and the KV cache, across BF16, FP16, FP8, and FP4, delivering around 30% more GPU headroom with identical model output. Weights are bit-for-bit exact with cryptographic hash verification, and stay compressed in GPU memory while they run. Freeing weight memory leaves more room for the KV cache, and the KV cache is then compressed on top. In deployments that are already memory-constrained, this results in cases of up to 110% more KV cache headroom, raising usable context length, batch size, and concurrency. The talk frames bit-exact KV cache compression as the next lever for lossless inference efficiency.... Read more

14:00

Matt Barge

Selling Commercial Real Estate with Grok Bot

Superbuilders
This talk is a field report on using Grok Bot to sell commercial real estate. I’ll show the live stack I used on real deals: Grok Bot as the operating layer across buyer inbound and follow-up, Quo for the sales phone line and texts, a dedicated /buy sales website and deal room, Google Drive diligence packs, and offering memorandums, all powered by Grok Bot. We’ll cover what the agent actually does day to day (watching inbound, drafting first-touch that leads with income, logging buyer calls, keeping board copy and the OM in sync, chasing listing-agreement issues) and where humans still have to approve sends. Expect concrete CRE examples, the connectors and artifacts that made it work, and the failure modes that show up when an agent touches real buyers.... Read more

14:30

Vashishtha Patil

Auto-Research on a Budget: Small Models in the Loop, Frontier Models on Call

Amazon Lab126
Autonomous research agents that propose, implement, and refine ML solutions have become remarkably capable. Yet most rely on frontier models throughout the research loop, creating substantial inference costs that limit their scalability and accessibility. This talk explores a resource-efficient alternative: a small open-weight model autonomously drives the research loop, while a frontier model serves as an on-demand advisor operating within a constrained inference budget. Drawing on principles of efficient AI inference and resource-aware AI engineering, we'll explore how inference-time decision-making, adaptive model routing, and dynamic compute allocation can balance model capability, inference cost, and research quality. We'll examine existing work on small-large model collaboration, agent distillation, and budget-aware inference, while addressing the challenges of long-horizon autonomous workflows, including unproductive exploration, error accumulation, and inefficient resource utilization. We'll introduce a framework for deciding when expensive model guidance is worth its cost, how much context the advisor needs, and how to measure its impact on research outcomes. A recorded demonstration will illustrate the autonomous research loop, intelligent advisor invocation, and inference budget utilization. The session concludes with open challenges in asynchronous model collaboration, persistent guidance, and engineering scalable, resource-efficient autonomous AI systems.... Read more

15:00

Nate Lemos

My wife is a vibe-coder. So, what now?

MakingFriends.app
My wife, who doesn’t have any technical background, built a real app with AI, that she uses every day. So if someone with no previous experience can build working software now, what’s left for software engineers? During this presentation we'll explore what makes a software engineer relevant in the AI era. An engineer needs to know foundations, judgment, responsibility... Programming is easier. Software engineering isn’t.... Read more

15:30

Networking & sponsor crawl

Main lobby

16:00

Wrap up

Scan each other's QR codes & head to a nearby pub!
Main room
  1. 08:30
    Registration and coffee
  2. 09:00
  3. 09:30
    One LLM Call Is the Wrong Default
    Geoff Niehaus · Today Mechanic
  4. 10:00
  5. 10:30
  6. 11:00
  7. 11:30
  8. 12:00
    Lunch & networking
  9. 13:00
  10. 13:30
    30% More KV Cache Headroom, 100% Accuracy
    Kunle Olutomilayo · Isiro AI
  11. 14:00
    Selling Commercial Real Estate with Grok Bot
    Matt Barge · Superbuilders
  12. 14:30
  13. 15:00
    My wife is a vibe-coder. So, what now?
    Nate Lemos · MakingFriends.app
  14. 15:30
    Networking & sponsor crawl
  15. 16:00
    Wrap up

Speakers

Colby Mainard
RiskScout
Geoff Niehaus
Today Mechanic
Kunle Olutomilayo
Isiro AI
Leila Anderson
Upheal
Maryam Astero
Genomenon
Matt Barge
Superbuilders
Nate Lemos
MakingFriends.app
Nick Smith
AstraPack
Rahul Azmeera
7-Eleven
Rodney Richard Puplampu
Puplampu Consulting
Vashishtha Patil
Amazon Lab126

Venue

The Sunset Room

310 E 3rd St, Austin
TX 78701, United States

Sponsors & Partners

Want to become a sponsor? Get in touch!
Let's talk!
We'll email you and share prospectuses for relevant events.
We'd like to (one or more)
Pick at least one
Conferences (one or more)
Pick at least one
Regions (one or more)
Pick at least one
Budget
Pick one