The Medical AI Scorecard: Accuracy, Cost, And Responsible AI Across The Patient Journey
Every year the frontier models get better, and every year specialized medical models stay ahead on the tasks that matter in healthcare. This keynote publishes the latest scorecard of how John Snow Labs’ medical language models compare to the current frontier LLMs on three axes that decide real deployments: clinical accuracy, cost at population scale, and responsible AI. The accuracy numbers span medical question answering and clinical extraction; the cost numbers reflect fixed-cost, single-GPU deployment against API pricing; and the responsible-AI numbers come from reproducible validation, monitoring, and governance through Pacific AI, because “responsible” has to be measured, not asserted.
We then turn from models to architecture. The pattern emerging across the field is that you don’t win healthcare AI by owning the best model; you win by building the governed data foundation that lets many accurate, auditable agents run on top of it, connected through an open protocol like MCP. That governed data foundation is where regulatory-grade healthcare AI is won or lost, and it is what lets agents reason accurately about the whole patient and turns each new application into configuration rather than a rebuild.
About the speaker
David Talby
CEO at John Snow Labs
David Talby is the CEO at John Snow Labs and Pacific AI, helping companies apply artificial intelligence to solve real-world problems in healthcare and life science. He has extensive experience building and running web-scale software platforms and teams – in startups, open-source projects, and previously at Microsoft and Amazon. David holds a Ph.D. in computer science and master’s degrees in computer science and business administration. He was named USA CTO of the Year by the Global 100 Awards in 2022, Game Changers Awards in 2023, and ACQ5 Global Awards in 2025.