3/19/26

When Does AI Become a Medical Device?

When does an AI chatbot become a medical device, and how do you regulate technology that can change the way it responds to patients?

 

This week on Trying to Keep Up, Allison Komiyama and Michael Nilo are joined by Aubrey Shick, former senior digital health advisor at the FDA’s Digital Health Center of Excellence and founder of Launch and Logic, for a deep dive into generative AI, digital health policy, and how the FDA is approaching technologies that don't always fit neatly into traditional regulatory models.

 

Aubrey brings a unique perspective to the conversation. Before joining the FDA, she spent more than a decade working in product development and user experience. At the FDA, she helped develop and interpret digital health policy, including work involving generative AI and human-centered AI transparency.

 

The group looks at RecoveryAI's recent Breakthrough Device Designation for a physician-prescribed, AI-powered assistant designed to support patients recovering from joint replacement. The designation offers an early glimpse into how the FDA may evaluate patient-facing generative AI within existing medical device frameworks.

 

The conversation also explores the FDA's TEMPO pilot and what its implementation could tell the industry about real-world evidence, enforcement discretion, and emerging digital health policy. Aubrey explains why policy often develops through individual submissions before it appears in formal guidance and why companies working at the edge of existing policy should consider involving the Digital Health Center of Excellence early.

 

The team also examines the FDA's own growing use of AI. With Elsa reportedly used voluntarily by more than 70% of agency staff, they discuss transparency, data security, model dependency, and whether sponsors should know when AI contributes to a product review.

 

Additional topics include:

  • The FDA's new unified Adverse Event Monitoring System

  • Human-centered transparency for patient-facing AI

  • The risks and opportunities of generative AI in mental health

  • What sponsors should know about TEMPO applications

  • How intended use can change a device's regulatory classification

  • A new AI-enabled breast cancer imaging PMA

  • The FDA's request for feedback on 510(k) submission burden

  • CDRH early alerts and device reclassifications

  • Digital health resources that innovators may be overlooking

  • Why FDA databases provide transparency, but not always discoverability

 

Plus, Aubrey explains why digital health sometimes comes down to one fundamental question: “Is this a device, or are we all just having a very expensive misunderstanding?”

Previous

De Novos, Drama & a Very Cool Heart Valve

Next

FDA Hiring, AI Imaging & Ortho Innovation