The Platinum 10 Minutes. It’s the critical window of time after a medical emergency that can determine a person’s survival. Ambulances typically take around 7 minutes to arrive—25 minutes in cities like Atlanta—leaving bystanders to act without the presence of medical experts after a trauma event. While Apple Watches track various health metrics, they lack clear, user-specific instructions for handling emergency situations.

Our application, HealthDirect, leverages the power of bystanders with clear, spoken instructions tailored to the person in need of medical attention. The iOS application is designed as an Apple Watch add-on that detects life-threatening emergencies by continuously monitoring user data contained in Apple’s HealthKit API for medical anomalies. By harnessing Gemini AI to analyze the user’s stored biometric data, tracked symptoms, and situational context, our tool provides alerts and vocalizes customized, step-by-step instructions that anyone—even without medical training—can follow to act quickly during those platinum ten minutes, equipping bystanders to potentially save a life.

One of the primary challenges we faced while developing the application was having access to only one device, between four developers, that supported Xcode, the only environment in which we could test our program. Choosing, training, and integrating a suitable AI model into the application was also difficult considering our limited prior experience with LLMs. Future directions for HealthDirect include further training and fine-tuning of the AI-generated instructions and triggering an alarm sound when a potential medical emergency is detected.

Built With

  • geminiapi
  • healthkit
  • swift
  • vscode
Share this project:

Updates