Inspiration

Singapore faces an urgent need for innovative, high-tech solutions to address the challenges of a rapidly aging population. With nearly 1 in 11 individuals over 60 living with dementia—and projections of 152,000 affected by 2030—the strain on healthcare systems and caregivers is mounting. Meeting this demographic challenge requires technology that empowers autonomy and relieves caregiver pressures.

What it does

Introducing the Hippo2 Dementia Glasses: an unobtrusive, wearable device that integrates three layers of cutting-edge AI assistance. The first layer is memory support via Computer Vision: the system provides instant facial recognition and a revolutionary Object-to-Action Memory module that logs the specific time and location (e.g., “left your wallet on the kitchen counter at 9:15 AM”), moving beyond simple object naming. The second, most novel layer is the Dynamic Scheduler. This Conversational AI listens to natural, ambiguous dialogue and translates vague phrases like “let’s do that later tonight” into a precise, scheduled reminder, a breakthrough in intuitive senior-tech interaction. The final, critical layer is safety: on-device logic immediately detects high-risk actions, such as a double medication dosage, triggering a life-saving audio-visual warning to the user and a swift caregiver alert via a secure Wokato webhook. By unifying these distinct, powerful AI modules into a hands-free device, Hippo2 offers a sophisticated, practical, and highly impactful solution that directly contributes to a safer, more inclusive Smart Nation.

Challenges we ran into

Latency problems as responses need to be immediate. This is solved through conducting facial detection on the client and heavy logic on cloud. The split allows for real time tracking on wearable hardware.

What's next for Hippo2

Next steps will include revising the laptop prototype to an app (edge processing), possibly integrate with smart homes (smart lock cabinets with Workato) and clinical trials with early stage patients.

Built With

  • fastapi
  • mediapipe
  • openai
  • pinecone
  • webspeechapi
Share this project:

Updates