SnaipShot

Innovative memory tracker for people with dementia and alzheimers.

Comment

Inspiration

We were inspired by the need to provide quick, accessible environmental feedback to users, especially in situations where understanding context through sound or visuals can enhance their experience. This inspired the creation of SnaipShot, a tool that gives users audio feedback based on real-time data, helping them stay informed without the need to check screens.

What it does

SnaipShot fetches and summarizes key highlights of the user's day from an API. It offers an interactive HELP feature, which provides environmental context through real-time audio feedback by converting descriptions to speech. It also allows users to view summarized data from their day in a friendly dashboard format.

How we built it

We built SnaipShot using:

Streamlit for the frontend and UI components. APIs to fetch real-time data, including summaries, highlights, and environmental context. A text-to-speech service to generate audio feedback based on the latest data fetched from the API. Python for managing logic, API requests, and audio processing.

Challenges we ran into

API Integration: Ensuring seamless communication between our frontend and various APIs, especially handling different response times and error handling. Real-time audio generation: Implementing smooth playback of audio generated dynamically from the data without delays. State management: Managing session states to ensure audio components and UI elements work cohesively.

Accomplishments that we're proud of

Successfully implementing a real-time HELP feature that provides immediate environmental context through audio feedback. Building an interactive and responsive dashboard that fetches and displays user data dynamically. Integrating APIs to produce a smooth user experience with minimal latency.

What we learned

We gained valuable insights into real-time data handling and the challenges that come with processing and presenting it quickly. We improved our understanding of text-to-speech APIs and their integration into a web app. Managing user sessions and state in a Streamlit app was a valuable experience that helped us design a better user experience.

What's next for SnaipShot

We plan to:

Enhance the audio feedback with more natural-sounding voices and multi-language support. Expand the HELP feature to include visual feedback through diagrams or charts. Implement more personalized data tracking and summaries, giving users deeper insights into their daily routines.

Built With

Share this project:

Updates