Reflexion Buddy

Mood tracker
Mood heatmap

Introduction

Imagine having a trusted companion who listens to your thoughts, helps you reflect on your day, and supports your journey to improved mental health. Introducing Reflexion Buddy, your AI-based journaling partner bringing increased enjoyment and accessibility to the journaling process! Our project is designed to empower individuals to embrace the benefits of reflection through journaling consistently. We believe that taking time to reflect is a powerful tool for enhancing mental well-being and personal growth, which is an approach backed by science and used by countless successful people who attribute journaling to their success, productivity, and overall well-being.

Inspiration

The inspiration behind Reflexion Buddy comes from the increasing importance of mental health and well-being in today's fast-paced world. We live in an age where stress, anxiety, and burnout are prevalent, and many people struggle to find time for self-reflection. We wanted to create a solution that encourages individuals to prioritize their mental health by making journaling a seamless, accessible, and enjoyable experience.

What it does

Reflexion Buddy offers a seamless journaling experience by transforming spoken words into written entries through Voice-to-Text Journaling. It supports multiple languages and goes beyond mere transcription. It also engages in meaningful two-way conversations It then takes journaling a step further by summarizing these entries, inferring key themes, and generating images that encapsulate the main ideas. Beyond documentation, our AI system also performs Emotion/Sentiment Analysis to help users track their emotional journey over time. These insights are organized into a personal digital diary, providing users with a convenient way to reflect on their thoughts, experiences, and personal growth.

Reflexion Buddy has the following features to improve both the accessibility and personal impact of journaling:

Language picker: To allow users of any language background to use the app
Speech-to-text: For those who have difficulty typing/writing, or just enjoy voice-based journaling more
Response interaction: To provide insightful questions and feedback on the journal
Image generation: To make the journaling experience more enjoyable and visual, thereby increasing the probability that someone will journal
Text-to-speech: Reads responses out loud to users
With these innovations, we are certain that users' mental health and well-being will be positively affected, and the journaling process will become more accessible.

How we built it

We harnessed a diverse array of technologies to create a comprehensive journaling platform. Powered by Streamlit and coded entirely in Python, our project integrates five essential AI components: IBM Speech to Text for effortless voice-to-text transcription, GPT-4 Chat for engaging conversational capabilities, GPT-4 Summarize for insightful content condensation, DALL-E Stable Diffusion for generating meaningful visual representations, and Google Text-to-Speech for interactive communication. We leveraged IBM Watson Natural Language Understanding for sentiment analysis, allowing users to track their emotions over time. Additionally, MATLAB was employed to craft intuitive mood visualizations. This amalgamation of AI, programming proficiency, and data visualization expertise has culminated in Reflexion Buddy, a versatile and user-centric journaling solution.

Challenges we ran into

Certainly! Here's the list of challenges we ran into in bullet point format using markup language:

Initial Idea:
- Challenge: AI medical assistant limitations.
Pivot to Mental Health Support:
- Challenge: Finding a reliable LLM model for mental health.
Technical Challenges:
- Setting up IBM Cloud and understanding IBM speech-to-text API
- Incorporating IBM Natural Language Understanding API.
- Using OpenAI API effectively.
- Providing context and intent to GPT-4.
- Generating meaningful images from text.
- Integrating different components.
- Creating a PDF from the conversation data.

Accomplishments that we're proud of

We are proud of completing the development of all the features on time. We are also proud of how we pivoted to a better idea and had a seamless collaboration among our teammates by dividing the work efficiently. We learned a lot about various APIs and different technologies.

What we learned

We've learned the importance of adaptability and pivoting in response to challenges. We gained hands-on experience in integrating multiple AI technologies, cloud services, and sentiment analysis, strengthening our skills in AI development and interdisciplinary collaboration.

What's next for Reflexion Buddy

We envision transforming it into a comprehensive mobile application. Users will have the opportunity to create individual accounts, providing them with a personal diary that spans 365 days. This extended functionality will allow users to maintain a year-long record of their thoughts, emotions, and personal growth while benefiting from AI-powered features for enhanced mental well-being.

Additionally, we plan to further enhance its capabilities by incorporating more advanced AI models, expanding language support, and refining the user experience. We aim to integrate additional features for personalized mental health insights, such as mood trend analysis and actionable recommendations. Additionally, we plan to explore partnerships with mental health professionals to ensure Reflexion Buddy becomes a valuable tool for individuals seeking emotional well-being.