Expressify | Devpost

Inspiration

We were inspired by the fact that around one in five adults aged 18 and older experienced symptoms of either anxiety or depression in the past two weeks. Specifically, 18.2% reported anxiety symptoms, while 21.4% reported depression symptoms. Music plays a significant role in emotions and mental health, often reflecting one's state of mind. We wanted to explore whether a user’s music preferences could provide insights into their mental well-being and offer helpful suggestions based on those insights.

What it does

Expressify analyzes a user's most played songs on Spotify to determine if their listening habits suggest signs of anxiety or depression. A user logs in with their Spotify account, and Expressify instantly evaluates their top tracks, providing a breakdown of potential mood indicators.

Additionally, the app includes a generative AI feature that interprets the user’s music data and provides:

Potential reasons for their emotional state based on their listening history.
Actionable advice on how to manage their emotions.

How we built it

Frontend: Built using React, ensuring a seamless user experience.
Backend: Powered by Flask, handling user authentication and data processing.
Spotify API: Fetches user data, including top tracks, and analyzes trends.
OpenAI: Used to assess emotional patterns in song lyrics and themes.
Generative AI: OpenAI’s API provides personalized insights and coping strategies.

Challenges we ran into

Spotify API Authentication: We had a very difficult time getting the authentication to work there was an issue with storing the authentication token
Implementing AI response system and displaying anxiety and depression levels Getting the necessary data for analysis by GPT was a very big issue of ours as well

Accomplishments that we're proud of

Successfully built a user-friendly frontend interact frontend
We are were able to pivot and be flexible, originally we were oriented our idea around Twitter but had to change to Spotify since the API was too expensive

What we learned

How to work with Spotify API efficiently to extract meaningful user data.
The importance of context in sentiment analysis, especially in music.
Best practices in handling sensitive topics like mental health responsibly.

What's next for Expressify

Expanding music analysis to include listening patterns (e.g., time of day, frequency).
Enhancing AI responses with more in-depth mental health guidance.
Collaborating with mental health professionals to improve Expressify’s accuracy.
Mobile app version to make Expressify more accessible.
Community features where users can explore uplifting music recommendations.