Inspiration
As college students fighting our way through finals week, we have seen many of our peers experience a decline in their mental health. However, there aren't enough mental health professionals out there that are free and accessible. Sites like BetterHelp are accessible but too expensive. Existing AI therapists are not personable nor compassionate. Our AI therapist has an ultra-realistic voice and an intriguing backstory.
What it does
Dr. Gemini is a virtual therapist which users can speak to. Additionally, our app has a personal diary where users can submit entries that the LLM has access to and can tailor its responses based on the diary. You can save all your health information, including diary entries, height, and blood type, which the therapist can also read and base its responses off of.
How we built it
She uses a version of the Gemini 1.5 Pro LLM that was fine tuned to be more compassionate and personable. We fine-tuned using a synthetic dataset also generated by Gemini. Her realistic voice is created by the Retell AI API. We also RAG with a therapy textbook to prevent hallucinations.
Challenges we ran into
We ran into challenges with Gemini's speed with embeddings. After we figured out RAG in a separate file, we had trouble integrating it into Gemini. Additionally, there was little resources online for integrating Gemini with Retell AI. The sound was also breaking up at one point - we found it was an issue with our web audio protocols.
Accomplishments that we're proud of
We are proud of our overall app design. We feel that it is intuitive and simple to easy, without unnecessary features to complicate users. We are also proud of how realistic it sounds and the speed of the responses.
What we learned
We learned more about how to create an LLM - specifically, fine-tuning and RAG. We also learned about creating a database with ChromaDB.
What's next for Dr. Gemini
We plan to add more textbooks to the database and add a voice entry diary.
Log in or sign up for Devpost to join the conversation.