Inspiration
Studying and working are completely different. But, one common thing between experiencing a study term and an internship that we noticed was that sometimes we wanted to have someone to talk to. But, evidently that's sometimes impossible, so given that we wanted to explore a little bit with AI and our drive to solve our problems for future terms (where school only gets harder), we brought λlbert to life.
What it does
λlbert is your best friend! it simply requests you to talk (with your voice!) about something that you want to get off your chest. Then, based on that and what's been happening in the conversation previously, it will respond to you. This can be used in multiple ways -- therapy, entertainment, and so on. λlbert will never get bored of you, and frankly you also won't get bored of λlbert.
How we built it
To run the backend, we use NodeJS and Express to manipulate given data to make calls to the Cohere API. This made the logic and error handling relatively simple, as our complementing frontend was built with HTML, CSS, and Typescript. The audio recordings that were taken in were converted to text using Assembly AI, and then the brains of λlbert were made using the Cohere API.
Challenges we ran into
Sometimes, the Assembly AI API was returning values a little slower than expected. We ended up taking it as a positive though, as we were able to have a reason to implement promises to have a loading icon. :) The audio format that was used to record the audio wasn't compatible with Assembly AI to process and transcript it, so there were some troubles with using conversion to binary to change the file formats internally. It took some time, but eventually worked smoothly. Finally, we were aiming for a really clean interface that looked inviting for people to want to vent out to without looking too intimidating. So, there were lots of discussion and disagreement with the design of the page, and how much info we wanted to have on there. Eventually though, we landed on a design that we believe to be pretty clean.
Accomplishments that we're proud of
After working and testing Assembly AI with multiple different tests of file formats, things started to make sense of how it was working under the hood. Once we were able to do this, it became much easier to program the transcription and process it. As mentioned earlier, we believe we landed on a pretty simple but effective UI. For people with not the greatest artistic sense, that feeling always has a special place in our hearts. :)
What we learned
A big realization was that even understanding the shallowest of levels of one's personality can go a long way. Seeing how λlbert's adversity was only being more effective as the conversation continued even though sometimes responses started off very well, it became very eye-opening to how much problems and thoughts in one's mind can be influenced simply with another opinion.
What's next for λlbert
λlbert has lots of room for improvement, from simple areas like speed to more training to give even better responses. We would love to incorporate λlbert into different applications in the future, as we realize it is very light weight compared to a lot of software, but can come a very long way in helping someone in some way.
Built With
- assembly-ai
- cohere
- css3
- express.js
- html5
- node.js
- typescript
Log in or sign up for Devpost to join the conversation.