Inspiration
We were inspired by the pandemic and the fact that we all know have to sit through many online lectures or meetings. For some, this may be more difficult as they may be hearing impaired or may not be a native speaker of the other speaker's language.
What it does
This application gives the end user a live captioning window with automatic transcription and translation of the desktop audio.
How we built it
We build the application using Vue on an electron app and used google APIs for real-time speech-to-text and translation.
Challenges we ran into
We ran into many issues trying to use FFmpeg with our application in a way that didn't cause any errors with webpack.
Accomplishments that we're proud of
We're proud to have gotten a stream of audio manipulated in real-time with google cloud computing.
What we learned
We learned how to create electron applications, and how to use google's streaming APIs (gRPC).
What's next for Babel Captions
We would like to improve the translation time, while still making a minimal amount of API calls.
Log in or sign up for Devpost to join the conversation.