https://docs.google.com/document/d/1EDGggyGS0iopP5AeqaRpE19oSx3yOe6fIAkNbQZobRA/edit?usp=drive_link

Inspiration

My mother is a professor at a college, and has told me about the challenges that many of her international students face in the classroom. As well, I have noticed similar struggles with international students in my school, as well as students with learning accommodations in my classes who I believe would benefit from my software.

What it does

Allows students and teachers to record lessons, transcribe the audio into text, translate into other languages (visually and audibly), play back the audio at slower speeds, and summarize the content of lessons for notes.

How we built it

I built the project using Next.js as the core of the project, using supabase for storing lessons and handling authentication, various npm libraries and built in web APIs to handle speech recognition and speech analysis (speech-to-text/text-to-speech), and OpenAI to handle text summarizing with the davinci text engine.

Challenges we ran into

I faced countless bugs and issues related to the design of my site, external libraries which did not fully fit my needs, and multi-browser compatibility.

Accomplishments that we're proud of

I created a fully functioning site that fulfilled my original idea and learned how to do many new things.

What we learned

I learned how to use supabase, which is an excellent cloud-based database that also manages authentication; OpenAI’s API; and Google Translate’s API for translation.

What's next for LessonLearned

My future plans for the project include improving the site's design and the experience for both teachers and users. After refining the site, I plan to promote it to teachers and students within my high school as well as other schools. Lastly, I plan to develop a way to group together recorded lessons and summarize their content together according to their various topics.

Built With

  • next.js
  • openai
  • react
  • supabase
Share this project:

Updates