EasyNotes

Our project takes in links of videos, can generate a state-of-the-art transcript, summarize the video, and automatically create Anki decks for students by pulling out keywords and their descriptions.

Comment

What it does

Transcription, Summarization, extraction of keywords, descriptions of keywords, and anki flashcard creation; all in one to help you learn!

How we built it

Used Whisper by OpenAI to generate transcripts of videos, used Cohere to generate summaries and extract keyword/description pairs with the help of GPT-3 and genanki to automatically generate anki cards.

Challenges we ran into

Prompt-engineeing, creating Anki decks and downloading them on the user's device, hosting the website using streamlit.

Accomplishments that we're proud of

Created a fully functioning pipeline from start to finish that takes in links of audio or video format and returns the transcript, summary, and automated Anki cards. Completing the project in time!!

What we learned

Using cohere's API for NLP and how to use generative deep NLP models for a wide variety of uses, such as summary.

What's next for EasyNotes

Developing SOTA summarization abilities using inspiration from OpenAI's summarization with GPT-3 paper, using larger Whisper versions to get better transcripts, and increasing the efficiency and parallelism of the whole pipeline.

Built With

Share this project:

Updates