Inspiration
One of our friend lost his hearing ability. It's very hard for him to take notes during lectures and he has difficulty understanding it as well. So we tried to build an automatic note taker using AI. Any student will be able to use this tool to take notes during class. I have seen many people writing notes instead of focusing on lecture this will help eliminate that behavior and they will be able to get most out of the class.
What it does
Imagine you go to a class. You can start the app and focus on the lecture . At end of the class, you would have a transcript of what happened in the class and summary. We are using android's native speech to text engine which utilizes best in class voice recognition and after that we are sending the transcript to our python AI to get summary using Natural language processing tool .
How we built it
We built using java in the android studio and used microservices to connect to Python AI which is hosted remotely.
Challenges we ran into
We were doing Natural language processing so it was tedious sometimes, We used android's native speech to text api and gensim package for natural language processing. Tweaking the gensim to make stuffs happen was kinda difficult.
Accomplishments that we're proud of
We are very proud of actually putting together a real working prototype by the end of the hackathon. despite many challenges.
What we learned
We learned a lot. team work nlp, gensim.
What's next for Snap Summerize
We will try to put it on the appstore.
Log in or sign up for Devpost to join the conversation.