Specnote

Specnote watches lecture with you using Snap Glasses, generating summaries, concept maps, and key ideas, and then uploads automatically to Google Docs so you can focus on the knowledge, not the notes.

Comment

Inspiration

We've all been there--you're following along with lecture and turn to jot down some notes. Barely a second passes, and all of a sudden the whiteboard is full. You're going to have to spend the rest of class catching up!

What it does

Specnotes runs on Snapchat's Snap Glasses, virtually displaying updating summaries of a lecture, along with key points and concept maps. Afterwards, this content is seamlessly added to a new Google document in the user's drive for later review.

How we built it

Through the Snap Glasses camera and microphone, specnotes gathers visual and audio data and feeds them into Gemini and DAIN to create the study media. A custom DAIN agent formats the content into the Google Doc, and simultaneously the information is sent back to the Snap Glasses to display on an adjustable side-screen for real-time viewing.

Challenges we ran into

Working in Lens Studio; There isn't much documentation, quite buggy and crashes-hard to diagnose Learning to use a DAIN

Accomplishments that we're proud of

Getting photos and voice off of the glasses and being able to communicate with the server Building an entire app in Lens Studio

What we learned

Lens Studio! DAIN Simplicity is best

What's next for Specnote

Live Translation, Voice Prompting, Equation Solver

Built With

Share this project:

Updates