Studeye | Devpost

Our beautiful site.

Inspiration

Our inspiration came from all the new AI tools to assist in studying. We had previously seen a note-taking Chrome extension that can read and summarize slides, and we thought "How could we make this even more convenient?". Nothing is more convenient than using your eyes, so we decided to make a note-taking application that uses eye tracking and eye gestures to record and summarize notes.

What it does

Studeye was designed to allow users to take notes and look up definitions in a moment's time. The user's eyes are tracked by MindLink glasses, and the gaze is mapped to the user's screen in order to determine what is being read. The user can then wink or use other facial gestures to take notes using AI tools.

How we built it

We built this project using Next.js and TailwindCSS for the website, for the actual gaze tracking, we used Python and the Adhawk SDK.

Challenges we ran into

Our largest challenge was undoubtedly the lack of documentation for the Adhawk SDK. This made working with the MindLink glasses an incredibly taxing task, and more or less required us to learn through trial and error. In addition, the glasses began behaving abnormally on the last night. We were unable to receive a replacement, nor any help, as the Adhawk team had unfortunately already left at this point.

Accomplishments that we're proud of

We're proud of the fact that we have a working front end, as well as all of the AI components. Also given the complexity of the eye tracking, we're proud of the progress that we did make.

What we learned

We learned the utmost importance of documentation when choosing what libraries to use for a project. We completely lacked the resources to figure out how to fully build our idea in the time given, our mistake was not fully realizing this and adjusting early on.