AUDEYE | Devpost

Inspiration

We wanted to find the intersection between music and technology. How can we created music by looking at the world around us? With Audeye. By watching interpretive dance or simply letting your eyes wander, your eye movement powers the generative music.

What it does

When you look around, the glasses track the movement of your eye and calculate harmonic melodies to play, thereby turning the world around us into music.

How we built it

By using the AdHawk MindLink glasses, we could track eye movement, and with Python libraries, we could produce a vast library of different sounds.

Challenges we ran into

Because of the unlimited possibilities of the MindLink glasses, pinpointing one project was definitely not easy. We came up with many different ideas and even went through them before scrapping them, such as using eye movement to draw and head movement to control the character in a video game. However, what really resonated with us was the interaction between the real world and music. Furthermore, learning and adapting to the nuances and limitations of the glasses was another hurdle we had to overcome.

Accomplishments that we're proud of

We are astounded as first-timers that we were able to complete a project that we are proud to present. Originally, we were all lost without a game plan or experience, but with our heads high and caffeine to push through, we prevailed.

What we learned

Just Start! We wouldn't have finished with a project of this calibre if we hadn't started without an idea or plan. Initially, we were gonna build a Pictionary, but the idea evolved into what it is today through constant brainstorming as we progressed with the Adhawk API.