A'eye' | Devpost

Inspiration

When we thought about an algorithm used to help people, we envisioned an algorithm capable of tracking eye movements. Why you may ask, simple to help hardware or software companies know what the user is looking at, but making the project is not that simple. In virtual reality and augmented reality eye-tracking plays a huge role in the interaction between the user and hardware facilitating the connection. So we created A👁️ a tool to help various hardware and software companies understand the user better.

What it does

It is a fun and amazing tool that can detect every eye movement of the user stores that data and help increase the user experience of various VR and AR devices we use on a daily basis. It can check eye directions, how much we blink, and the look on the eye to detect the changes our iris makes. This could help AR and VR games too. In the future, you might be able to play a game just with your eyes maybe. Not only does it help software companies it could also help normal people, for example, while you are driving our tool could help you concentrate while driving. When you look at the left or right it will tell you to stop looking at the left or right.

How we built it

we created this tool using python, mediapipe, OpenCV, cv2, NumPy, math, pygame, and vscode.

Challenges we ran into

We ran into some challenges not quite often due to our bug fix mindset which helped us to fix errors in the eye detection algorithm faster and being able to test it on the go, played a major role in fixing any bugs we encountered.

Accomplishments that we're proud of

We are proud of the tool's ability to successfully track eye movement and to store the data it gets from the user to be used for improving various software and hardware devices.

What we learned

In these couple of days, we learned soo much about how python can be used to build intensive algorithms and tools used to improve and solve big problems for VR and AR equipment.

What's next for A👁️

We hope to integrate it into various software and hardware and improve eye tracking ability and help solve major eye-tracking tools problems. We are thinking about integrating our eye tracker with games. We want to develop a game that is controlled by only our eyes, for example, we wanted to create a flappy bird game whenever you blink it will flap. We also want to help blind people, we were thinking about integrating AR gear into our project, when a blind person wears the AR gear it will tell them if there are people next to them and will also tell you the direction.