Inspiration
We really wanted to do a project with computer vision this time around. We settled on creating a system that lets you use simple gestures to control most of the UI functionality on your computer
What it does
The user wears two sleeves on their thumb and index finger, each a different color. We use these as trackers to see where the user's fingers are. They are then able to use gestures to move the mouse, click, scroll and switch between programs
How we built it
We used OpenCV to capture images from the webcam and process the position of the user's fingers. We also used pyautogui which is a library that allows us to control different aspects of the OS's gui.
Challenges we ran into
Originally tried this without any finger sleeves. That produced horrendously awful results and we messed around with that for a while.
Log in or sign up for Devpost to join the conversation.