Inspiration
We wanted to do something with computer vision and this is what we came up with!
What it does
The program tracks your hand movements through your webcam, which is then used to allow users to control an on-screen keyboard or a virtual mouse using hand gestures.
You can collapse your hand to left click and rotate your hand to switch modes.
How we built it
We built this using OpenCV and a lot of other Python libraries like PyQt and keyboard.
Challenges we ran into
Fine-tuning the hand tracking was very difficult. It was also very difficult to get OpenCV, PyQt, and the other Python libraries we're using to cooperate.
Accomplishments that we're proud of
Our main motivation for this project was doing a project with computer vision, as none of us had ever made one before.
What we learned
We learned how to leverage OpenCV for computer vision tasks, as well as how to use mediapipe for image recognition tasks. Additionally, we used PyQT for our GUI, which was most of our team members' first times using the library.
What's next for SeeBoard
Potentially adding an autocomplete feature using AI since typing with this software is rather slow
Log in or sign up for Devpost to join the conversation.