Inspiration:
Our inspiration for the project was the rhythm video game Osu!.
What it does:
The game operates like a regular Osu! game except it is controlled entirely through moving your fingers in front of your webcam. There will be notes that appear on the screen with an approach circle. You must hover the corresponding finger over the note as the approach circle hits in order to gain points. Notes continue to appear as the song continues and the game will finish when the song ends.
How we built it:
We used the game engine Unity along with the packages Barracuda and MediaPipe to track the fingers.
Challenges we ran into:
Getting the hand tracking to work, creating key features such as the approach circles, sliders + their paths, and beatmapping
Accomplishments that we're proud of
Working finger tracking, getting any shape paths of sliders through Bezier curves
What we learned:
Better time management, how to use Unity with neural networks, and MediaPipe
What's next for Finger Dance!:
If we continue this project we plan on adding more UI, note types and songs along with general polish.
Log in or sign up for Devpost to join the conversation.