Inspiration
One of our team members had worked with the Leap Motion at a previous hackathon, so we decided to give it another try and help people to learn sign language.
What it does
It allows the addition of hand signs to the program and then allows users to practice the hand signs by matching them within 3D space.
How we built it
We used the Leap Motion Unity SDK to track hand movements to store the hand signs and then match against them to practice.
Challenges we ran into
We had various troubles implementing the Leap Motion within Unity. Trying to set the positions and rotations of the hands stored in the library proved difficult since they were using a different base position and rotation than the Leap Motion hands.
Accomplishments that we're proud of
We managed to actually get a working proof of concept for the program.
What we learned
We all gained a better understanding of Unity and the Leap Motion interface. We also learned basic sign language overnight.
What's next for LeapLearning: Sign Language
We can expand on the hand poses that are stored within the program. Eventually we would like to add the ability to convert sign language to text and text to sign language.
Log in or sign up for Devpost to join the conversation.