Math Trainer

Math Trainer is a unique application designed to help students with learning disabilities. Utilizing the latest technology in the field of gesture controlled depth cameras, Math Trainer has stretched the current ability of this equipment. The student sitting in front of the computer will be able to interact with their testing/practicing environment in ways never done before. This will allow the student to stay focused on what they are doing, and help them learn in a “hands on” environment.

If a student does not understand the problem they can simply give the sign language expression for help. In return the help menu will show up, which is not currently implemented, and will assess what the user needs help with based on their previous answers and give them proper guidance eliminating the need for an instructor to go around the room helping people individually.

This application uses raw image data and depth data to turn user gestures into program controls. The user is currently able to sign for help and open up the applications help menu, as well as swipe to select different answers to questions, or change modes to where the user can actually write in the air and have it appear on the virtual notepad eliminating the need for paper and allowing the user to solve their problems in the virtual environment.

My future hopes for this application is to allow others to learn from my programming experience and allow this to be one of my first open-source applications once it is finished. I would like to create an advanced AI algorithm that will assess the user's needs and help them develop the skills to tend to those needs. As of right now that is not implemented and the application just features the based math assessment.

Thank you for taking the time to read my entry and look at my application!

Built With

• .net
• c#
• creativeinteractivegesturecamera
• hardware
• intelpercsdk
• visual-studio
• windows