MartialVision

A platform designed to enhance martial arts practice by analyzing and grading movements. The system uses computer vision to compare a user's performance with tutorial videos and provides feedback.

Comment

Inspiration

We were inspired by the Nintendo Wii console. This console featured games like Wii Fit and Wii Sports, offering a variety of physical exercise minigames using the Wii remote controller to map the players position.

What it does

When you want to learn a martial arts technique, simply input a video of the technique you’d like to learn. MartialVision takes a video file as an input, studies it, and maps the body parts of the person. Then, it gives you a chance to recreate the movement. By comparing your movements with that of the video, it gives personalized feedback on how to improve your skills. The gloves and ankle monitors track the acceleration of the wearer’s arms and legs, and then compares it to the acceleration of the video you want to learn in order to check if you have the correct speed.

How we built it

We built MartialVision using OpenCV, microbit IDE, a laptop, and some microbits. We all worked on different components, with some group members focusing on the openCV portion while others worked on creating and coding the gloves and ankle monitors to be used.

Challenges we ran into

Our biggest challenge was trying to connect the microbit to the python code. We attempted to transmit the acceleration of the gloves through bluetooth to the python code, but that was unsuccessful. Eventually, we decided to store this information inside the gloves and use radio waves to communicate.

Accomplishments that we're proud of

  • Successfully learning, adapting and utilising OpenCV in the short amount of time
  • Resolving all major technical issues
  • Bridging the gap between traditional martial arts instruction and modern technology. ## What we learned
  • Leveraging OpenCV and CVZone for motion tracking and video comparison.
  • Integrating Microbits with a software project ## What's next for MartialVision
  • If more time was at our disposal to continue to expand and develop this software, our first step would be to make a better interface that is easier for a normal person to use.
  • Integrate the data recorded live from the gloves and ankle bracelets instead of having them upload the required videos.

Built With

Share this project:

Updates