Inspiration
According to Mayo Clinic, people who sit more than 8 hours a day with little to no physical activity have a risk of death similar caused by obesity and smoking. Majority of white collar workers spend hours per day sitting down in front of screen now, without a sense of time. Sitting down for this amount of time causes a lot of back pain and neck pain. Our goal was to create a simple, accessible way to protect musculoskeletal health by gently guiding users towards better posture through the exercises implemented in the app.
What it does
The application tracks the user's body movements in real time using their device camera. It detects bad posture such as slouching, uneven shoulders, forward head, etc. The app then provides live feedback on your sitting position and statistics on your sitting habits. There are also exercises built into the app to improve your posture by using the same technology to analyze whether you are doing the exercises correctly.
How we built it
We built the front-end with React and Electron for desktop integration. It leverages the MediaPipe library for real-time pose detection via the user's camera. The UI is styled with custom CSS and supports both light and dark themes. The app structure includes modular React components for features like posture analysis, exercise tracking, and session management, all orchestrated within an Electron environment for cross-platform desktop support. Dependency management and scripts are handled via npm.
Challenges we ran into
One of the hardest parts of this project was setting up Electron and React together since it was our first time creating an app using Electron with a UI/UX made from React.
Accomplishments that we're proud of
We are proud to successfully integrate real-time posture detection and feedback using computer vision (MediaPipe) and successfully built a desktop application from scratch in 36 hours.
What we learned
We learned to use MediaPipe for real-time posture tracking, integrating React with Electron to create desktop applications, and debugging cross-platform issues and resolving dependency conflicts in npm projects.
What's next for Motion
Our plan for Motionify in the future is to incorporate more "exercises" tailored towards physical therapy and offer Motionify as a platform for physical therapy providers to offer more effective online physical therapy with the help of our posture tracking technology. This makes it more accessible for patients who aren't the most physically able to commute to the physical therapy office.
Log in or sign up for Devpost to join the conversation.