KinectPT | Devpost

KinectPt visualizes an arm raise and records arm degree to compare with previous data.
A graph displaying recent leg raise degrees and progress.
PT, our talking robot, guides users through exercises.
kinect
PT Listening

Inspiration

We wanted to create an innovative healthcare solution that is both useful for patients as well as caretakers. We saw the Xbox Kinect as a perfect physical data visualization tool, capable of analyzing recovery and progress for physical therapy patients while also giving physicians valuable information and feedback.

What it does

KinectPT analyzes and records progress for the following exercises: arm raises, leg raises, and shrugs. It looks at a patient, measure arm,leg, or shoulder raise degrees and keeps track of improvements, letting the patient know if they were able to raise their arms higher than the day before, etc. KinectPT then graphs this data and displays the information on a web dashboard for patients and caretakers to view. During the exercise, an awesome robot head also interacts with the user and gives exercise instructions.

How we built it

We used the Kinect to scan a patients figure, which streamed the data that is viewed to a C# application. This application then measures exercise progress and sends all of the collected statistics to Firebase, where we grabbed the information and displayed on our Angular web application using Chart.js graphs.

Challenges we ran into

One of our biggest challenges was creating a means of analyzing limb degree changes. Another challenge was keeping track of best improvements and sending this information to Firebase.

Accomplishments that we're proud of

PT, our mascot/robot. We built him out of cardboard and tape. He almost died when we short circuited his battery, but now we built a safety catch to keep the red wire from the yellow one. In all seriousness, we were super excited and proud that we were able to record physical improvement by analyzing a user with the Kinect.

What we learned

We learned a lot about the way the Kinect works as well as how to stream data from an application to a web app.

What's next for Kinect PT

We will continue developing in order to make a high fidelity project. We hope to add more exercises and gather more parameters using the Kinect, to give better analysis and more comprehensive data to users. We will also be taking our mascot, PT, and making him a super intelligent AI cyborg.