A Machine Learning Mobile App for the Hearing Impaired

In a world where 430 million people are hearing impaired and where cars and guns can pose serious danger to people, there is a need for a more accessible solution to help detect dangerous sounds.

Comment 1

Inspiration

Five years ago, my grandma became hearing impaired and thus needed a hearing aid. However, even with the best ones she could find, she still had trouble hearing sounds around her. This can be dangerous as she may not know whether a car is behind her or not as she is walking outside. I wonder if there is a better solution to help her and other hearing impaired individuals navigate places safely and knowingly outside.

What it does

My idea is to train a machine learning model to detect potentially dangerous outdoor sounds like gun shots, car horns, and car engines and then integrate the model into a mobile app to detect sounds in real time for hearing impaired users so they can be notified and move to a safer place, for example, if a car is behind them.

How we built it

Using Python and Google Colab for the machine learning model and using Swift and XCode for the mobile app.

Challenges we ran into

Trying to find a problem and solution by combining several fields together, such as audio classification, machine learning, and mobile app development.

Accomplishments that we're proud of

I successfully found an important problem in the world and came up with a solution/idea.

What we learned

That sometimes inspirations, ideas, and problems can come from your own community, family, etc., and see if a solution can be found to that problem or idea.

What's next for A Machine Learning Mobile App for the Hearing Impaired

To fully develop the mobile app for audio classification, test it on real sounds, and potentially put it on the App Store for free download and usage.

Built With

Share this project:

Updates