Voya

• 

  Screenshot of how the translation works in the WebApp.

Inspiration

I was inspired by the challenges Deaf users face when trying to follow spoken conversations in real time. Existing tools are limited or require manual typing, so I wanted to create a live, automated solution that translates speech into visually readable fingerspelled letters.

What it does

Converts spoken English to ASL fingerspelling in real time.

Supports two display modes: Individual letters – animates one letter at a time for focus. Grouped letters – displays one word at once for faster reading.

How we built it

1) Gather all the fingerspelling for ASL including the alphabets, and the numbers between 0-9 2) Using flask and flask templates(Html, Css) we built a WebApp for easier accessibility for everyone without having to install anything. 3) Implemented the Web Speech API with Flask to capture live speech and process it. 4) Map the characters gathered from Web Speech API to the ASL fingerspelling assets stored in the "assets" folder.

Challenges we ran into

1) Animation speed: Letters needed to be visible long enough to read but not too slow for long sentences. 2) Long sentences: Displaying many letters caused scrolling issues and overwhelmed the user. 3) ASL limitations: Fingerspelling only represents letters; full ASL grammar and expressions are more complex and out of scope for this prototype.

Accomplishments that we're proud of

1) Built a working, live prototype. 2) Implemented smooth UX for pause detection and display modes. 3) Designed a foundation for future ASL expansion, including full signs.

What's next for Voya

1) Expand to full ASL signs beyond fingerspelling using AI and Machine Learning to process everything. 2) Optimize the app for longer sentences and smoother animations. 3) Explore mobile and cross-platform support for accessibility on the go. 4) Support ASL to English translation 5) Add multilingual support

Built With

• css3
• flask
• html5
• python
• webspeechapi