Context Manager

Inspiration

Seeing the needs of those that wish to use computers with some sort for impairment. Realized accessibility options are a really big thing and very important.

What it does

Intelligently magnifies parts of the screen for the user based on OCR tools and mouse position.

How we built it

We used a OCR library called Tesseract (by Google) along with Qt6.

Challenges we ran into

Implementing a thread safe interface for screen coordinates to be obtained from a thread using the webcam.

Accomplishments that we're proud of

Getting it to work.

What we learned

The QT GUI framework and OpenCV.

What's next for Context Manager

Eye tracking! This was the original idea, but we found that using webcam eye tracking didn't net a great user experience. We would like to add support for hardware eye tracking in the future.

Built With

• opencv
• pytesseract
• python
• qt