Visionairy

Guiding you beyond sight.

Comment

Inspiration

In today's digital age, internet access is often taken for granted. However, for individuals with disabilities—especially those who are visually impaired—this convenience is far less accessible. While tools like screen readers and narrators provide some assistance, they often struggle with complex tasks, such as planning a trip. That’s where Visionairy steps in.

What it does

Visionairy is a service designed to help visually impaired individuals plan their trips effortlessly. Users can simply describe the journey they want to take, and we’ll find the best flight options to make it a reality. The choices are then read aloud, allowing users to respond and refine their selection. This experience mirrors speaking with a travel agent—but in a more seamless and intuitive way.

How we built it

Frontend figma: We designed the webpages, outlined the wireframe, chose a typography, and determined the color scheme on Figma.

next.js, TypeScript, TailwindCSS: We used next.js to create our frontend project and implement the figma design. With TypeScript and TailwindCSS, we were able to more efficiently create our frontend project.

Backend browser-use: A Github project that gives AI access to a Chromium browser. We used browser-use to navigate travel websites and fill out text fields according to the users’ needs. Also, we used GPT 4o to analyze page content and understand complex prompts.

langchain: A framework for developing applications powered by LLMs. We used langchain to build 2 different agents. The first agent aims to interpret the users’ needs and find 3 of the cheapest flights that fit those needs. The second agent’s purpose is to purchase the ticket specified by the user. We also had to integrate browser-use as a langchain tool to be used by our agents. We used mixtral-7b to communicate with the user and pass important information to our browser-use.

Google Speech-to-Text: Transcribe users’ speech from .wav to text.

Challenges we ran into

We ran into an issue where we built a prototype to test the backend but when trying to integrate the same functionality with the frontend we developed, it did not work. Additionally, we ran into issues with certain models not working as expected.

Accomplishments that we're proud of

We are proud of successfully integrating all of the functionality we planned to at the beginning. Additionally, we created a service that is actually usable by the visually impaired.

What we learned

We learned that using apis to call models can be costly when debugging.

What's next for Visionairy

The trip planning process is more than just a flight, we would like to expand our service to hotel booking as well as booking transportation. Furthermore, our service is such that it can be expanded to those who are less technologically savvy and people with other disabilities.

Built With

Share this project:

Updates