VisuaLearn | Devpost

Asking VisuaLearn how to perform computer tasks
VisuaLearn always on top overlay feature
Settings page

Problem Statement

As our world grew to embrace technology, digital literacy skills have become crucial for living in our modern society. Being able to navigate research tools, financial platforms, social platforms and function effectively in a modern workplace is a must have skill. However, not all communities share this level of digital literacy. Lack of high speed internet in many communities has caused people living there to have lower tech skills. The lack of infrastructure in communities is a consequence of centuries of social division and redlining, which is further exacerbating the social and economic disadvantages in society (source). This is also a large issue for those who are older, who didn't grow up with technology and are struggling to navigate it today. As a result, there is a clear gap in the world for ways to teach people how to use technology in a way that is non-intrusive to a full-time worker. The goal of this project is to meet the need for an intuitive, accessible and simple to use tool that aids people with technology use. To be feasibly implemented, the project is scoped to be a computer program, to make it easy for us to develop and distribute.

What it does

VisuaLearn is a desktop application that leverages Google's Gemini AI to provide a powerful chat interface with both text and image capabilities. The application allows users to interact with Gemini using text messages, upload images for analysis, and even capture screenshots directly within the app.

How we built it

VisuaLearn is an Electron app with a React + Typescript + TailwindCSS frontend, built using Vite tooling. It uses Google Gemini API for the chatbot interactions.

Challenges we ran into

The biggest challenge was navigating unfamiliar frameworks and tools, and successfully integrating Gemini into our program.

Accomplishments that we're proud of

Our biggest accomplishment was successfully developing a MVP in one day of hacking, with no prior electron experience.

What we learned

We learned how to build Electron apps with a react frontend, how to integrate Google Gemini API calls into a responsive and interactive chatbot UI, and how to think creatively to apply our technical skills to real world social issues.