ConsentIQ | Devpost

Our Goal

Our goal is to help surgeons connect better with their patients, and to improve that relationship. We want to help make sure that patients understand what it is that they’re going through to improve their understanding and experience.

Purpose

This is for use for a surgeon to show to their patient so that they can see both the official medical form and a simplified, understandable version of it that retains all the key information, to make sure that a patient understands everything.

How it’s Built

Our application is mostly built using JavaScript, while using other frameworks, tools, and languages. The React framework along with CSS and HTML were used to create the frontend. The backend was built with JavaScript, also using Node and Express, with the Gemini API being used for response parsing, and ElevenLabs API for text-to-speech.

Challenges Faced

We had difficulty with using the ElevenLabs API and integrating its Text-to-Speech feature with the simplified text and definitions into the application. There were also challenges in learning how to integrate the Gemini API to create the simplified language summary, along with figuring out how to optimize its speed in displaying its response.

Accomplishments and Achievements

We were able to build a system that integrates several frameworks, tools, and AI API’s to better the experience and relationship of patients and surgeons in an important scenario.

What we learned

As all first-time Hackathon participants, we had to learn how to work with API’s, as well as using frontend frameworks like React, backend tools like Node and Express, and collaborating as a team to make sure we all worked together and optimized our work.

What's Next?

With this project, there are certain aspects we would wish to improve should we move forward. Most importantly, we would wish to optimize the speed of the application, working so that the simplified language summary and language translations generate significantly faster to improve interaction between surgeon and patient. Another optimization we would like to add is a simplified language response that’s more accurate to proper medical terminology and examples seen in official medical resources used by surgeons and doctors. While we already worked on this, focusing more on this would ensure that accurate information is provided and never changed or lost due to how Gemini might interpret the medical form. Another feature we would like to add is support for more languages, as having support for more languages lessens the possibility that a patient wouldn’t be able to make use of the simplified summary and so that they could read in their preferred language.

First-Time Hackathon participants