SummaryTTS

Summarize your text and files just in one click and play the audio to hear the summarized version.

Comment

Inspiration

Our inspiration for the "SummaryTTS" project stems from our commitment to promoting inclusive information access for all individuals, regardless of their abilities. We recognized the challenges faced by people with visual or hearing impairments when it comes to accessing and understanding content from video, audio, and textual sources. To address this, we sought to develop a comprehensive solution that provides multi-format summaries catered to different accessibility needs.

What it does

The primary function of this system is to generate summaries from various sources such as videos, audio files, and text documents (excluding text from images, like scanned pages). It offers these summaries in three different formats: textual, audio, and braille. For individuals without visual or hearing impairments, both the textual and audio summaries are provided. Those with visual impairments receive the audio summary, while those with hearing impairments receive the textual summary. Lastly, individuals who are both deaf and blind are provided with a summary in braille text. This system aims to accommodate different accessibility needs by presenting information in formats suitable for diverse users.

How we built it

We used Python, OpenAI, whisper.ai to make the AI model to summarize the data. We used flask for the backend. For frontend, we used Vite, React.js, TailwindCSS, Flowbite and Vanilla CSS. We also added authentication feature having Google OAuth using Firebase.

Challenges we ran into

We ran into various challenges while building this project. Some of them are as follows:

  • Using firebase for sign in feature including Google OAuth
  • Integrating backend with frontend
  • Sending Data from frontend to backend
  • Making the site reponsive
  • Using React Router DOM

Accomplishments that we're proud of

  • Our AI model is working
  • We integrated flask in our application
  • Sign in feature with Firebase is also working
  • We learnt a lot of things building this project together.

What we learned

We learnt flask and how to make a AI model. We also learnt how to use firebase and make an application that uses React and Flask.

What's next for SummaryTTS

We have many plans for SummaryTTS. As of now we have thought of adding the following features.

  • More Accessibility features
  • Fixing all bugs
  • Sending data from frontend to backend in a proper way
  • Adding more summarization options and helping more people in the society via our application

Built With

Share this project:

Updates