Inspiration
Grzeg was sick last week causing him to miss all his lectures. This gave him the genius idea to generate lectures on an INFINITE number of topics from the comfort of his own bed.
What it does
Takes in a prompt from a user in Unity, this prompt is input into OpenAI's API, generating the script for the lecture and bullet points for the slides. These bullet points are input into Powerpoint Generator's API Returning slides filled with the script, as written by Chat-GPT. The script is also converted to an mp3 using text-to-speech which is overlayed over the frames of the slides and output as an mp4. This mp4 is read by Unity and presented in a VR environment.
How we built it
Used Python, to read APIs and convert their outputs to our required format in order to get our lecture slides. Used Unity to make our front-end a VR environment, and therefore accessible to anyone
Challenges we ran into
Due to none of us using Unity before, we have had many hiccups with implementing any features involving Unity, and therefore took much more time than we expected making 'simple' stuff (such as getting a text box input to work; video to show; loading in 3D models)
We originally planned to use a PowerPoint slide LLM generator, however, we were not able to find any with viable APIs, therefore we had to make our own PowerPoint templates
Accomplishments that we're proud of
What we learned
What's next for Lecture-Genie
Our original project scope included the option to choose lecture length and language which would drastically improve accessibility. In the future, we would also include an animated lecturer who would talk in time with the script, to more closely emulate a real lecture
Log in or sign up for Devpost to join the conversation.