Paracosm | Devpost

Generated World at First
Home Page

💫 Inspiration

Several of our teammates have wanted an seamless way to create a world with their imagination.

🎮 What it Does

Paracosm is a web-accessible program that allows users to enter a world of creation. They can manipulate objects in Unity created 3D environment. Speak through an audio detection system to put objects in their world. And finally dive into an imagined world that was created by them.

Section Zero: Access the Paracosm web server. You'll be greeted by a futuristic main menu.

Section One: Command with Movement. Use hand detection to move, customize, and explore a 3D generated world in Unity. You have different options with your hand movements like zooming in and out, changing the size of objects, and more.

Section Two: Speech Manipulation. Use audio detection to voice your thoughts and make the world yours. Ask the system anything you'd like and it will be added.

Section Three: Explore Your Creation. Tap into your newly imagined world using Virtual Reality. Put on your headset once you enter, and explore the vast terrain that is yours to roam.

🔨 How we Built It

Hardware: Integrated a Meta Quest 2 VR headset entering the world. Once the user has generated the world, they can freely access it through virtual reality.

Backend: Utilized Google MediaPipe and OpenCV for hand detection.

Frontend: Developed in Vanilla React. Used JavaScript for our components, CSS for our design, and HTML for applications. We displayed Uses Unity React Web GL to display the world.

Tech Stack

Python, Google Mediapipe, OpenCV, Tensorflow, Flask, React, Unity, WebGL, VR

📊 Challenges we Ran Into

Implementing Unity React Web GL was a difficult task that required a lot of work. Many issues came up due to incorrect directory placement, faulty syntax, or even the world not generating properly due to Unity files. Unity itself brought a lot of problems, as implementing certain tasks can change everything about the world.

🥇 Accomplishments that We're Proud of

Creating a frontend with an inspired look that is unique was a hard but fun task. This gives Paracosm it's own identity. Designing and developing the world had it's fair share of difficulties but once we figured out what we were looking for, the process became a little easier.

🗣️ What we Learned

We learned how to use Unity, WebGL, and React for the first time. Connecting two different systems can be a difficult endeavor but we made great use of it. Unity has a lot of assets, so figuring out which ones to use was overwhelming at first. React is a framework we've always wanted to use for a project to make the design and implementation of other libraries seamless. We also learned how to work with VR and what it's like to combine that system with frontend and backend practices.

🌎 What's Next for Paracosm

We want to develop Paracosm to the next level. Add more features for users to create a world of their imagination, and upgrade previous design aspects like the graphics, generation, and fine-tuning. We want to make this as accessible as possible for people around the world.