Unity Enzo

Unity Enzo: Uniting Realms of Creativity – Where Spatial Computing Meets Collaborative Innovation across Platforms.

Comment 2

Inspiration

The main inspiration for 'Unity Enzo' stemmed from the growing demand for augmented productivity in diverse enterprise scenarios. As spatial computing becomes increasingly prevalent, the need for a unified, cross-platform workflow is more apparent than ever. The project was inspired by the vision of a seamlessly connected world, where the boundaries between physical and digital realms blur, enabling unprecedented collaboration and creativity.

What it does

'Unity Enzo' reimagines the workflow across various devices, from computers to headsets and mobile applications. It integrates the immediate rendering capabilities of Unity with the dynamic procedural generation of Houdini, creating a world where real-time interaction and procedural creation intersect. This integration allows for the construction of dynamic environments and landscapes that respond to user interactions, creating a rich, immersive experience.

How we built it

The project began with a focus on VFX creation in Houdini, establishing a close loop with Magic Leap 2 and Meta Quest 3 through Photon for asset sharing and interactive modification. The MIT Building site served as the real-world canvas for testing and refining our collaborative and interactive features. The project leveraged a robust technology stack, including Unity 2022.3.f1, Chat GPT Vision API, and Meshy.ai, along with the extensive use of Codeberg/GitHub for version control and collaboration.

Challenges we ran into

  1. Multiplayer Setup: Photon Pun presented intermittent issues, mainly related to connection stability, impacting the continuous operation of multiplayer features.
  2. Cross-Platforming Project: Creating a unified project proved challenging, leading to the creation of separate projects for MRTK Magic Leap 2 and Meta Quest 3 XR Interaction Blocks.
  3. Multiplayer Syncs: Implementing a synchronized experience for materials, textures, and details across participants was particularly challenging, as this was not an inherent feature of Photon.

Accomplishments that we're proud of

Despite the challenges, we are particularly proud of:

  1. Seamless Integration: Successfully integrating Unity's immersive rendering with Houdini's dynamic procedural generation.
  2. Innovative Testing: Utilizing the MIT Building site as a large-scale, real-world canvas for collaboration and testing.
  3. Extended Features: Incorporating AI capabilities with Chat GPT Vision and a Language Action Model to enhance user interaction and experience within the Unity app.

What we learned

Throughout the project, we learned about the complexities of cross-platform integration and the importance of robust testing in real-world scenarios. We also gained insights into the potential of spatial computing and AI in transforming user interactions and productivity in collaborative environments.

What's next for Unity Enzo

  1. Enhance Stability: Address the challenges in multiplayer setup and syncing, ensuring a stable and consistent user experience.
  2. Expand Compatibility: Further develop the project to support a wider range of devices and platforms, enhancing its accessibility and utility.
  3. Incorporate Feedback: Gather user feedback and iterate on the design and functionality, refining the project to better meet the needs of its users.

By continuing to innovate and refine our approach, Unity Enzo is poised to set new standards in spatial computing and cross-platform productivity.

Built With

Share this project:

Updates