Immersive Creator

• 

  Private Environment in a Gym Playing 01

• 

  Private Environment in a Gym Recording 01

• 

  Private Environment in a Gym Playing 02

• 

  Industry Environment in a PumpStation Environment Playing 01

• 

  Industry Environment in a PumpStation Environment Playing 02

• 

  Industry Environment in a PumpStation Environment Playing 06

• 

  Private Environment in a Gym Playing 03

• 

  Public Environment in a Training Situation for Safety Playing 02

• 

  Private Environment in a Gym Playing 04

• 

  Public Environment in a Training Situation for Safety Playing 01

• 

  Private Environment in a Gym Recording 02

• 

  Industry Environment in a PumpStation Environment Recording 02

• 

  Industry Environment in a PumpStation Environment Playing 09

• 

  Industry Environment in a PumpStation Environment Playing 05

• 

  Industry Environment in a PumpStation Environment Playing 03

• 

  Industry Environment in a PumpStation Environment Playing 08

• 

  Industry Environment in a PumpStation Environment Recording 01

• 

  Industry Environment in a PumpStation Environment Playing 07

• 

  Industry Environment in a PumpStation Environment Playing 04

Immersive Creator

Our inspiration Immersive Creator was inspired by the need for constant supervision in training and education environments. By using avatars, productivity in these environments can be significantly improved, optimizing both learning and training. We aimed to create a comfortable user experience with an interactive menu for recording actions and voice, which users can then play back. Recordings can be done step-by-step and played back step-by-step. The application can be used in any situation, with proposed environments including private, public, and industrial settings, but the possibilities are endless.

How we created this immersive application Immersive Creator was built using Unreal Engine, with MetaHuman for the avatar. It features hand tracking to enhance user comfort. Actions are recorded through hand and head tracking using the MetaXR plugin. Leg animations are achieved with inverse kinematics, and voice recordings can be imported using the Runtime Audio Importer plugin. The scenarios were created using assets generated by the developers and additional sources. Our biggest challenge was accurately tracking the user's body and switching levels in the APK. We are particularly proud of the avatar's inverse kinematics and the recording system.

Our valuable experience Throughout this experience, we have learned a lot from each other. Our team members brought different skills and strengths to the project, including 3D modeling, texturing, and programming in Unreal Engine. One key takeaway is that development is not easy, and working in a multitalented team is essential to achieving our goals.

Future steps Our next steps involve optimizing the hand menu and improving the performance of the HMDs to enable seamless level switching.

Built With

• c++
• meta
• metahuman
• mr
• unreal-engine
• vr
• xr