My Singing Animals

Inspiration 🎤

Our main inspiration was My Singing Monsters — a wildly popular game with over 50 million downloads on the Google Play Store alone. We were deeply inspired by how it turns music into a playful, collectible experience, letting players build unique soundscapes by combining different characters.

But we wanted to take it a step further: what if we made that experience even more immersive and collaborative? What if players could step into the music world themselves, mix animal sounds, and co-create music in real time with others? That vision sparked the idea behind our game.

What it does 💃

While wearing Snap Spectacles, you can see different animals appear in your world — and when you touch them, they produce sounds or musical notes. At the same time, your player partner can join in by moving their own animals, adding their unique sounds to the mix. Each animal brings its own distinct sound or rhythm, and together you create a one-of-a-kind musical collaboration, blending all the elements into a fun, interactive tune.

How we built it ⚙️

We built our project using Lens Studio, which served as the main platform for designing and assembling all of our AR scenes and interactions. As beginners, we found Lens Studio’s features and documentation helpful for importing 3D models, creating animations, and scripting interactive elements. The platform’s support for both JavaScript and TypeScript made it easier for us to customize our experience and iterate quickly.

To ensure that both pairs of Spectacles displayed synchronized visuals, we used the Spectacles Sync Kit. This toolkit allowed us to create a connected experience where two users could see and interact with the same content in real time. The Sync Kit handled the alignment of coordinate spaces and managed the communication between devices, making the synchronization process seamless and natural.

Challenges we ran into 🧠

Since we were beginners with Lens Studio, one of our first tasks was to get comfortable with the platform. Learning all its features and figuring out the best ways to create AR experiences was a big step for us, but it was also exciting.

Another challenge was connecting two Spectacles to a single device and making sure they stayed in sync. This required us to really dig into both the hardware and software, and it took some experimenting to get everything working together smoothly.

We also had to learn scripting to make the game interactive and responsive, which was a completely new experience for our team. There was definitely a lot to pick up along the way.

Finally, finding the right assets and sounds that matched our vision for the game took some creativity and problem-solving, as we wanted everything to feel unique and high-quality.

However, despite these challenges, the overall development experience was surprisingly smooth. We learned a lot, and working through these obstacles together made the process both rewarding and enjoyable.

Accomplishments that we're proud of 🏆

We had a lot of fun throughout the development process. Mixing different animal sounds and seeing the adorable creatures we created brought us so much joy-we were laughing non-stop at some of the combinations.

We're especially proud that, as beginners, we managed to figure out Lens Studio and use it to bring our ideas to life. Developing our very first cooperative, interactive app for Spectacles was a big milestone for us. It was exciting to see our project come together and work seamlessly on such innovative AR glasses.

Most of all, we're proud of our idea to make live music creation accessible to everyone. Being able to share the joy of spontaneous music-making in such a playful way feels really rewarding. We’re thrilled that we could create something collaborative, creative, and fun using new technology!

What's next for My Singing Animals 💎

We’re excited to continue evolving the experience!

🫂 Community

Players will soon be able to save their tracks and showcase them in a shared gallery, and we’re adding features for players to share their creations on social media, spreading the joy of their music with friends. Additionally, players will be able to see what others have created, fostering a vibrant community of musical collaboration.

💻 Creating AudioSync Kit and More Stylized UI/UX

Next, we want to focus on ensuring sound is perfectly in sync across all spectacles in real time.

🎺 Sound Design

We’re also expanding the range of unique sounds and beats, allowing for even more creative freedom. Moreover, we plan to enhance the experience by using player position to create more dynamic sound layers, making the world feel even more immersive and interactive.

🎤 User-Generated Sound

Looking to the future, we aim to allow players to record their own voices and sounds, integrating them seamlessly into gameplay, offering even more personal and unique contributions to the music they create.

Built With

• ar
• lens
• snap
• spectacles
• studio
• typescript