Chingoo

Daily Dose of Korean with Chingoo: Learn with your MR language friend! Discover motivation, learn encouraging phrases, share K-pop passion, and grow with Chingoo's encouragement and expertise.

Comment 1

Inspiration

Miji, a Korean language instructor, noticed students' enthusiasm when discussing K-pop and dramas. Recognizing motivation's key role in language acquisition, Miji aimed to create an innovative approach to sustain learners' motivation and foster continuous language growth. Her team at Kore Meta created a friendly AI character that provides daily encouragement and practice in an MR environment, leveraging technology to support language acquisition. This approach keeps learners engaged and motivated throughout their Korean language journey. The team aims to design a widget concept app for effortless access and seamless closure, integrating language learning into daily routines without stress, and harmoniously merging with Mixed Reality users' daily lives for a fluid and enjoyable experience.

What it does

Chingoo, empowered by AI technology, will appear on the user's palm, offering a daily dose of motivational encouragement to fuel their Korean language learning journey. This interactive character will engage in conversations with users in both English and Korean, delving into Korean culture and imparting new vocabulary and expressions. Designed for effortless accessibility and minimal stress, Chingoo provides a supportive and enjoyable learning experience.

How we built it

Kore Meta team leveraged the Meta Presence Platform's interaction SDKs to enable hand tracking, poking interactions, and also passthrough capabilities, delivering a mixed reality experience. Additionally, we integrated a multilingual AI solution that supports voice commands and speech-to-text functionality, further enhancing user engagement and interaction.

Challenges we ran into

One of the most significant challenges we faced in this project was developing a multilingual AI avatar. The AI's language recognition capabilities are sometimes inconsistent, posing a hurdle in achieving seamless communication. Additionally, designing a character that could move and respond naturally and intuitively was another technical challenge.

Accomplishments that we're proud of:

We are proud to have achieved several objectives with this project:

  1. Pushing the boundaries of Mixed Reality (MR) technology with Meta Presence Platform by creating a pet-like MR companion that offers not only affection and interaction but also valuable educational content
  2. Successfully developing our first AI project, bringing our vision of innovative education to life
  3. Enhancing user experience by designing an intuitive and easily accessible interface, making it simple for users to harness the benefits of this innovative technology These accomplishments demonstrate our commitment to harnessing cutting-edge technology to improve education and make it more engaging and accessible for all.

What we learned

Realizing a seamless AI experience in Mixed Reality (MR) requires further development and time investment; however, the payoff will be significant. When achieved, the integration of AI and MR will unlock immense potential, delivering a transformative and immersive learning experience for users. The synergy between these technologies will revolutionize the way we learn and interact, making education more engaging, effective, and accessible.

What's next for Chingoo

  1. Personalized Avatar Selection: We aim to provide users with the flexibility to choose their preferred avatar with user-chosen names, enhancing their overall experience and fostering a sense of ownership and engagement.
  2. Enhanced Interaction Capabilities: Expanding and diversifying user interactions will significantly enrich the user experience, providing a more immersive and dynamic environment.
  3. Advanced AI Training: Further training of AI will enable the provision of more comprehensive and insightful information, catering to a wider range of user inquiries and needs.
  4. Optimizing Multilingual AI Avatar: We strive to utilize a good multilingual AI avatar, ensuring seamless communication and an inclusive experience for users.
  5. Further possibility: Personalized AI avatar for different purposes: free conversation, counseling, etc.

Built With

Share this project:

Updates