BlockHeal.VR

🧠⛓️BlockHeal.VR presents a new therapy encounter with remarkable & user-friendly Starknet API for safeguarding medical records 🔒 while empowering users to find healing through cherished memories! 😊

Comment

💡Inspiration

Every year in Canada, 5.3 million people feel the need for mental health support. However, conventional therapies can be tedious and sometimes ineffective. Mental health professionals, dealing with numerous patients daily, may struggle to establish a profound connection conducive to patients' mental and physical improvement.

🤖 What it does

BlockHeal.VR offers professional psychological advice using Cohere's API and a RAG. It utilizes Starknet for private and decentralized patient information storage. To aid more people, it employs Starknet to reward patients with cryptocurrencies in a decentralized network, encouraging participation in unique "therapy sessions."

🧠 How we built it

Using C# and Unity Engine, we utilized the Starknet API for blockchain technology, creating smart contracts for secure storage of a "doctor's" evaluation and gamified blockchain transactions. Auth0 secured the NextJS web app for memory import, hosted with a GoDaddy domain. Verbal interaction utilized ElevenLabs and AssemblyAI, and the cognitive process incorporated Cohere's API and a RAG. The VR project involved Unity animation with C#.

🧩 Challenges we ran into

Auth0 exposed a cache problem, requiring last-minute server-side rendered issue resolution in Next.js. We tackled support issues while hosting the domain name on GoDaddy and linking it to our Vercel deployment. Deploying the C# Unity app on Meta Quest 2 took 24 hours.

🏆 Accomplishments that we're proud of

First-time deployment on Meta Quest 2 and building a project with Unity. Successful integration of multiple APIs like AssemblyAI, ElevenLabs, Cohere, and the implementation of a RAG through a complex pipeline with minimal latency.

🌐What we learned

Auth0's HTTPS protocol requirement for user authentication. Hosting on GoDaddy for the first time, especially for a project domain. Developing and running production-fast pipelines with minimal latency to enhance user experience.

🚀What's next for BlockHeal.VR

In the exciting journey ahead, BlockHeal.VR aims to revolutionize personalized therapy by reducing latency, expanding immersive scenes, and introducing features like virtual running. Future goals include crafting a more seamless and enriching experience, pushing the boundaries of therapeutic possibilities for all users.

Built With

  • assemblyai
  • auth0
  • c#
  • cohere
  • elevenlabs
  • godaddy
  • metaquest2
  • nextjs
  • starknet
  • tailwind
  • unity
  • vercel
Share this project:

Updates