Inspiration
We live in a 3D world So why is all current medical imaging 2D?
What it does
IntravisionXR is a cloud-based, 3D model medical software platform that automates the process of creating 3D models and allows you to visualize them. • Fully formed 3D models created from any DICOM dataset such as CT and MRI scans.• These 3D models contain complete anatomical detail, including spatial relationships between organs and their internal structure. • Doctors can view organ vasculature, neoplasms and anomalies in-situ within specific structures. • Models can be viewed by multiuser in unparalleled visual detail using AR, VR . • Enhanced viewing of dimensional models in Augmented or Virtual Reality is the most realistic way to view anatomical structures.
How we built it
First we gain a thorough understanding of the DICOM standard, as it specifies how medical imaging information should be exchanged, stored, and accessed. Familiarize yourself with the various types of medical imaging data, such as CT scans, MRI scans, and ultrasound images. Develop algorithms to preprocess DICOM datasets. This may involve converting DICOM files to a suitable format for 3D modeling, handling different modalities, and ensuring consistent resolution and quality. Use Unity3D to create anatomically correct 3D models based on the preprocessed DICOM data. Ensure that the models accurately represent the anatomical structures of interest. Develop algorithms for real-time rendering of 3D models. Optimize performance to ensure smooth and responsive user experiences.
Challenges we ran into
DICOM datasets are vary significantly in terms of format, resolution, and quality. Handling different types of medical imaging data, such as CT scans, MRI scans, or ultrasound images, require robust preprocessing algorithms to ensure consistency and accuracy. Medical data, including DICOM images, is highly sensitive and subject to strict privacy regulations. Ensuring compliance with data protection laws, such as HIPAA in the United States, is crucial. Implementing secure data storage, transmission, and access controls is essential. Real-time Processing: Generating 3D models in real-time from DICOM datasets can be computationally intensive, especially on a device like Pico 4 Optimizing algorithms for efficient processing and rendering is critical to maintaining a smooth user experience. Displaying complex anatomical structures in a way that is both accurate and comprehensible in a mixed reality environment can be challenging. Designing effective user interfaces and interaction mechanisms for exploring and interacting with 3D models in a three-dimensional space is crucial. User Interaction: Designing intuitive and user-friendly interactions in a mixed reality environment presents its own set of challenges. Ensuring that users can easily manipulate and navigate through 3D models, and providing effective tools for annotation and collaboration, requires careful consideration.
Accomplishments that we're proud of
Doctors feedback like Dr. Jamal McClendon, MD Pediatric Neurosurgeon, Phoenix Children’s Hospital said “This gives me much more information, like ten times more than if I did not have this. So, that’s great.”
What we learned
Building anatomically correct 3D models from DICOM datasets is a multidisciplinary task that involves the intersection of medical expertise, software development skills, and an understanding of XR technology. Continuous learning and collaboration with healthcare professionals are essential for the successful development and deployment of such applications.## What's next for IntravisionXR
Log in or sign up for Devpost to join the conversation.