Immersive Visualization and Interventions: A Multicenter Experience

Immersive visualization technologies, including augmented reality (AR), virtual reality (VR), and mixed reality (MR), are revolutionizing medical imaging and therapeutic interventions. These include AR ultrasound (US) guidance, often combined with CT, where the interventionist/ surgeon does not need to look away from the patient to separate screens. Rather, the procedure is performed looking directly at the site with images superimposed. This session explores multicenter experience of implementing these cutting-edge technologies, from initial proof of concept and registration verification with imaging phantoms to multidisciplinary education and training, culminating in their actual application in surgical and radiological interventions. 

Objectives

• Demonstrate the potential of immersive visualization by showcasing AR, VR, and MR technologies in guiding medical interventions and their transformative impact. 

• Discuss AR phantom validation and technologies’ role in enhancing multidisciplinary education and training, including the creation of 3D-printed imaging phantoms for multimodality registration proof of concept. 

• Compare approaches for aligning 3D models to patients, addressing technical challenges in data acquisition, real-time co-registration, and validation, including the use of ML/AI for movement correction and mis-registration detection. 

Resources

• A Glimpse Into the Future with SIIM’s Enterprise Imaging Committee

• AI for Imaging Informatics IT: Building Intelligent Systems for Better Care  

• What Will Imaging AI Look Like in 10 Years?

CE Credit

The Society for Imaging Informatics in Medicine has approved this activity for 1.0 hours of SIIM IIP Credits towards certification and re-certification by the American Board of Imaging Informatics (ABII).