Siemens Healthineers has launched an app designed for Apple Vision Pro that enables users such as surgeons, medical students, or patients to view immersive, interactive holograms of the human body captured through medical scans in their real-world environment. Visualising the renderings through the app could assist in surgical planning and medical education or help patients visualise procedures.
“Cinematic Reality gives people the opportunity to immerse themselves in a world of photorealistic renderings of the human anatomy. Apple Vision Pro perfectly presents that three-dimensional experience, combined with great flexibility and standalone use. We see great potential for the technology for clinical as well as educational purposes,” states Scott Sinclair, Digital Health Business Manager at Siemens Healthineers Great Britain & Ireland.
Apple Vision Pro, the company’s first spatial computer, seamlessly blends digital content with the user’s physical world. Intuitive gestures allow users to interact with apps by simply looking at them, tapping their fingers to select, flicking their wrist to scroll, or using a virtual keyboard or dictation to type. Using the Cinematic Reality app on Apple Vision Pro allows users to zoom into details of clinical images, enlarging content and rotating around a rendering of the human body and provides basic two-dimensional reading tools such as scrolling. Cinematic Reality app users can simply visualise clinical cases directly through the native app without the need to connect to an additional computer.
The Cinematic Reality app is designed to take advantage of the power of Apple Silicon and Metal, laying a strong foundation for future development. The app helps to provide a more realistic way of visualising organs or body parts, making it possible to better explain clinical cases to patients, discuss clinical questions around referrals, or to educate medical students. In the future, this could assist surgeons in pre-operative planning, facilitate interdisciplinary communication between specialists in different fields, or help non-radiologists and patients to better understand scans and conditions.