June 2017
Volume 58, Issue 8
Open Access
ARVO Annual Meeting Abstract  |   June 2017
Immersive Virtual Reality for Live Volumetric Optical Coherence Tomography
Author Affiliations & Notes
  • Mark Draelos
    Biomedical Engineering, Duke University, Durham, North Carolina, United States
  • Brenton Keller
    Biomedical Engineering, Duke University, Durham, North Carolina, United States
  • Anthony N Kuo
    Ophthalmology, Duke University, Durham, North Carolina, United States
  • Joseph A Izatt
    Biomedical Engineering, Duke University, Durham, North Carolina, United States
    Ophthalmology, Duke University, Durham, North Carolina, United States
  • Footnotes
    Commercial Relationships   Mark Draelos, None; Brenton Keller, None; Anthony Kuo, ClarVista (C), Leica Microsystems (P); Joseph Izatt, Leica Microsystems (P), Leica Microsystems (R)
  • Footnotes
    Support  NVIDIA Global Impact Award, NIH R01-EY023039, NIH F30-EY027280
Investigative Ophthalmology & Visual Science June 2017, Vol.58, 3116. doi:
  • Views
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Mark Draelos, Brenton Keller, Anthony N Kuo, Joseph A Izatt; Immersive Virtual Reality for Live Volumetric Optical Coherence Tomography. Invest. Ophthalmol. Vis. Sci. 2017;58(8):3116.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose : Virtual reality (VR) head-mounted displays (HMDs) are an attractive method for displaying intrasurgical optical coherence tomography (OCT) volumes because they free surgeons from microscope oculars. We demonstrate real-time interactive manipulation and viewing of static and live OCT volumes in a commercial HTC Vive® immersive VR system.

Methods : We designed a VR rendering pipeline built with CUDA, OpenGL, and OpenVR that supports interactive translation, rotation, and scaling of volumes as well as volume sectioning with multiple cut planes. We modified previously reported raycasting techniques to use arbitrary projection matrices for ray generation and to extensively exploit spatially-cached texture memory to meet the Vive’s native refresh rate of 90 Hz. We used custom OpenGL shaders to composite the volumetric render image into a standard 3D scene using ray propagation depth. To allow full GPU occupancy for volumetric renderings without degrading VR frame rate, we dedicated an NVIDIA GTX 1080 for raycasting and used an NVIDIA GTX 670 for compositing. We tested the pipeline using both static and live imaging.

Results : Our VR rendering pipeline operated at 90 Hz without frame drops for a 1024x1327x128 static volume. Stereo raycasting at a resolution of 512x512 pixels had a median and maximum runtime of 7.3 ms and 10.3 ms over 15000 consecutive frames. For live imaging, concurrent raycasting and updating of the volume did not degrade rendering performance. The immersed user was able to view the volume from any perspective through head orientation changes and walking around or through the volume. Using the interactive features, the user was able to readily apply cut planes and manipulate the volume’s pose and scale.

Conclusions : We have demonstrated the viability of HMDs for real-time visualization of OCT volumes and developed an interactive VR OCT volume viewer. VR OCT viewing improves upon intrasurgical heads-up displays with interactivity, full field of view display, and unrestricted head position and orientation.

This is an abstract that was submitted for the 2017 ARVO Annual Meeting, held in Baltimore, MD, May 7-11, 2017.

 

(Left) Example view through the HMD demonstrating the OCT volume rendering for each eye. (Right) Picture of the immersed user rotating the volume with handheld controllers. Hands-free controllers are also possible.

(Left) Example view through the HMD demonstrating the OCT volume rendering for each eye. (Right) Picture of the immersed user rotating the volume with handheld controllers. Hands-free controllers are also possible.

 

(Top) Example of a roughly axis-aligned cut plane. (Bottom) Example of an arbitrary cut plane. Both cuts are of the same static volume. The translucent plane indicates the cut location.

(Top) Example of a roughly axis-aligned cut plane. (Bottom) Example of an arbitrary cut plane. Both cuts are of the same static volume. The translucent plane indicates the cut location.

×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×