Edit this page

NA-MIC Project Weeks

Back to Projects List

Volume rendering improvements

Key Investigators

Project Description

Volume rendering capabilities in VTK and Slicer have been significantly improved. The goal of this project is to explore what are the current unmet volume visualization needs of the Slicer community and how to fulfill.

Objective

  1. Create a list of unmet clinical needs for volume rendering.
  2. Propose potential solutions of how Slicer/VTK volume rendering could be improved to fulfill these needs.
  3. Create prototypes, demos for selected use cases.

Approach and Plan

  1. Demo of new features: custom GLSL shaders for volume rendering, multi-volume rendering, virtual reality, customizing lighting, photorealistic rendering Maybe have a breakout session?
  2. Discuss with people who would like to see improvements in volume rendering. Please talk to Andras Lasso during the project week or during the breakout session?
  3. Implement new volume rendering presets to demonstrate new features

Progress and Next Steps

  1. Clinical needs/use cases:
    • 3D ultrasound rendering: Quality of ultrasound images is very poor compared to most other 3D imaging modalities. Depth-modulated coloring is used by all commercial systems to make it easier to distinguish surfaces.
    • On-the-fly processing: filtering (e.g., Gaussian or median filter) would improve rendering of noisy images. It would be preferable to not modify the original input images and apply these filters dynamically, on the GPU.
    • Multi-volume rendering
    • 4D image (3D time sequence) rendering
    • Large volume rendering (up to 4-6k per axis)
    • Photorealistic rendering (“cinematic rendering”): clinical significance is unclear, but definitely useful for patient communication and training
  2. Solutions

Illustrations

Depth-modulated coloring using GLSL using recent Slicer Preview release:

Depth modulated coloring

Background and References