Edit this page

NA-MIC Project Weeks

Back to Projects List

TorchXRayVision Meets 3D Slicer: Bridging Deep Learning and Medical Imaging

Key Investigators

Project Description

This project focuses on developing a 3D Slicer module for the automatic processing of chest X-rays, integrating powerful deep learning capabilities provided by TorchXRayVision. The module streamlines radiological analysis by offering the following features:

By combining the advanced machine learning models from TorchXRayVision with the versatile 3D Slicer platform, this module aims to provide a robust tool for clinicians and researchers to enhance diagnostic workflows, reduce manual workload, and improve consistency in radiological interpretation.

Objective

  1. A 3D Slicer Module
  2. TorchXRayVision models included in the module
  3. Torch XRays automatic segmentation, anomaly detection and pathology classification
  4. Heatmaps

Approach and Plan

  1. Create a Slicer Module
  2. Create an interface to upload X-Rays and perform automatic analysis
  3. Use TorchXRayVision framework to perform automatic analysis
  4. Compute heatmaps

Progress and Next Steps

  1. Creating a 3D Slicer Module
  2. Building the interface
  3. Including the TorchXRayVision models
  4. Incorporate mechanisms to facilitate the interpretability of the predictions made by the models

Illustrations

Loading the X-Ray Image: 1

Running automatic analysis: 2

View segmentation: 3

Pathologies scores and heatmap validation: 4

5

Background and References

https://github.com/mlmed/torchxrayvision