Edit this page

NA-MIC Project Weeks

Back to Projects List

Extracting deep learning features from CT images of the thoracic region for lung cancer applications

Key Investigators

Project Description

This project focuses on using existing foundational deep learning models in 3D Slicer to process CT images of the thoracic region. The objective is to extract features that can be used for lung cancer applications, such as classification, screening, and risk prediction.

Objective

  1. The main objective is to create a 3D Slicer application that receives either one or multiple CT images, processes them with a deep learning model, and generates features that can be used for various lung cancer applications.

Approach and Plan

  1. Identify members of the 3D Slicer community interested in participating in the project.
  2. Meet and discuss the scope of the project during the 3D Slicer week preparation meetings.
  3. List the functional and GUI requirements for the application.
  4. Identify useful deep learning foundational models for lung cancer applications.
  5. Develop the 3D Slicer application to extract features from CT images of the thoracic region.

Progress

  1. Worked on identifying members of the 3D Slicer community interested in participating in the project.
  2. Used Claude AI to generate the graphical interface in 3D Slicer to process medical images using the Tangerine model.
  3. Created a stand-alone command-line interface to access the model via OHIF.
  4. Uploaded the code to a Github repo.

Next Steps

  1. Look for more model models that can encode CT images to add to the interface.
  2. Connect VS studio code via ssh to a server, for easier development with Claude AI.

Illustrations

image

Figure 1: Example screenshot showing the application interface in 3D Slicer.

image

Figure 2: Example screenshot showing the application interface in OHIF.

Background and References

  1. https://projectweek.na-mic.org/PW44_2026_GranCanaria/Projects/ExplorationOfFoundationModelsAndTheirEmbeddingsForOtherTasksUsingTheCloud/
  2. https://github.com/AIM-Harvard/TumorImagingBench
  3. https://imagingdatacommons.github.io/nlst-sybil-connectome/?model=CTClipVit&match=c&color=cancerType
  4. https://github.com/niccolo246/3D-MAE-MedImaging
  5. https://arxiv.org/pdf/2501.09001
  6. https://pmc.ncbi.nlm.nih.gov/articles/PMC12876872/