Edit this page

ProjectWeek

Back to Projects List

Customization of user interfaces for dissemination applications based on 3D Slicer

Key Investigators

Project Description

This project aims at creating a minimal user interface oriented to museological environments. A 3D Slicer application will be implemented with the basic functionality and then its graphic user interface will be customized to a prescribed design. In addition, alternative input/output devices will be considered instead of the usual ones (keyboard, mouse and monitor). Therefore, we will work on the integration of hardware devices such as push buttons, a trackball, a gesture tracking device (Leap Motion), and a touch screen via serial communications. It is also intended to provide the system with 3D visualization capabilities using the SlicerVirtualReality extension.

Objective

  1. Define a methodology to customize the graphical user interface of applications based on 3D Slicer
  2. Combine 3D Slicer and PLUS facilities to integrate new input/output devices
  3. Include 3D visualization capabilities.

Approach and Plan

  1. Design a simple graphical user interface suitable for museological interfaces
  2. Implement the prescribed interface using a Python scripted module
  3. Integrate push buttons and a trackball connected to an Arduino-like platform in 3D Slicer using PLUS
  4. Use SlicerVirtualReality extension to include visualization in virtual reality glasses
  5. Integrate the Leap Motion.

Progress and Next Steps

  1. A very simple tailor-made GUI for the dissemination of aboriginal mummies in museums has been created, including spanish translation and the insertion of the museum logos and corporate colors
  2. The implementation of the graphic interface was complete creating a new custom application using the Slicer template. The whole interface has been designed to be easy to use and user-proof
  3. Performance issues were resolved from the first Slicelet based approach. Improvements include the avoidance of the redundant canvas of the Slicer instance running in the background and the loading of unnecessary modules and extensions
  4. A first strategy to connect Arduino platform to Slicer via PLUS Generic serial device was tested. The sending of commands from the Slicer to check the status of the actuators connected to Arduino was completed, while a robust and appropriate reception of the Arduino response has not yet been implemented.

Illustrations

Some more images
Sketch of the interface.


Some more images Arduino board with push buttons and trackballs.

Interface prototype with translated texts and corporate image
Interface prototype with translated texts and corporate image


Museum logo
Museum logo

Detail of the custom buttons
Detail of the custom buttons

Background and References