Edit this page

NA-MIC Project Weeks

Back to Projects List

AMP SCZ Facial expression feature extraction for video interviews

Key Investigators

Presenter location: In-person

Project Description

Put together code that 1) performs facial expression feature extraction for video interviews stored on a data aggregation server, and 2) transfers them to a local directory. It would be based on existing scripts for facial expression feature extraction and an existing data management tool. This project is part of the AMP SCZ program, an initiative for early detection of risk for schizophrenia (https://www.ampscz.org).


  1. Objective 1: Adapt our existing code for facial expression analysis to extract features through a proper video pipeline, including running this task for upcoming videos in the data aggregation server.
  2. Objective 2: Adapt our data management tool to incorporate the files generated by this pipeline for data transfer.

Approach and Plan

  1. Discuss how the data management tool (Lochness) retrieves data from the aggregate server.
  2. Define facial expression features of interest.
  3. Set up the facial expression analysis code to be run as a proper pipeline.

Progress and Next Steps

Since we could only stay at project week for a couple of days and this was our first face-to-face interaction as a group, we mainly focused on figuring out specifics of the project that are difficult to fully grasp via zoom meetings. Some of the points being discussed were:

We started to incorporate those adjustments in the code and will continue to work on this after project week. Other considerations that will be taken into account for future work are:


No response

Background and References

Facial expression code: https://github.com/ecastrow/face-feats Data Management tool: https://github.com/AMP-SCZ/lochness