Computational Behavior Analysis

We develop sophisticated yet easy-to-use computer vision tools to fill the enormous gap between engineering advances and their clinical accessibility for quantifying human behavior.

Recent advances in computer vision and machine learning promise to rapidly advance research on human behavior, by introducing reliable and granular measurement tools within a new paradigm: computational behavior analysis. Such tools capture and quantify all observable human behavior, with extraordinary precision. Unfortunately, there is a gap between promised possibilities and their translation into behavioral and mental health research.

Our research has focused on development of novel computer vision and machine learning technologies, and their translation into behavioral research. The development and validation of easy-to-use computational tools that a researcher with no engineering background can easily and reliably deploy and interpret would democratize computational behavior analysis and significantly advance science in this area.

3D Modeling of Face and Facial Expressions
Advances in computer vision and online face-to-face communication promise to rapidly reshape mental health research, allowing for exquisitely rich characterization of behavior from videos collected in individuals’ everyday environments. Unfortunately, the great promise of computer vision ...
Detecting Synchronized Behavior
Synchrony is observed in countless phenomena and its discovery is central to answering many computer vision and pattern recognition problems. A basic research problem has remained surprisingly underexplored: Given a set of sequences, how can we discover subsets in which every pair of sequences ...
Evaluation of Facial Analysis Techniques and Methods
Facial expression analysis is one of the most studied problems in computer vision, motivated by numerous applications in industry, clinical research, entertainment, and marketing. Variations in head pose create a significant challenge for facial expression analysis, as expressions look significantly...