Predicting Brainwaves from Face Videos

IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), vol. 27, pp. 1139–1147

Abstract

We investigate the regulation of human brain arousal in the central nervous system and its synchronization with the autonomic nervous system affecting the facial dynamics and its behavioral gestalt. A major focus is made on the sensing observable during natural human eye to eye communication. Although the inner state of the autopoietic system is deterministic, its outer facial behavioral component nondeterministic. Beside the introduction of general validity of the classical empirical interpretation of the vigilance continuum during open eyes, we show that the facial behavior can be used as suitable surrogate measurement for specific states of mind. As a consequence we predict brainwaves from face videos formulated as inverse problem of the underlying stochastic process. Finally, we discuss the impact and range of application field.

Authors 4

1. Christian S. Pilz
   Affiliation as printed

   CanControls, Aachen, Germany

2. Ibtissem Ben Makhlouf
   Affiliation as printed

   CanControls, Aachen, Germany

3. Ute Habel Aachen

   Universitätsklinikum Aachen

   Affiliation as printed

   Uniklinik RWTH, Aachen, Germany

4. Steffen K. Leonhardt Aachen

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University, Germany