Perception of “Live” Facial Expressions

The article provides a review of experimental studies of interpersonal perception on the material of static and dynamic facial expressions as a unique source of information about the person’s inner world. The focus is on the patterns of perception of a moving face, included in the processes of communication and joint activities (an alternative to the most commonly studied perception of static images of a person outside of a behavioral context). The review includes four interrelated topics: face statics and dynamics in the recognition of emotional expressions; specificity of perception of moving face expressions; multimodal integration of emotional cues; generation and perception of facial expressions in communication processes. The analysis identifies the most promising areas of research of face in motion. We show that the static and dynamic modes of facial perception complement each other, and describe the role of qualitative features of the facial expression dynamics in assessing the emotional state of a person. Facial expression is considered as part of a holistic multimodal manifestation of emotions. The importance of facial movements as an instrument of social interaction is emphasized.

1. Adams R.B., Kleck R.E. Perceived Gaze Direction and the Processing of Facial Displays of Emotion. Psychological Science, 2003. Vol. 14, no. 6, pp. 644—647. DOI:10.1046/j.0956-7976.2003.psci_1479.x
2. Addabbo M., Longhi E., Marchis I.C., Tagliabue P., Turati C. Dynamic facial expressions of emotions are discriminated at birth. PLoS one, 2018. Vol. 13, no. 3, pp. 1—11. DOI:10.1371/journal.pone.0193868
3. Alves N.T. Recognition of static and dynamic facial expressions: a study review. Estudos de Psicologia (Natal), 2013. Vol. 18, no. 1, pp. 125—130. DOI:10.1590/S1413-294X2013000100020
4. Ambadar Z., Cohn J.F., Reed L.I. All Smiles are Not Created Equal: Morphology and Timing of Smiles Perceived as Amused, Polite, and Embarrassed/Nervous. Journal of Nonverbal Behavior, 2009. Vol. 33, no. 1, pp. 17—34. DOI:10.1007/s10919-008-0059-5
5. Ambadar Z., Schooler J.W., Cohn J.F. Deciphering the Enigmatic Face: The Importance of Facial Dynamics in Interpreting Subtle Facial Expressions. Psychological Science, 2005. Vol. 16, no. 5, pp. 403— 410. DOI:10.1111/j.0956-7976.2005.01548.x
6. Argyle M., Cook M. Gaze and mutual gaze. Cambridge: Cambridge University Press, 1976.
7. Aviezer H., Bentin S., Dudarev V., Hassin R.R. The automaticity of emotional face-context integration. Emotion, 2011. Vol. 11, no. 6, pp. 1406—1414. DOI:10.1037/a0023578
8. Aviezer H., Hassin R.R., Ryan J., Grady C., Susskind J., Anderson A., Moscovitch M., Bentin S. Angry, disgusted, or afraid? Studies on the malleability of emotion perception. Psychological Science, 2008. Vol. 19, no. 7, pp. 724—732. DOI:10.1111/j.1467-9280.2008.02148.x
9. Baart M., Vroomen J. Recalibration of vocal affect by a dynamic face. Experimental Brain Research, 2018. Vol. 236, no. 7, pp. 1911—1918. DOI:10.1007/s00221-018-5270-y
10. Barabanschikov V.A. [Dynamics of perception of facial expressions]. Moscow: Cogito-Center, 2016.
11. Barabanschikov V.A. [Facial expressions and their perception]. Moscow: IP RAS Publ., 2012.
12. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. [Dependence of the perception of facial expressions on the spatio-temporal structure of exposure]. Cognitive mechanisms of non-verbal communication. Moscow: Cogito-Center, 2017. P. 48—101.
13. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. [Perception of facial expressions during masking and apparent motion]. Experimental Psychology (Russia), 2015. Vol. 8, no. 1, pp. 7—27.
14. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. [Recognition of blurred images of facial emotional expression in apparent movement]. Experimental Psychology (Russia), 2015. Vol. 8, no. 4, pp. 5—29. DOI:10.17759/exppsy.2015080402
15. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. [Recognition of facial expressions during step-function stroboscopic presentation]. Experimental Psychology (Russia), 2018. Vol. 11, no. 4, pp. 50—69. DOI:10.17759/exppsy.2018110405
16. Barabanschikov V.A., Zhegallo A.V., Ivanova L.A. [Recognition of expression of inverted face image]. Experimental Psychology (Russia), 2010. Vol. 3, no. 3, pp. 66—83.
17. Barabanschikov V.A., Zhegallo A.V., Khoze E.G. [Indicators of oculomotor activity of an observer in the perception of video and photo images of a face]. Cognitive mechanisms of non-verbal communication. Moscow: Cogito-Center, 2017. P. 146—188.
18. Barabanschikov V.A., Zhegallo A. V., Khrisanfova L.A. [Perceptual genesis of facial expressions]. Communication and cognition. Moscow: IP RAS Publ., 2007. P. 44—83.
19. Barabanschikov V.A., Zhegallo A. V., Korolkova O.A. [Perceptual categorization of facial expressions]. Moscow: Cogito-Center, 2016.
20. Barabanschikov V.A., Zherdev I.Y. Visual Perception of Facial Emotional Expressions during Saccades. Behavioral Sciences, 2019. Vol. 9, no. 12, pp. 1—11. DOI:10.3390/bs9120131
21. Bassili J.N. Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology: Human Perception and Performance, 1978. Vol. 4, no. 3, pp. 373—379. DOI:10.1037/0096- 1523.4.3.373
22. Biele C., Grabowska A. Sex differences in perception of emotion intensity in dynamic and static facial expressions. Experimental Brain Research, 2006. Vol. 171, no. 1, pp. 1—6. DOI:10.1007/s00221-005-0254-0
23. Bindemann M., Burton A.M., Langton S.R.H. How do eye gaze and facial expression interact? Visual Cognition, 2008. Vol. 16, no. 6, pp. 708—733. DOI:10.1080/13506280701269318
24. Binetti N., Harrison C., Coutrot A., Mareschal I., Johnston A. Reciprocating the gaze of others: how we look and how long we like to be looked at. Journal of Vision, 2015. Vol. 15, no. 12, pp. 172. DOI:10.1167/15.12.172
25. Birmingham E., Bischof W.F., Kingstone A. Why do we look at people’s eyes? Journal of Eye Movement Research, 2007. Vol. 1, no. 1 (SE-Articles). DOI:10.16910/jemr.1.1.1
26. Blais C., Fiset D., Roy C., Saumure Régimbald C., Gosselin F. Eye fixation patterns for categorizing static and dynamic facial expressions. Emotion, 2017. Vol. 17, no. 7, pp. 1107—1119. DOI:10.1037/emo0000283
27. Bould E., Morris N. Role of motion signals in recognizing subtle facial expressions of emotion. British Journal of Psychology, 2008. Vol. 99, no. 2, pp. 167—189. DOI:10.1348/000712607X206702
28. Bould E., Morris N., Wink B. Recognising subtle emotional expressions: The role of facial movements. Cognition & Emotion, 2008. Vol. 22, no. 8, pp. 1569—1587. DOI:10.1080/02699930801921156
29. Bruce V., Valentine T. When a nod’s as good as a wink: The role of dynamic information in facial recognition. Practical Aspects of Memory: Current Research and Issues, 1988. Vol. 1, pp. 169—174.
30. Bruce V., Young A. In the eye of the beholder: the science of face perception. Oxford: Oxford University Press, 1998.
31. Bugental D.B. Unmasking the “Polite Smile”: Situational and Personal Determinants of Managed Affect in Adult-Child Interaction. Personality and Social Psychology Bulletin, 1986. Vol. 12, no. 1, pp. 7—16. DOI:10.1177/0146167286121001
32. Calder A.J., Rhodes G., Johnson M.H., Haxby J. V. The Oxford Handbook of Face Perception. In A.J. Calder, G. Rhodes, M.H. Johnson, J. V Haxby (ed.), Oxford: Oxford University Press, 2011. 916 p.
33. Calvo M.G., Avero P., Fernández-Martín A., Recio G. Recognition thresholds for static and dynamic emotional faces. Emotion, 2016. Vol. 16, no. 8, pp. 1186—1200. DOI:10.1037/emo0000192
34. Calvo M.G., Fernandez-Martin A., Gutierrez-Garcia A., Lundqvist D. Selective eye fixations on diagnostic face regions of dynamic emotional expressions: KDEF-dyn database. Scientific reports, 2018. Vol. 8, no. 1, pp. 1—10. DOI:10.1038/s41598-018-35259-w
35. Campanella S., Belin P. Integrating face and voice in person perception. Trends in Cognitive Sciences, 2007. Vol. 11, no. 12, pp. 535—543. DOI:10.1016/j.tics.2007.10.001
36. Carr E.W., Winkielman P., Oveis C. Transforming the mirror: power fundamentally changes facial responding to emotional expressions. Journal of experimental psychology. General, 2014. Vol. 143, no. 3, pp. 997—1003. DOI:10.1037/a0034972
37. Collignon O., Girard S., Gosselin F., Roy S., Saint-Amour D., Lassonde M., Lepore F. Audio-visual integration of emotion expression. Brain Research, 2008. Vol. 1242, pp. 126—135. DOI:10.1016/j. brainres.2008.04.023
38. Cosker D., Krumhuber E.G., Hilton A. Perception of linear and nonlinear motion properties using a FACS validated 3D facial model. Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization (APGV 2010). New York, New York, USA: ACM Press, 2010. P. 101. DOI:10.1145/1836248.1836268
39. Cunningham D.W., Nusseck M., Wallraven C., Bülthoff H.H. The role of image size in the recognition of conversational facial expressions. Computer Animation and Virtual Worlds, 2004. Vol. 15, no. 34, pp. 305— 310. DOI:10.1002/cav.33
40. Cunningham D.W., Wallraven C. Dynamic information for the recognition of conversational expressions. Journal of Vision, 2009. Vol. 9, no. 13, pp. 1—17. DOI:10.1167/9.13.7
41. Cunningham D.W., Wallraven C. The interaction between motion and form in expression recognition. Proceedings of the 6th Symposium on Applied Perception in Graphics and Visualization (APGV 2009). New York, New York, USA: ACM Press, 2009. P. 41. DOI:10.1145/1620993.1621002
42. Cutting J.E., Kozlowski L.T. Recognizing Friends by Their Walk: Gait Perception Without Familiarity Cues. Bulletin of the Psychonomic Society, 1977. Vol. 9, pp. 353—356. DOI:10.3758/BF03337021
43. Deng H., Hu P. Matching Your Face or Appraising the Situation: Two Paths to Emotional Contagion. Frontiers in Psychology, 2017. Vol. 8, pp. 1—9. DOI:10.3389/fpsyg.2017.02278
44. Dimberg U., Thunberg M., Elmehed K. Unconscious Facial Reactions to Emotional Facial Expressions. Psychological Science, 2000. Vol. 11, no. 1, pp. 86—89. DOI:10.1111/1467-9280.00221
45. Dolan R.J., Morris J.S., Gelder B. De. Crossmodal binding of fear in voice and face. Proceedings of the National Academy of Sciences of the United States of America, 2001. Vol. 98, no. 17, pp. 10006—10010. DOI:10.1073/pnas.171288598
46. Ekman P., Rosenberg E.L. What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS). N.Y.: Oxford University Press, 2005. 486 p. DOI:10.1093/ acprof:oso/9780195179644.001.0001
47. Ethofer T., Anders S., Erb M., Droll C., Royen L., Saur R., Reiterer S., Grodd W., Wildgruber D. Impact of voice on emotional judgment of faces: An event-related fMRI study. Human Brain Mapping, 2006. Vol. 27, no. 9, pp. 707—714. DOI:10.1002/hbm.20212
48. Fernandez-Dols J., Carroll J.M. Is the meaning perceived in facial expression independent of its context? The Psychology of Facial Expression. Cambridge: Cambridge University Press, 1997. P. 275—294. DOI:10.1017/CBO9780511659911.014
49. Fiorentini C., Schmidt S., Viviani P. The identification of unfolding facial expressions. Perception, 2012. Vol. 41, no. 5, pp. 532—555. DOI:10.1068/p7052
50. Fiorentini C., Viviani P. Is there a dynamic advantage for facial expressions? Journal of Vision, 2011. Vol. 11, no. 3, pp. 1—15. DOI:10.1167/11.3.17
51. Fischer A.H., Becker D., Veenstra L. Emotional Mimicry in Social Context: The Case of Disgust and Pride. Frontiers in Psychology, 2012. Vol. 3, pp. 1—9. DOI:10.3389/fpsyg.2012.00475
52. Fischer A.H., Gillebaart M., Rotteveel M., Becker D., Vliek M. Veiled emotions: The effect of covered faces on emotion perception and attitudes. Social Psychological and Personality Science, 2012. Vol. 3, no. 3, pp. 266—273. DOI:10.1177/1948550611418534
53. Fox C.J., Barton J.J.S. What is adapted in face adaptation? The neural representations of expression in the human visual system. Brain research, 2007. Vol. 1127, no. 1, pp. 80—89. DOI:10.1016/j.brainres.2006.09.104
54. Fox C.J., Iaria G., Barton J.J.S. Defining the face processing network: Optimization of the functional localizer in fMRI. Human Brain Mapping, 2009. Vol. 30, no. 5, pp. 1637—1651. DOI:10.1002/hbm.20630
55. Gelder B. De, Vroomen J. The perception of emotions by ear and by eye. Cognition & Emotion, 2000. Vol. 14, no. 3, pp. 289—311. DOI:10.1080/026999300378824
56. Gelder B. De, Vroomen J., Bertelson P. Upright but not inverted faces modify the perception of emotion in the voice. Cahiers de Psychologie Cognitive, 1998. Vol. 17, no. 4—5, pp. 1021—1032.
57. Gibson J.J. The Ecological Approach to Visual Perception. Boston: Houghton Mifflin, 1979.
58. Gibson J.J. The Senses Considered as Perceptual Systems. Boston: Houghton Mifflin, 1966.
59. Grainger S.A., Henry J.D., Phillips L.H., Vanman E.J., Allen R. Age Deficits in Facial Affect Recognition: The Influence of Dynamic Cues. The Journals of Gerontology. Series B, Psychological Sciences and Social Sciences, 2017. Vol. 72, no. 4, pp. 622—632. DOI:10.1093/geronb/gbv100
60. Hashiya K., Meng X., Uto Y., Tajiri K. Overt congruent facial reaction to dynamic emotional expressions in 9—10-month-old infants. Infant Behavior & Development, 2019. Vol. 54, pp. 48—56. DOI:10.1016/j. infbeh.2018.12.002
61. Hess U., Fischer A. Emotional Mimicry as Social Regulation. Personality and Social Psychology Review, 2013. Vol. 17, no. 2, pp. 142—157. DOI:10.1177/1088868312472607
62. Hess U., Kleck R.E. The cues decoders use in attempting to differentiate emotion - elicited and posed facial expressions. European Journal of Social Psychology, 1994. Vol. 24, no. 3, pp. 367—381. DOI:10.1002/ ejsp.2420240306
63. Hessels R.S. How does gaze to faces support face-to-face interaction? A review and perspective. Psychonomic Bulletin & Review, 2020. Vol. 27, no. 5, pp. 1—26. DOI:10.3758/s13423-020-01715-w
64. Hessels R.S., Cornelissen T.H.W., Hooge I.T.C., Kemner C. Gaze behavior to faces during dyadic interaction. Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale, 2017. Vol. 71, no. 3, pp. 226—242. DOI:10.1037/cep0000113
65. Hill H.C.H., Troje N.F., Johnston A. Range- and domain-specific exaggeration of facial speech. Journal of vision, 2005. Vol. 5, no. 10, pp. 793—807. DOI:10.1167/5.10.4
66. Isomura T., Nakano T. Automatic facial mimicry in response to dynamic emotional stimuli in five-month-old infants. Proceedings of the Royal Society B: Biological Sciences, 2016. Vol. 283, no. 1844, pp. 1—9. DOI:10.1098/rspb.2016.1948
67. Jack R.E., Garrod O.G.B., Schyns P.G. Dynamic Facial Expressions of Emotion Transmit an Evolving Hierarchy of Signals over Time. Current Biology, 2014. Vol. 24, no. 2, pp. 187—192. DOI:10.1016/j.cub.2013.11.064
68. Jellema T., Pecchinenda A., Palumbo L., Tan E.G. Biases in the perception and affective valence of neutral facial expressions induced by the immediate perceptual history. Visual Cognition, 2011. Vol. 19, no. 5, pp. 616—634. DOI:10.1080/13506285.2011.569775
69. Jiang Z., Li W., Recio G., Liu Y., Luo W., Zhang D., Sun D. Time Pressure Inhibits Dynamic Advantage in the Classification of Facial Expressions of Emotion. PLoS ONE, 2014. Vol. 9, no. 6, pp. 1—7. DOI:10.1371/ journal.pone.0100162
70. Johansson G. Visual perception of biological motion and a model for its analysis. Perception & Psychophysics, 1973. Vol. 14, no. 2, pp. 201—211. DOI:10.3758/BF03212378
71. Johansson G., Hofsten C. von H., Jansson G. Event Perception. Annual Review of Psychology, 1980. Vol. 31, no. 1, pp. 27—63. DOI:10.1146/annurev.ps.31.020180.000331
72. Kaiser J., Davey G.C.L., Parkhouse T., Meeres J., Scott R.B. Emotional facial activation induced by unconsciously perceived dynamic facial expressions. International Journal of Psychophysiology, 2016. Vol. 110, pp. 207—211. DOI:10.1016/j.ijpsycho.2016.07.504
73. Kamachi M., Bruce V., Mukaida S., Gyoba J., Yoshikawa S., Akamatsu S. Dynamic properties influence the perception of facial expressions. Perception, 2001. Vol. 30, no. 7, pp. 875—887. DOI:10.1068/p3131
74. Kätsyri J., Sams M. The effect of dynamics on identifying basic emotions from synthetic and natural faces. International Journal of Human-Computer Studies, 2008. Vol. 66, no. 4, pp. 233—242. DOI:10.1016/j. ijhcs.2007.10.001
75. Kleinke C.L. Gaze and eye contact: A research review. Psychological Bulletin, 1986. Vol. 100, no. 1, pp. 78—100. DOI:10.1037/0033-2909.100.1.78
76. Kokinous J., Kotz S.A., Tavano A., Schröger E. The role of emotion in dynamic audiovisual integration of faces and voices. Social Cognitive and Affective Neuroscience, 2015. Vol. 10, no. 5, pp. 713—720. DOI:10.1093/ scan/nsu105
77. Korolkova O.A. [Perceptual Space and Predictors of Emotional Facial Expression Discrimination]. The Russian Journal of Cognitive Science, 2014. Vol. 1, no. 4, pp. 82—97.
78. Korolkova O.A. [The effect of perceptual adaptation to dynamic facial expressions]. Experimental Psychology (Russia), 2017. Vol. 10, no. 1, pp. 67—88. DOI:10.17759/exppsy.2017100106
79. Korolkova O.A. Adaptation or Assimilation? Sequential Effects in the Perception of Dynamic and Static Facial Expressions of Emotion. The Russian Journal of Cognitive Science, 2018. Vol. 5, no. 2, pp. 18—34.
80. Korolkova O.A. The role of dynamics in visual adaptation to emotional facial expressions. The Russian Journal of Cognitive Science, 2015. Vol. 2, no. 4, pp. 38—57.
81. Korolkova O.A. The role of temporal inversion in the perception of realistic and morphed dynamic transitions between facial expressions. Vision Research, 2018. Vol. 143, pp. 42—51. DOI:10.1016/j. visres.2017.10.007
82. Kraaijenvanger E.J., Hofman D., Bos P.A. A neuroendocrine account of facial mimicry and its dynamic modulation. Neuroscience & Biobehavioral Reviews, 2017. Vol. 77, pp. 98—106. DOI:10.1016/j. neubiorev.2017.03.006
83. Krumhuber E., Manstead A.S.R., Cosker D., Marshall D., Rosin P.L. Effects of Dynamic Attributes of Smiles in Human and Synthetic Faces: A Simulated Job Interview Setting. Journal of Nonverbal Behavior, 2009. Vol. 33, no. 1, pp. 1—15. DOI:10.1007/s10919-008-0056-8
84. Krumhuber E., Manstead A.S.R., Cosker D., Marshall D., Rosin P.L., Kappas A. Facial dynamics as indicators of trustworthiness and cooperative behavior. Emotion, 2007. Vol. 7, no. 4, pp. 730—735. DOI:10.1037/1528-3542.7.4.730
85. Krumhuber E.G., Kappas A. Moving Smiles: The Role of Dynamic Components for the Perception of the Genuineness of Smiles. Journal of Nonverbal Behavior, 2005. Vol. 29, no. 1, pp. 3—24. DOI:10.1007/ s10919-004-0887-x
86. Krumhuber E.G., Kappas A., Manstead A.S.R. Effects of Dynamic Aspects of Facial Expressions: A Review. Emotion Review, 2013. Vol. 5, no. 1, pp. 41—46. DOI:10.1177/1754073912451349
87. Krumhuber E.G., Manstead A.S.R., Kappas A. Temporal Aspects of Facial Displays in Person and Expression Perception: The Effects of Smile Dynamics, Head-tilt, and Gender. Journal of Nonverbal Behavior, 2006. Vol. 31, no. 1, pp. 39—56. DOI:10.1007/s10919-006-0019-x
88. Krumhuber E.G., Scherer K.R. The Look of Fear from the Eyes Varies with the Dynamic Sequence of Facial Actions. Swiss Journal of Psychology, 2016. Vol. 75, no. 1, pp. 5—14. DOI:10.1024/1421-0185/ a000166
89. Langton S.R. Gaze perception and visually mediated attention. In J. Adams, R. B., N. Ambady, K. Nakayama, S. Shimojo (ed.), The Science of Social Vision. N.Y.: Oxford University Press, 2011. P. 108— 132.
90. Lanzetta J.T., Englis B.G. Expectations of cooperation and competition and their effects on observers’ vicarious emotional responses. Journal of Personality and Social Psychology, 1989. Vol. 56, no. 4, pp. 543— 554. DOI:10.1037/0022-3514.56.4.543
91. Levy Y., Bentin S. Interactive processes in matching identity and expressions of unfamiliar faces: evidence for mutual facilitation effects. Perception, 2008. Vol. 37, no. 6, pp. 915—930. DOI:10.1068/p5925
92. Likowski K.U., Weyers P., Seibt B., Stöhr C., Pauli P., Mühlberger A. Sad and Lonely? Sad Mood Suppresses Facial Mimicry. Journal of Nonverbal Behavior, 2011. Vol. 35, no. 2, pp. 101—117. DOI:10.1007/ s10919-011-0107-4
93. Louwerse M.M., Dale R., Bard E.G., Jeuniaux P. Behavior Matching in Multimodal Communication Is Synchronized. Cognitive Science, 2012. Vol. 36, no. 8, pp. 1404—1426. DOI:10.1111/j.1551-6709.2012.01269.x
94. Marian D.E., Shimamura A.P. Contextual Influences on Dynamic Facial Expressions. The American Journal of Psychology, 2013. Vol. 126, no. 1, pp. 53—66. DOI:10.5406/amerjpsyc.126.1.0053
95. Maringer M., Krumhuber E.G., Fischer A.H., Niedenthal P.M. Beyond smile dynamics: Mimicry and beliefs in judgments of smiles. Emotion, 2011. Vol. 11, no. 1, pp. 181—187. DOI:10.1037/a0022596
96. Massaro D.W., Egan P.B. Perceiving affect from the voice and the face. Psychonomic Bulletin & Review, 1996. Vol. 3, no. 2, pp. 215—221. DOI:10.3758/BF03212421
97. McGurk H., McDonald J. Hearing lips and seeing voices. Nature, 1976. Vol. 264, no. 5588, pp. 746—748. DOI:10.1038/264746a0
98. Meeren H.K.M., Heijnsbergen C.C.R.J. van, Gelder B. De. Rapid perceptual integration of facial expression and emotional body language. Proceedings of the National Academy of Sciences, 2005. Vol. 102, no. 45, pp. 16518—16523. DOI:10.1073/pnas.0507650102
99. Moskowitz G.B. Social cognition: understanding self and others. New York: Guilford Press, 2005. 612 p.
100. Nelson K. Event Knowledge: Structure and Function in Development. Hillsdale, N.J.: Lawrence Erlbaum Associates, 1986. 288 p.
101. Niedenthal P.M., Brauer M., Halberstadt J.B., Innes-Ker Å.H. When did her smile drop? Facial mimicry and the influences of emotional state on the detection of change in emotional expression. Cognition and Emotion, 2001. Vol. 15, no. 6, pp. 853—864. DOI:10.1080/02699930143000194
102. Paulmann S., Pell M.D. Is there an advantage for recognizing multi-modal emotional stimuli? Motivation and Emotion, 2011. Vol. 35, no. 2, pp. 192—201. DOI:10.1007/s11031-011-9206-0
103. Perdikis D., Volhard J., Müller V., Kaulard K., Brick T.R., Wallraven C., Lindenberger U. Brain synchronization during perception of facial emotional expressions with natural and unnatural dynamics. PLoS one, 2017. Vol. 12, no. 7, pp. 1—23. DOI:10.1371/journal.pone.0181225
104. Pitcher D., Dilks D.D., Saxe R.R., Triantafyllou C., Kanwisher N. Differential selectivity for dynamic versus static information in face-selective cortical regions. NeuroImage, 2011. Vol. 56, no. 4, pp. 2356—2363. DOI:10.1016/j.neuroimage.2011.03.067
105. Pye A., Bestelmeyer P.E.G. Evidence for a supra-modal representation of emotion from cross-modal adaptation. Cognition, 2015. Vol. 134, pp. 245—251. DOI:10.1016/j.cognition.2014.11.001
106. Recio G., Schacht A., Sommer W. Classification of dynamic facial expressions of emotion presented briefly. Cognition & Emotion, 2013. Vol. 27, no. 8, pp. 1486—1494. DOI:10.1080/02699931.2013.794128
107. Reinl M., Bartels A. Perception of temporal asymmetries in dynamic facial expressions. Frontiers in Psychology, 2015. Vol. 6, pp. 1—8. DOI:10.3389/fpsyg.2015.01107
108. Richoz A.-R., Lao J., Pascalis O., Caldara R. Tracking the recognition of static and dynamic facial expressions of emotion across the life span. Journal of Vision, 2018. Vol. 18, no. 9, pp. 1—27. DOI:10.1167/18.9.5
109. Rizzolatti G., Sinigaglia C. Mirrors in the Brain — How Our Minds Share Actions and Emotions. Oxford: Oxford Univ Press, 2008. 242 p.
110. Runeson S., Frykholm G. Kinematic specification of dynamics as an informational basis for person-and-action perception: Expectation, gender recognition, and deceptive intention. Journal of Experimental Psychology: General, 1983. Vol. 112, no. 4, pp. 585—615. DOI:10.1037/0096-3445.112.4.585
111. Russell J.A., Fernández-Dols J.M. The Psychology of Facial Expression. In J.A. Russell, J.M. Fernández- Dols (ed.), Cambridge: Cambridge University Press, 1997. DOI:10.1017/CBO9780511659911
112. Rymarczyk K., Żurawski Ł., Jankowiak-Siuda K., Szatkowska I. Empathy in Facial Mimicry of Fear and Disgust: Simultaneous EMG-fMRI Recordings During Observation of Static and Dynamic Facial Expressions. Frontiers in Psychology, 2019. Vol. 10, pp. 1—20. DOI:10.3389/fpsyg.2019.00701
113. Rymarczyk K., Żurawski Ł., Jankowiak-Siuda K., Szatkowska I. Neural Correlates of Facial Mimicry: Simultaneous Measurements of EMG and BOLD Responses during Perception of Dynamic Compared to Static Facial Expressions. Frontiers in Psychology, 2018. Vol. 9, pp. 1—17. DOI:10.3389/fpsyg.2018.00052
114. Sato W., Fujimura T., Suzuki N. Enhanced facial EMG activity in response to dynamic facial expressions. International Journal of Psychophysiology, 2008. Vol. 70, no. 1, pp. 70—74. DOI:10.1016/j.ijpsycho.2008.06.001
115. Sato W., Kochiyama T., Uono S., Sawada R., Kubota Y., Yoshimura S., Toichi M. Widespread and lateralized social brain activity for processing dynamic facial expressions. Human Brain Mapping, 2019. Vol. 40, no. 13, pp. 3753—3768. DOI:10.1002/hbm.24629
116. Sato W., Yoshikawa S. Enhanced experience of emotional arousal in response to dynamic facial expressions. Journal of Nonverbal Behavior, 2007. Vol. 31, no. 2, pp. 119—135. DOI:10.1007/s10919-007-0025-7
117. Sato W., Yoshikawa S. Spontaneous facial mimicry in response to dynamic facial expressions. Cognition, 2007. Vol. 104, no. 1, pp. 1—18. DOI:10.1016/j.cognition.2006.05.001
118. Sato W., Yoshikawa S. The dynamic aspects of emotional facial expressions. Cognition & Emotion, 2004. Vol. 18, no. 5, pp. 701—710. DOI:10.1080/02699930341000176
119. Schiano D.J., Ehrlich S.M., Sheridan K. Categorical imperative NOT: Facial Affect is Perceived Continuously. Proceedings of the 2004 conference on Human factors in computing systems - CHI ’04. New York, New York, USA: ACM Press, 2004. P. 49—56. DOI:10.1145/985692.985699
120. Scopa C., Palagi E. Mimic me while playing! Social tolerance and rapid facial mimicry in macaques (Macaca tonkeana and Macaca fuscata). Journal of Comparative Psychology, 2016. Vol. 130, no. 2, pp. 153— 161. DOI:10.1037/com0000028
121. Seibt B., Weyers P., Likowski K.U., Pauli P., Mühlberger A., Hess U. Subliminal Interdependence Priming Modulates Congruent and Incongruent Facial Reactions to Emotional Displays. Social Cognition, 2013. Vol. 31, no. 5, pp. 613—631. DOI:10.1521/soco.2013.31.5.613
122. Skuk V.G., Schweinberger S.R. Adaptation aftereffects in vocal emotion perception elicited by expressive faces and voices. PloS one, 2013. Vol. 8, no. 11, pp. 1—13. DOI:10.1371/journal.pone.0081691
123. Soussignan R., Chadwick M., Philip L., Conty L., Dezecache G., Grèzes J. Self-relevance appraisal of gaze direction and dynamic facial expressions: Effects on facial electromyographic and autonomic reactions. Emotion, 2013. Vol. 13, no. 2, pp. 330—337. DOI:10.1037/a0029892
124. Soussignan R., Dollion N., Schaal B., Durand K., Reissland N., Baudouin J.-Y. Mimicking emotions: how 3—12-month-old infants use the facial expressions and eyes of a model. Cognition and Emotion, 2018. Vol. 32, no. 4, pp. 827—842. DOI:10.1080/02699931.2017.1359015
125. Stienen B.M.C., Tanaka A., Gelder B. De. Emotional voice and emotional body postures influence each other independently of visual awareness. PloS one, 2011. Vol. 6, no. 10, pp. 1—7. DOI:10.1371/journal. pone.0025517
126. Stock J. Van den, Righart R., Gelder B. De. Body expressions influence recognition of emotions in the face and voice. Emotion, 2007. Vol. 7, no. 3, pp. 487—494. DOI:10.1037/1528-3542.7.3.487
127. Takagi S., Hiramatsu S., Tabei K., Tanaka A. Multisensory perception of the six basic emotions is modulated by attentional instruction and unattended modality. Frontiers in Integrative Neuroscience, 2015. Vol. 9, pp. 1—10. DOI:10.3389/fnint.2015.00001
128. Tanaka A., Koizumi A., Imai H., Hiramatsu S., Hiramoto E., Gelder B. De. I Feel Your Voice. Cultural differences in the multisensory perception of emotion. Psychological Science, 2010. Vol. 21, no. 9, pp. 1259— 1262. DOI:10.1177/0956797610380698
129. Vroomen J., Driver J., Gelder B. De. Is cross-modal integration of emotional expressions independent of attentional resources? Cognitive, Affective, & Behavioral Neuroscience, 2001. Vol. 1, no. 4, pp. 382—387. DOI:10.3758/CABN.1.4.382
130. Wallraven C., Breidt M., Cunningham D.W., Bülthoff H.H. Evaluating the perceptual realism of animated facial expressions. ACM Transactions on Applied Perception, 2008. Vol. 4, no. 4, pp. 1—20. DOI:10.1145/1278760.1278764
131. Wang X., Guo X., Chen L., Liu Y., Goldberg M.E., Xu H. Auditory to Visual Cross-Modal Adaptation for Emotion: Psychophysical and Neural Correlates. Cerebral Cortex, 2017. Vol. 27, no. 2, pp. 1337—1346. DOI:10.1093/cercor/bhv321
132. Watson R., Gelder B. de. The representation and plasticity of body emotion expression. Psychological Research, 2019. pp. 1—7. DOI:10.1007/s00426-018-1133-1
133. Weyers P., Mühlberger A., Hefele C., Pauli P. Electromyographic responses to static and dynamic avatar emotional facial expressions. Psychophysiology, 2006. Vol. 43, no. 5, pp. 450—453. DOI:10.1111/ j.1469-8986.2006.00451.x
134. Weyers P., Mühlberger A., Kund A., Hess U., Pauli P. Modulation of facial reactions to avatar emotional faces by nonconscious competition priming. Psychophysiology, 2009. Vol. 46, no. 2, pp. 328—335. DOI:10.1111/j.1469-8986.2008.00771.x
135. Wied M. de, Boxtel A. van, Zaalberg R., Goudena P.P., Matthys W. Facial EMG responses to dynamic emotional facial expressions in boys with disruptive behavior disorders. Journal of Psychiatric Research, 2006. Vol. 40, no. 2, pp. 112—121. DOI:10.1016/j.jpsychires.2005.08.003
136. Xiao N. The role of facial movements in face processing and its development. Graduate Department of Applied Psychology and Human Development. University of Toronto Thesis Ph.D. 2016.
137. Yarbus A.L. Eye Movements and Vision. N.Y.: Plenum, 1967. DOI:10.1007/978-1-4899-5379-7
138. Yoshikawa S., Sato W. Dynamic facial expressions of emotion induce representational momentum. Cognitive, Affective, & Behavioral Neuroscience, 2008. Vol. 8, no. 1, pp. 25—31. DOI:10.3758/CABN.8.1.25
139. Yuschenkova D.V., Meshcheryakov B.G. [Recognition of individual facial features as a basis for identification of the whole face]. Experimental Psychology (Russia), 2010. Vol. 3, no. 3, pp. 84—92.