Recognition of facial expressions during step-function stroboscopic presentation

We studied the perception of human facial emotional expressions during step-function stroboscopic presentation of changing mimics. Consecutive stages of each of the six basic facial expressions were pre sented to the participants: neutral face (300 ms) — expression of medium intensity (10—40 ms) — intense expression (30—120 ms) — expression of medium intensity (10—40 ms) — neutral face (100 ms). Alternative forced choice task was used to categorize the facial expressions. The results were compared to previous studies (Barabanschikov, Korolkova, Lobodinskaya, 2015; 2016), conducted using the same paradigm but with boxcar-function change of the expression: neutral face — intense expression — neutral face. We found that the dynamics of facial expression recognition, as well as errors and recognition time are almost identical in conditions of boxcar- and step-function presentation. One factor influencing the recognition rate is the proportion of presentation time of static (neutral) and changing (facial expression) aspects of the stimulus. In suboptimal conditions of facial expression perception (minimal presentation time of 10+30+10 ms and reduced intensity of expressions) we revealed stroboscopic sensibilization — a previously described phenomenon of enhanced recognition rate of low-attractive expressions (disgust, sadness, fear and anger), which has been previously found in conditions of boxcar-function presentation of expressions. We confirmed the similarity of influence of real and apparent motion on the recognition of basic facial emotional expressions.

1. Ambadar Z., Schooler J.W., Cohn J.F. Deciphering the Enigmatic Face: The Importance of Facial Dynamics in Interpreting Subtle Facial Expressions. Psychological Science, 2005, vol. 16, no. 5, pp. 403—410. doi: 10.1111/j.0956-7976.2005.01548.x
2. Barabanschikov V.A. Dynamics of facial expressions perception. Moscow, Kogito-Tsentr, 2016. (In Russ.).
3. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. Otsenka emotsional’nykh ekspressii razlichnoi stepeni chetkosti [Evaluation of emotional expressions of varying degrees of clarity]. In A.L. Zhuravlev, V.A. Koltsova (eds.), Fundamental’nye I prikladnye issledovaniia sovremennoi psikhologii: rezul’taty I perspektivy razvitiia [ Fundamental and applied research of modern psychology: results and development prospects]. Moscow, IPRAS Publ., 2017. pp. 417—422. (In Russ.).
4. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. Vliianie kazhushchegosia dvizheniia rasfokusirovannogo izobrazheniia litsa na raspoznavanie bazovykh emotsii [The influence of the apparent movement of the defocused face image on the recognition of basic emotions]. In N.B. Karabushchenko, N.L. Sungurova (eds.), Aktual’nye problemy psikhologii I pedagogiki v sovremennom mire: sbornik trudov uchastnikov III Mezhdunarodnoi nauchno-prakticheskoi konferentsii [ Actual problems of psychology and pedagogy in the modern world: a collection of works of participants of the III International Scientific and Practical Conference]. Moscow, RUDN Publ., 2017. pp. 50—58. (In Russ.).
5. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. Vliianie mikropauzy na raspoznavanie bazovykh ekspressii pri stroboskopicheskoi ekspozitsii litsa [The role of brief ISI in perception of facial emotional expressions during stroboscopic exposition]. In K.I. Ananyeva, V.A. Barabanschikov, A.A. Demidov (eds.), Litso cheloveka v prostranstve obshcheniia [Human face in the communicational space]. Moscow, Cogito-Center Publ., 2016. pp. 339—353. (In Russ.).
6. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. Vospriyatie emotsional’nykh ekspressii litsa pri ego maskirovke I kazhushchemsya dvizhenii [Perception of facial expressions during masking and apparent motion]. Eksperimental’naya psikhologiya [Experimental Psychology (Russia)], 2015, vol. 8, no. 1, pp. 7—27. (In Russ.; abstr. in Engl.).
7. Barabanschikov V.A., Korolkova O.A., Lobodinskaya E.A. Zavisimost’ vospriiatiia litsevykh ekspressii ot prostranstvenno-vremennoi struktury ekspozitsii [The dependence of the perception of facial expressions on the spatial-temporal structure of the exposure]. In V.A. Barabanschikov (ed.), Kognitivnye mekhanizmy neverbal’noi kommunikatsii [Cognitive mechanisms of non-verbal communication]. Moscow, Cogito-Center Publ., 2016. pp. 48—101. (In Russ.).
8. Bates D., Mächler M., Bolker B., Walker S. Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software, 2015, vol. 67, no. 1, pp. 1—48. doi: 10.18637/jss.v067.i01
9. Cosker D., Krumhuber E., Hilton A. Perception of linear and nonlinear motion properties using a FACS validated 3D facial model. Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization — APGV ’10. N.Y., ACM Press, 2010. pp. 101—108. doi: 10.1145/1836248.1836268
10. Cunningham D.W., Wallraven C. Dynamic information for the recognition of conversational expressions. Journal of Vision, 2009, vol. 9, no. 13, pp. 1—17. doi: 10.1167/9.13.7
11. Hill H.C.H., Troje N.F., Johnston A. Range- and domain-specific exaggeration of facial speech. Journal of vision, 2005, vol. 5, no. 10, pp. 793—807. doi: 10.1167/5.10.4
12. Langner O., Dotsch R., Bijlstra G., Wigboldus D.H.J., Hawk S.T., Knippenberg A. van. Presentation and validation of the Radboud Faces Database. Cognition & Emotion, 2010, vol. 24, no. 8, pp. 1377—1388. doi: 10.1080/02699930903485076
13. Leonard C.M., Voeller K.K.S., Kuldau J.M. When’s a Smile a Smile? Or how to Detect a Message by Digitizing the Signal. Psychological Science, 1991, vol. 2, no. 3, pp. 166—172. doi: 10.1111/j.1467-9280.1991. tb00125.x
14. Recio G., Sommer W., Schacht A. Electrophysiological correlates of perceiving and evaluating static and dynamic facial emotional expressions. Brain Research, 2011, vol. 1376, no. 2, pp. 66—75. doi: 10.1016/j. brainres.2010.12.041
15. Sato W., Yoshikawa S. The dynamic aspects of emotional facial expressions. Cognition & Emotion, 2004, vol. 18, no. 5, pp. 701—710. doi: 10.1080/02699930341000176
16. Wallraven C., Breidt M., Cunningham D.W., Bülthoff H.H. Evaluating the perceptual realism of animated facial expressions. ACM Transactionson Applied Perception, 2008, vol. 4, no. 4, pp. 1—20. doi: 10.1145/1278760.1278764