Holistic Face Processing: the Eye Tracking Data

In modern literature, the question of holistic and analytic processing of facial perception and facial expressions is actively debated. Various experimental paradigms have been developed for their study, one of which was based on the face inversion effect. In a number of works to study the role of eye movements in holistic and analytic processing, the procedure of presenting upright and inverted faces was followed by recording eye movements. The results were contradictory: some works revealed significant changes in the characteristics of eye movements in the inversion effect, but the others have not found the changes. The aim of our work was to study individual eye movement strategies in the task of assessing the attractiveness of upright and inverted faces. The participants were 57 students. The results showed that a decrease in the role of holistic processing in the face inversion effect led to a significant change in fixation durations and saccade amplitudes, as well as to a change in the distribution of the dwell time on four areas of interest (eyes, nose, nose bridge and mouth). Two groups of participants with individual types of eye movement strategies (static and dynamic) were identified. Comparing eye movement strategies for upright and inverted faces showed that the dwell time distribution on areas of interest varied significantly depending on the group. These data showed the importance of incorporating the individual eye movement strategies when studying holistic and analytic face processing.

1. Barabanshchikov V.A Vospriyatie i sobytie. [Perception and event] SPb., Aletejya, 2002. (In Russ.).
2. Barabanshchikov V.A., Anan’eva K.I., Haritonov V.N. Organizatsiya dvijenii glaz pri vospriyatii izobrajenii litsa [The organization of eye movements in the perception of facial images] // Eksperimental’naya psikhologiya = Experimental Psychology, 2009, T. 2, № 2. pp. 31— 60. (In Russ.).
3. Barabanshchikov V.A., Zhegallo A.V. Zavisimost’ vospriyatiya ekspressii ot prostranstvennoj orientatsii izobrazhenii litsa [Dependence of the perception of expression on the spatial orientation of the face image] // Sovremennaya eksperimental’naya psikhologiya = Modern Experimental Psychology. M.: MGPPU-Izd-vo Institut psihologii RAN, 2011, Т. 2. pp. 55—80. (In Russ.).
4. Barabanschikov V.A. Ekspressii litsa i ikh vospriyatiye [The expression of the face and their perception] M.: Izd-vo «Institut psikhologii RAN», 2012. (In Russ.).
5. Barabanshchikov V.A., Zhegallo A.V. Okulomotornaya aktivnost’ pri vospriyatii dinamicheskih I staticheskih vyrazhenij litsa [Okulomotor activity at the perception of dynamic and static expressions of the face] // Eksperimental’naya psikhologiya = Experimental Psychology, 2018, Т. 11, №. 1. pp. 5—34. (In Russ.).
6. Barabanshchikov V.A., Besprozvannaya I.I. Sledy lichnosti na shematicheskom izobrazhenii litsa [Traces of the person on the schematic depiction of the person] // Eksperimental’naya psikhologiya = Experimental Psychology, 2019, Т. 12, № 2. pp. 16—34. doi:10.17759/exppsy.2019120202 (In Russ.).
7. Lunyakova E.G., Gani-zade D.S. Strategii dvijenii glaz pri raspoznavanii litsevoi ekspressii ne svyazany s vyrazhennost’yu effekta inversii [Eye movement strategies for recognizing facial expression are not associated with the severity of the inversion effect] // Kognitivnaya nauka v Mosckve: novye issledovaniya. Materialy konferentsii / Pod red. E.V. Pechnikovoj, M.V. Falikman, М.: Izd-vo ООО Buki Vedi, 2019. pp. 328—333. (In Russ.).
8. Men’shikova G.Ya., Lunyakova E.G. Individual’nye strategii dvijenij glaz v zadache opoznaniya ekspressij kompozitnyh lits [Individual strategies of eye movements in the task of recognizing the expressions of composite faces] // Psikhologiya cheloveka kak sub”ekta poznaniya, obshcheniya i deyatel’nosti / Оtv. red. V.V. Znakov, A.L. Zhuravlev. M.: Izd-vo «Institut psikhologii RAN», 2018. pp. 767—776. (In Russ.).
9. Men’shikova G.Ya. Lunyakova E.G., Gani-zade D.S. Analiticheskie i holisticheskie protcessi vospriyatiya litsa: modeli i metody issledovaniya [Analytical and Holistic Face Perception Processes: Models and Research Methods] // Voprosi psikhologii = Questions of Psychology, 2019, № 3. S. 155—165. (In Russ.).
10. Yarbus A.L. Rol’ dvizhenii glaz v protsesse zreniya [The role of eye movements in vision]. М. Nauka, 1965. (In Russ.).
11. Arizpe J.M., Noles D.L., Tsao J.W., Chan A.Y. Eye Movement Dynamics Differ between Encoding and Recognition of Faces // Vision 2019. Vol. 3(1). P. 9 https://doi.org/10.3390/vision3010009
12. Armann R., Bülthoff I. Gaze behavior in face comparison: the roles of sex, task, and symmetry // Atten. Percept. Psychophys. 2009. Vol. 71. P. 1107—1126.
13. Bargary G., Bosten J.M., Goodbourn P.T., Lawrance-Owen A.J., Hogg R.E., Mollon J.D. Individual differences in human eye movements: An oculomotor signature? // Vision Research. 2017. Vol. 141. P. 157—169.
14. Baudouin J.Y., Gallay M., Durand K., Robichon F. The development of perceptual sensitivity to second-order facial relations in children // Journal of Experimental Child Psychology. 2010. Vol. 107. P. 195—206.
15. Bombari D., Mast F. W., Lobmaier J. S. Featural, configural, and holistic face-processing strategies evoke different scan patterns //Perception. 2009. Vol. 38. №. 10. P. 1508—1521.
16. Brunswik E. Perception and representative design of psychological experiments. (2nd ed.). Berkeley, CA, US: University of California Press.1956. P. 154.
17. Caldara R., Zhou X., Miellet S. Putting culture under the spotlight reveals universal information use for face recognition // PLoS One. 2010. 5, e9708.10.1371/journal.pone.0009708.
18. Civile C., Mclaren R.P., Mclaren I.P.L. The face inversion effect—Parts and wholes: Individual features and their configuration // Quarterly journal of experimental psychology. 2014. Vol. 67. P. 728—746.
19. De Heering A., Rossion B., Maurer D. Developmental changes in face recognition during childhood: Evidence from upright and inverted faces // Cognitive Development. 2012. Vol. 27. P. 17—27.
20. Fan S. et al. Human perception of visual realism for photo and computer-generated face images //ACM Transactions on Applied Perception (TAP). 2014. Vol. 11. №. 2. P. 1—21.
21. Freedman E. G., Foxe J. J. Eye movements, sensorimotor adaptation and cerebellar-dependent learning in autism: toward potential biomarkers and subphenotypes //European Journal of Neuroscience. 2018. Vol. 47. №. 6. P. 549—555.
22. Galambos A., Turcsan B., Olah K., Elekes F., Gergely A., Kiraly I., Topal J. Visual fixation patterns during viewing of half-face stimuli in adults: an eye-tracking study // Front. Psychol. 2018. Vol. 9. № 2478. doi: 10.3389/fpsyg.2018.02478
23. Henderson J.M., Williams C.C., Falk, R.J. (2005). Eye movements are functional during face learning // Memory & Cognition, 33, 98—106.
24. Hsiao J.H., Cottrell G.W. Two fixations suffice in face recognition // Psychological Science. 2008. Vol. 9 (10). P. 998-1006.
25. Juhola M., Zhang Y. M., Rasku J. Biometric verification of a subject through eye movements // Computers in Biology and Medicine. 2013. Vol. 43 (1). P. 42—50.
26. McKone E., Robbins R. Are faces special? // The Oxford handbook of face perception. N.Y.: Oxford Univ. Press. Calder A.J., Rhodes G., Johnson M.H., Haxby J.V. (eds). 2011. Р. 149—176.
27. Peterson M.F., Eckstein M.P. Individual differences in eye movements during face identification reflect observer-specific optimal points of fixation // Psychological Science. 2013. Vol. 24 (7). P. 1216—1225. doi:10.1177/0956797612471684
28. Rezlescu C., Susilo T., Wilmer J., Caramazza A. The inversion, part-whole, and composite effects reflect distinct perceptual mechanisms with varied relationships to face recognition // Journal of Experimental Psychology: Human Perception and Performance, 2017. Vol. 43. P. 1961—1973. DOI: 10.1037/xhp0000400
29. Richler J.J., Gauthier I. A meta-analysis and review of holistic processing // Psychological Bulletin. 2014. Vol. 140 (5). P. 1281—1302.
30. Rossion B., Retter T.L. Holistic face perception: Mind the gap! // Visual Cognition. 2015. Vol. 23 (3). P. 379—398.
31. Schwarzer G., Huber S., Dümmler T. Gaze behavior in analytical and holistic face processing //Memory & Cognition. 2005. Vol. 33. №. 2. P. 344—354.
32. Tanaka J.W., Farah M.J. Parts and wholes in face recognition // Quarterly Journal of Experimental Psychology. 1993. Vol. 46 A. P. 225—245.
33. Unema P., Pannasch S., Joos M., Velichkovsky B. Time course of information processing during scene perception: The relationship between saccade amplitude and fixation duration. // Visual Cognition. 2005. Vol. 12. P. 473—494.
34. Van Belle G., De Graef P., Verfaillie K., Rossion B., Lefèvre P. Face inversion impairs holistic perception: evidence from gaze-contingent stimulation // Journal of Vision. 2010. Vol. 10 (5). P. 1—10.
35. Williams C.C., Henderson J.M. The face inversion effect is not a consequence of aberrant eye movements // Memory & Cognition 2007, 35 (8), P. 1977—1985.
36. Xu B., Tanaka J.W. Does face inversion qualitatively change face processing: An eye movement study using a face change detection task // Journal of vision. 2013. Vol. 13 (2). P. 22—22.
37. Yin R.K. Looking at upside-down faces // J. Exp. Psychology. 1969. Vol. 81. P. 141—145.