Building an Individual Portrait of the Dynamics of Music Perception Using Time-Frequency Analysis of Summary Skin Potential

The individual dynamics of the emotional component of the perception of musical melodies was studied. The indicators of emotional status were involuntary reactions of the summary skin potential (SSP) and arbitrary clicks by subjects on the “like” or “dislike” buttons while listening to melodies. The frequency of arbitrary button clicks serves as an indicator of the degree of differentiation (detail) of the conscious perception of various elements of the melody. By digital processing of the SSP, its derivatives were obtained — heart rate, median frequency and the RMS amplitude of the SSP as functions of time, etc. The temporal dynamics of these indicators turned out to be more intense compared to the frequency of pressing, which is explained by the specificity of the interaction between conscious and unconscious levels of perceptions. In connection with the use of several indicators of continuous emotional dynamics, there is a need for their integral representation. An example of such integration is given for two indicators in the form of individual approximating ellipses. In the future, it is planned to use modern computer graphics to solve the problem.

1. Adorno T.V. Tipy otnosheniya k muzyke / T.V. Adorno // Izbrannoe: Sociologiya muzyki /sost. S.Ya. Levit, S.Yu. Xurumov; per. s nem. — 2-e izd. — Moskva: Rossijskaya politicheskaya enciklopediya, 2008. — S. 10—26. (In Russ.).
2. Aparina I.M. Vliyanie muzyki i muzykalnoj deyatelnosti na emocionalnoe razvitie detej / I. M. Aparina // Muzykalnoe i xudozhestvennoe obrazovanie detej i yunoshestva: teoriya i praktika: mezhvuzovskij sbornik nauchnyx trudov. Uralskij gos. ped. un-t; otv. red. K.P. Matveeva. Ekaterinburg, 2011. S. 13—17. (In Russ.).
3. Bochkarev L.L. Psihologiya muzykalnoj deyatelnosti. — M.: Izd-vo «Institut psihologii RAN», 2004. 352 s. (In Russ.).
4. Gotsdiner A.L. Muzykalnaya psihologiya. — M.: Izd. Mezhd. akad. ped. nauk, 1993. — 189 s. (In Russ.).
5. Kirnarskaya D.K. Muzykalnoe vospriyatie [Tekst] / D.K. Kirnarskaya // Muzy-kalnaya psihologiya i psihologiya muzykalnogo obrazovaniya: Teoriya i praktika : uchebnik dlya stud. muz. fak. uchrezhdenij vyssh. ped. prof. obrazovaniya [D.K. Kirnarskaya, N.I. Kiyashhenko, K.V. Tarasova i dr.] ; pod. red. G.M. Cypina. 2-e izd., pererab. i dop. M. : Akademiya, 2011. — S. 68—123. (In Russ.).
6. Kurt E. Struktura muzykalnogo vospriyatiya. Tonpsixologiya i muzykalnaya psixologiya [Tekst] / E. Kurt // Psixologiya muzyki i muzykalnyx sposobnostej: xrestomatiya / sost. i red. A.E. Taras. M. : AST ; Minsk : Xarvest, 2005. — S. 643—673. (In Russ.).
7. Nazarov A.I. Sravnenie chastotnyx komponent EEG i kozhnogo potenciala (kolichestvennyj analiz) // Eksperimentalnaya psihologiya. 2018. T. 11. №. 2. S. 95—109. doi:10.17759/exppsy.2018110207 (In Russ.).
8. Ovsyankina G.P. Muzykalnaya psihologiya. — M.: «Soyuz hudozhnikov», 2007. — 240 s. (In Russ.).
9. Petrushin V. I. Poznavatelnye processy v deyatelnosti muzykanta // Muzykalnaya psihologiya: ucheb. posobie dlya vuzov; 3-e izd. M: Akademicheskij proekt; Gaudeamus, 2009. S. 188. (In Russ.).
10. Polyakova A.S. Psixosomaticheskie indikatory emocionalnyx sostoyanij pri vospriyatii muzyki // Magisterskaya dissertaciya. Gosudarstvennyj universitet «Dubna», 2019. (In Russ.).
11. Teplov B.M. Osnovnye muzykalnye sposobnosti. Gl. IX [Tekst] / B. M. Teplov // Psixologiya muzykalnyx sposobnostej. — M. : Izd-vo Akademii ped. nauk, 1947. Gl. IX. S. 303—319. (In Russ.).
12. Yavorskij B., Belyaeva S-E. Struktura melodii. — M.: Gosudarstvennaya akademiya xudozhestvennyx nauk, 1929. (In Russ.).
13. Grewe O.N.F., Reinhard K., Altenmuller E. Emotions over time: synchronicity and development of subjective, physiological, and facial affective responses to music // Emotion. 2007. Vol. 7. Р. 774—788.
14. Gupta U., Gupta B.S. Psychophysiological reactions to music in male coronary patients and healthy controls // Psychology of Music. 2015. Vol. 43(5). P. 736—755.
15. Juslin P.N., Vastfjall D. Emotional responses to music: the need to consider underlying mechanisms // Behavioral Brain Science. 2008. Vol. 31. P. 559—621.
16. Koelsch S., Jentschke S., Sammler D., and D. Mietchen. Untangling syntactic and sensory processing: An ERP study of music perception // Psychophysiology. 2007. Vol. 44. Р. 476—490.
17. Krumhansl C.L. An exploratory study of musical emotions and psychophysiology // Canadian J. Experimental Psychology. 1997. Vol. 51. Р. 336—353.
18. Lundqvist L-O., Carlsson F., Hilmersson P., Juslin P.N. Emotional responses to music: experience, expression, physiology // Psychology of Music. 2009. Vol. 37. Р. 61—90.
19. Music Perception / Eds. M.R. Jones, R.R. Fay, A.N. Popper. Springer. New York — Dordrecht — Heidelberg — London. 2010.
20. Nykliček I., Thayer J.F., Van Doornen L.J.P. Cardiorespiratory differentiation of musically induced emotions. // J. Psychophysiology. 1997. Vol. 11. P. 304—321.
21. Peretz I. Towards a neurobiology of musical emotions / Handbook of Music and Emotion: Theory, Research, Applications / P.N Juslin, J.A Sloboda (eds). Oxford: Oxford University Press. 2010. P. 99—126.
22. Sammler D., Grigutsch M., Fritz T., Koelsch S. Music and emotion: electrophysiological correlates of the processing of pleasant and unpleasant music // Psychophysiology. 2007. Vol. 44. Р. 293—304.
23. Schmidt L.A., Trainor L.J. Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions // Cognition and. Emotion. 2001. Vol. 15. Р. 487—500.
24. Sokhadze E.M. Effects of music on the recovery of autonomic and electrocortical activity after stress induced by aversive visual stimuli // Applied psychophysiology and biofeedback.. 2007. Vol. 32. № 1. P. 31—50.
25. Witvliet C.V.O., Vrana S.R. Play it again Sam: repeated exposure to emotionally evocative music polarises liking and smiling responses and influences other affective reports facial EMG and heart rate // Cognition and Emotion. 2007. Vol. 21. P. 3—25.
26. Zentner M.R., Grandjean D., Scherer K.R. Emotions evoked by the sound of music: characterization classification and measurement // Emotion. 2008. Vol. 8. P. 494—521.