Key Links
Grad recruiting: www.maplelab.net/grad
“Blues for Gilbert” on Dr. Schutz’s YouTube channel
Interpreting Bach: www.maplelab.net/bach
MAESTRO: https://maplelab.net/maestro/
Eerola & Schutz (under review) preprint: https://osf.io/preprints/psyarxiv/9egwk
Eerola & Schutz (under review) software: https://pypi.org/project/relative-mode
Class demo examples of marimba gestures: https://maplelab.net/textbook-examples
Death by beep? on official TED website
Our Publications
Auditory Alarms
Amplitude Envelope and Auditory Perception
![]() | Bak, K., Chan, G. S., Schutz, M., & Campos, J. L. (2021). Perceptions of Audio-Visual Impact Events in Younger and Older Adults. Multisensory Research, 1(aop), 1–30. |
![]() | Schutz, M. & Gillard, J. (2020). On the generalization of tones: A detailed exploration of non-speech auditory perception stimuli. Scientific Reports, 10, 1–14. |
![]() | Schutz, M. (2019). Acoustic Structure and Musical Function: Musical Notes Informing Auditory Research. The Oxford Handbook of Music and Neuroscience. Michael Thaut and Donald Hodges, Eds. |
![]() | Schutz, M., Stefanucci, J., Baum, S., & Roth, A. (2017). Name that percussive tune: Associative memory and amplitude envelope. Quarterly Journal of Experimental Psychology, 70(7), 1323–1343. |
![]() | Ng, M., & Schutz, M. (2017). Seeing sound: A new tool for teaching music perception principles. Canadian Acoustics, 45(3), 104–105. MAESTRO: https://maplelab.net/maestro/ |
![]() | Chuen, L., & Schutz, M. (2016). The unity assumption facilitates cross-modal binding of musical, non-speech stimuli: The role of spectral and amplitude envelope cues. Attention, Perception, & Psychophysics, 78(5), 1512–1528. |
![]() | Schutz, M., & Vaisberg, J. (2014). Surveying the temporal structure of sounds used in Music Perception. Music Perception, 31(3), 288–296. |
![]() | Vallet, G., Shore, D., & Schutz, M. (2014). Exploring the role of amplitude envelope in duration estimation. Perception, 43, 616–630. |
![]() | Schutz, M., & Kubovy, M. (2009). Deconstructing a musical illusion: Point-light representations capture salient properties of impact motions. Canadian Acoustics, 37, 23–28. |
![]() | Schutz, M., & Kubovy, M. (2009). Causality and cross-modal integration. Journal of Experimental Psychology: Human Perception and Performance, 35, 1791–1810. |
![]() | Schutz, M., & Lipscomb, S. D. (2007). Hearing gestures, seeing music: Vision influences perceived tone duration. Perception, 36, 888–897. |
![]() | Schutz, M., & Kubovy, M. (2007). Seeing Music: Do we hear silent gestures? Invited lay-language version of technical paper presented at the 153rd meeting of the Acoustical Society of America. |
Musical Emotion
Commonality Analysis
External References
Aarden, B. (2003). Dynamic Melodic Expectancy. The Ohio State University.
Adachi, M., & Trehub, S. E. (1998). Children’s expression of emotion in song. Psychology of Music, 26, 133–153.
Alais, D., & Burr, D. (2004). The ventriloquist effect results from near-optimal bimodal integration. Current Biology, 14, 257–262.
Albrecht, J. D., & Huron, D. (2014). A statistical approach to tracing the historical development of major and minor pitch distributions, 1400-1750. Music Perception, 31, 223–243.
Albrecht, J. D., & Shanahan, D. (2013). The use of large corpora to train a new type of key-finding algorithm: An improved treatment of the minor mode. Music Perception, 31, 59–67.
Bach, J. S. (2004). The Well-Tempered Clavier, Volume I (3rd ed., p. 224; W. A. Palmer, Ed.). Los Angeles, CA: Alfred Music Publishing.
Barrett, F. S., Grimm, K. J., Robins, R. W., Wildschut, T., Sedikides, C., & Janata, P. (2010). Music-evoked nostalgia: Affect, memory, and personality. Emotion, 10, 390–403.
Bellmann, H. G. (2005). About the Determination of Key of a Musical Excerpt. Proceedings of Computer Music Modeling and Retrieval. Springer Berlin Heidelberg.
Broze, Y., & Huron, D. (2013). Is higher music faster? Pitch-speed relationships in Western compositions. Music Perception: An Interdisciplinary Journal, 31, 19–31.
Broze, Y., & Shanahan, D. (2013). Diachronic Changes in Jazz Harmony: A Cognitive Perspective. Music Perception: An Interdisciplinary Journal, 3, 32–45.
Capraro, R. M., & Capraro, M. M. (2001). Commonality analysis: Understanding variance contributions to overall canonical correlation effects of attitude toward mathematics on geometry achievement. Multiple Linear Regression Viewpoints, 27, 16-23-16–23.
Clendinning, J. P., & Marvin, E. W. (2016). The musician’s guide to theory and analysis. WW Norton & Company.
Cvach, M. M. (2012). Monitor alarm fatigue: An integrative review. Biomedical Instrumentation & Technology, 46, 268–277.
Dalla Bella, S., Peretz, I., Rousseau, L., & Gosselin, N. (2001). A developmental study of the affective value of tempo and mode in music. Cognition, 80, B1–B10.
Edworthy, J. (2013). Medical audible alarms: A review. Journal of the American Medical Informatics Association, 20, 584–589.
Edworthy, J., & Hellier, E. (2006). Alarms and human behaviour: Implications for medical alarms. British Journal of Anaesthesia, 97, 12–17.
Eerola, T., Friberg, A., & Bresin, R. (2013). Emotional expression in music: Contribution, linearity, and additivity of primary musical cues. Frontiers in Psychology, 4, 1–12.
Eerola, T., & Vuoskoski, J. K. (2013). A Review of Music and Emotion Studies: Approaches, Emotion Models, and Stimuli. Music Perception, 30, 307–340.
Ernst, M. O., & Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415, 429–433.
Fairbanks, G., & Pronovost, W. (1939). An experimental study of the pitch characteristics of the voice during the expression of emotion∗. Speech Monographs, 6, 87–104.
Fennell, A. M., Bugos, J. A., Payne, B. R., & Schotter, E. R. (2021). Music is similar to language in terms of working memory interference. Psychonomic Bulletin & Review, 28, 512–525.
Gagnon, L., & Peretz, I. (2003). Mode and tempo relative contributions to” happy-sad” judgements in equitone melodies. Cognition and Emotion, 17, 25–40.
Gaver, W. W. (1993). How do we hear in the world?: Explorations in ecological acoustics. Ecological Psychology, 5, 285–313.
Gemmeke, J. F., Ellis, D. P. W., Freedman, D., Jansen, A., Lawrence, W., Moore, R. C., … Ritter, M. (2017). Audio Set: An ontology and human-labeled dataset for audio events. 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 776–780.
Grahn, J. A., & Brett, M. (2007). Rhythm and beat perception in motor areas of the brain. Journal of Cognitive Neuroscience, 19, 893–906.
Grassi, M., & Casco, C. (2010). Audiovisual bounce–inducing effect: When sound congruence affects grouping in vision. Attention, Perception, & Psychophysics, 72, 378–386.
Harasim, D., Moss, F. C., Ramirez, M., & Rohrmeier, M. (2021). Exploring the foundations of tonality: Statistical cognitive modeling of modes in the history of Western classical music. Humanities and Social Sciences Communications, 8, 1–11.
Hatten, R. S. (2004). Interpreting musical gestures, topics, and tropes: Mozart, Beethoven, and Schubert. Bloomington, IN: Indiana University Press.
Hui, A. (2012). The Psychophysical Ear: Musical Experiments, Experimental Sounds, 1840-1910. MIT Press.
Ilie, G., & Thompson, W. F. (2006). A comparison of acoustic cues in music and speech for three dimensions of affect. Music Perception: An Interdisciplinary Journal, 23, 319–330.
Janata, P., Tomic, S. T., & Rakowski, S. K. (2007). Characterisation of music-evoked autobiographical memories. Memory, 15, 845–860.
Jantzen, M. G., Large, E. W., & Magne, C. (2016). Editorial: Overlap of Neural Systems for Processing Language and Music. Frontiers in Psychology, 7. https://doi.org/10.3389/fpsyg.2016.00876
Joris, P. X., Schreiner, C. E., & Rees, A. (2004). Neural processing of amplitude-modulated sounds. Physiological Reviews, 84, 541–577.
Juslin, P. N, & Lindstrom, E. (2010). Musical expression of emotions- Modelling listeners’ judgements of composed and performed features.
Juslin, Patrik N., & Sloboda, J. A. (2001). Music and emotion: Theory and research (p. 487). New York, NY: Oxford University Press.
Juslin, & Timmers, R. (2010). Expression and communication of emotion in music performance. Handbook of Music and Emotion: Theory, Research, Applications, 453–489.
Kiernan, F., Krause, A. E., & Davidson, J. W. (2022). The impact of biographical information about a composer on emotional responses to their music. Musicae Scientiae, 26, 558–584.
Kowalewski, D. A. (2023). The sound of manufactured music: Reviewing the role of artificial stimuli in music cognition research. Psychomusicology: Music, Mind, and Brain, 33, 70–91.
Leman, M. (2007). Embodied Music Cognition and Mediation Technology. MIT Press.
Leman, M., & Maes, P.-J. (2014). Music Perception and Embodied Music Cognition. In The Routledge Handbook of Embodied Cognition. Routledge.
Margulis, E. H., Loui, P., & Loughridge, D. (2023). The Science-Music Borderlands: Reckoning with the Past and Imagining the Future. MIT Press.
Mook, D. G. (1983). In defense of external invalidity. American Psychologist, 38, 379–387.
Neuhoff, J. G. (2004). Ecological psychoacoustics (p. 13; J. G. Neuhoff, Ed.). Amsterdam: Elsevier Academic Press.
Palmer, C. (1997). Music performance. Annual Review of Psychology, 48, 115–138.
Parncutt, R. (2014). The emotional connotations of major versus minor tonality: One or more origins? Musicae Scientiae, 18, 324–353.
Patel, A. D. (1998). Syntactic Processing in Language and Music: Different Cognitive Operations, Similar Neural Resources? Music Perception, 16, 27–42.
Patel, A. D. (2003). Language, music, syntax and the brain. Nature Neuroscience, 6, 674–681.
Patel, A. D. (2008). Music, language, and the brain. Oxford, England: Oxford University Press.
Patel, A. D., & Daniele, J. R. (2003). An empirical comparison of rhythm in language and music. Cognition, 87, B35–B45.
Peretz, I., Vuvan, D., Lagrois, M.-É., & Armony, J. L. (2015). Neural overlap in processing music and speech. Philosophical Transactions of the Royal Society B: Biological Sciences, 370, 20140090.
Phillips, D. P., Hall, S. E., & Boehnke, S. E. (2002). Central auditory onset responses, and temporal asymmetries in auditory perception. Hearing Research, 167, 192–205.
Quinn, I. (2010). Are Pitch-Class Profiles Really “Key for Key”? Zeitschrift Der Gesellschaft Für Musiktheorie [Journal of the German-Speaking Society of Music Theory], 7, 151–163.
Russell, J. A. (1980). A Circumplex Model of Affect. Journal of Personality and Social Psychology, 39, 1161–1178.
Sapp, C. S. (2011). Computational Methods for the Analysis of Musical Structure. Stanford University.
Schellenberg, E. G., Krysciak, A. M., & Campbell, J. R. (2000). Perceiving emotion in melody: Interactive effects of pitch and rhythm. Music Perception: An Interdisciplinary Journal, 18, 155–171.
Scherer, K. R. (2003). Vocal communication of emotion: A review of research paradigms. Speech Communication, 40, 227–256.
Schoenberg, A., & Stein, L. (1969). Structural functions of harmony. WW Norton & Company.
Schön, D., & Morillon, B. (2019). In The Oxford Handbook of Music and the Brain. Oxford University Press.
Seibold, D. R., & McPhee, R. D. (1979). Commonality Analysis: A Method for Decomposing Explained Variance in Multiple Regression Analyses. Human Communication Research, 5, 355–365.
Steege, B. (2012). Helmholtz and the Modern Listener. Cambridge University Press.
Tan, S.-L., Pfordresher, P., & Harré, R. (2010). The joy of (the psychology of) music. PsycCRITIQUES, 55. https://doi.org/10.1037/a0021130
Temperley, D. (2007). Music and Probability. MIT Press.
Temperley, D., & de Clercq, T. (2013). Statistical Analysis of Harmony and Melody in Rock Music. Journal of New Music Research, 42, 187–204.
Temperley, D., & Tan, D. (2013). Emotional connotations of diatonic modes. Music Perception: An Interdisciplinary Journal, 30, 237–257.
Thompson, S. (2007). Determinants of listeners’ enjoyment of a performance. Psychology of Music, 35, 20–36.
Thompson, W. F., Bullot, N. J., & Margulis, E. H. (2022). The psychological basis of music appreciation: Structure, self, source. Psychological Review, 130, 260.
Thompson, W. F., & Russo, F. A. (2007). Facing the music. Psychological Science, 18, 756–757.
Timmers, R., & Ashley, R. (2007). Emotional ornamentation in performances of a Handel sonata. Music Perception, 25, 117–134.
Walker, J. T., & Scott, K. J. (1981). Auditory-visual conflicts in the perceived duration of lights, tones and gaps. Journal of Experimental Psychology: Human Perception and Performance, 7, 1327–1339.
Weiß, C., Mauch, M., Dixon, S., & Müller, M. (2019). Investigating style evolution of Western classical music: A computational approach. Musicae Scientiae, 23, 486–507.
Welch, R. B., DuttonHurt, L. D., & Warren, D. H. (1986). Contributions of audition and vision to temporal rate perception. Perception & Psychophysics, 39, 294–300.
White, C. (2022). The Music in the Data: Corpus Analysis, Music Analysis, and Tonal Traditions. New York: Routledge. Zatorre, R. J., Chen, J. L., & Penhune, V. B. (2007). When the brain plays music: Auditory–motor interactions in music perception and production. Nature Reviews Neuroscience, 8, 547-558-547–558.


