References and Key Links Noted in SMPC 2024 Keynote

Key Links

Grad recruiting: www.maplelab.net/grad

“Blues for Gilbert” on Dr. Schutz’s YouTube channel

Interpreting Bach: www.maplelab.net/bach

MAESTRO: https://maplelab.net/maestro/

Eerola & Schutz (under review) preprint: https://osf.io/preprints/psyarxiv/9egwk

Eerola & Schutz (under review) software: https://pypi.org/project/relative-mode

Class demo examples of marimba gestures: https://maplelab.net/textbook-examples

Death by beep? on official TED website

Our Publications

Auditory Alarms

Burdick, K., Yang, S., Lopez, A. E., Wessel, C., Schutz, M., Schlesinger, J.J. (2023). Auditory roughness: a delicate balance. British Journal of Anaesthesia, 131 (4), 649-652.
Anderson, C. J., Sreetharan, S., Elizondo López, A. E., Schlesinger, J. J., & Schutz, M. (2023). Improving auditory alarms: Reducing perceived annoyance with musical timbre (a randomized trial). Perioperative Care and Operating Room Management, 32, 100332.
Foley, L., Schlesinger, J., & Schutz, M. (2023). Improving detectability of auditory interfaces for medical alarms through temporal variation in amplitude envelope. British Journal of Anaesthesia, 130 (3), 351–359
Foley, L., Schlesinger, J., & Schutz, M. (2022). More detectable, less annoying: Temporal variation in amplitude envelope and spectral content improves auditory interface efficacy. The Journal of the Acoustical Society of America151(5), 3189-3196.
Foley, L., Schutz, M. (2021). High time for temporal variation: improving sonic interaction with auditory interfaces. IEEE Signal Process. Mag.
Sreetharan, S., Schlesinger, J. & Schutz, M. (2021) Decaying amplitude envelopes reduce alarm annoyance: Exploring new approaches to improving auditory interfaces. Applied Ergonomics, 96.
Foley, L., Anderson, C. J., & Schutz, M. (2020). Re-Sounding Alarms: Designing Ergonomic Auditory Interfaces by Embracing Musical Insights. Healthcare8(4), 389.
Sreetharan, S., & Schutz, M. (2019). Improving Human-Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope. Multimodal Technologies and Interaction.
Schutz, M., & Stefanucci, J. (2019). Hearing value: Exploring the effects of amplitude envelope on consumer preference. Ergonomics in Design: The Quarterly of Human Factors Applications, 27(1), 16–19.
Gillard, J. & Schutz, M. (2016). Composing alarms: Considering the musical aspects of auditory alarm design. Neurocase, 22(6), 566–576.
Schutz, M. (2016). Clarifying amplitude envelope’s crucial role in auditory perception. Canadian Acoustics, 44(2), 42–43.
Schutz, M., & Vaisberg, J. (2014). Surveying the temporal structure of sounds used in Music Perception. Music Perception, 31(3), 288–296.
Vallet, G., Shore, D., & Schutz, M. (2014). Exploring the role of amplitude envelope in duration estimation. Perception, 43, 616–630.

Amplitude Envelope and Auditory Perception

Bak, K., Chan, G. S., Schutz, M., & Campos, J. L. (2021). Perceptions of Audio-Visual Impact Events in Younger and Older Adults. Multisensory Research1(aop), 1–30.
Schutz, M. & Gillard, J. (2020). On the generalization of tones: A detailed exploration of non-speech auditory perception stimuli. Scientific Reports10, 1–14.
Schutz, M. (2019). Acoustic Structure and Musical Function: Musical Notes Informing Auditory Research. The Oxford Handbook of Music and Neuroscience. Michael Thaut and Donald Hodges, Eds.
Schutz, M., Stefanucci, J., Baum, S., & Roth, A. (2017). Name that percussive tune: Associative memory and amplitude envelope. Quarterly Journal of Experimental Psychology, 70(7), 1323–1343.
Ng, M., & Schutz, M. (2017). Seeing sound: A new tool for teaching music perception principles. Canadian Acoustics45(3), 104–105.
MAESTRO: https://maplelab.net/maestro/
Chuen, L., & Schutz, M. (2016). The unity assumption facilitates cross-modal binding of musical, non-speech stimuli: The role of spectral and amplitude envelope cues. Attention, Perception, & Psychophysics, 78(5), 1512–1528.
Schutz, M., & Vaisberg, J. (2014). Surveying the temporal structure of sounds used in Music Perception. Music Perception, 31(3), 288–296.
Vallet, G., Shore, D., & Schutz, M. (2014). Exploring the role of amplitude envelope in duration estimation. Perception, 43, 616–630.
Schutz, M., & Kubovy, M. (2009). Deconstructing a musical illusion: Point-light representations capture salient properties of impact motions. Canadian Acoustics, 37, 23–28.
Schutz, M., & Kubovy, M. (2009). Causality and cross-modal integration. Journal of Experimental Psychology: Human Perception and Performance, 35, 1791–1810.
Schutz, M., & Lipscomb, S. D. (2007). Hearing gestures, seeing music: Vision influences perceived tone duration. Perception, 36, 888–897.
Schutz, M., & Kubovy, M. (2007). Seeing Music: Do we hear silent gestures? Invited lay-language version of technical paper presented at the 153rd meeting of the Acoustical Society of America.

Musical Emotion

Anderson, C. J., & Schutz, M. (2023). Understanding Feature Importance in Musical Works: Unpacking Predictive Contributions to Cluster Analyses. Music & Science, 6.
Kelly, B. O., Anderson, C. J., & Schutz, M. (2021). Exploring changes in the emotional classification of music between eras. Auditory Perception & Cognition, 4(1-2)121–131.
Schutz, M. (2017). Acoustic Constraints and Musical Consequences: Exploring Composers’ Use of Cues for Musical Emotion. Frontiers in Psychology, 8, 1–10. https://doi.org/10.3389/fpsyg.2017.01402
Poon, M., & Schutz, M. (2015). Cueing musical emotions: An empirical analysis of 24-piece sets by Bach and Chopin documents parallels with emotional speech. Frontiers in Psychology (Cognition), 6, 1419.

Commonality Analysis

Delle Grazie, Anderson & Schutz (in press).  Breaking with Common Practice: Exploring Modernist Musical Emotion, Psychology of Music.
Anderson, C. J., & Schutz, M. (2022). Exploring historic changes in musical communication: Deconstructing emotional cues in preludes by Bach and Chopin. Psychology of Music, 50 (5), 1424–1442.
Battcock, A., & Schutz, M. (2022). Emotion and expertise: how listeners with formal music training use cues to perceive emotion. Psychological Research86, 66–86.
Battcock, A., & Schutz, M. (2021).  Individualized interpretation: Exploring structural and interpretive effects on evaluations of emotional content in Bach’s Well Tempered Clavier. Journal of New Music Research, 50(5), 447–468.
Battcock, A., & Schutz, M. (2019). Acoustically Expressing Affect. Music Perception, 37(1), 66–91.

External References

Aarden, B. (2003). Dynamic Melodic Expectancy. The Ohio State University.

Adachi, M., & Trehub, S. E. (1998). Children’s expression of emotion in song. Psychology of Music, 26, 133–153.

Alais, D., & Burr, D. (2004). The ventriloquist effect results from near-optimal bimodal integration. Current Biology, 14, 257–262.

Albrecht, J. D., & Huron, D. (2014). A statistical approach to tracing the historical development of major and minor pitch distributions, 1400-1750. Music Perception, 31, 223–243.

Albrecht, J. D., & Shanahan, D. (2013). The use of large corpora to train a new type of key-finding algorithm: An improved treatment of the minor mode. Music Perception, 31, 59–67.

Bach, J. S. (2004). The Well-Tempered Clavier, Volume I (3rd ed., p. 224; W. A. Palmer, Ed.). Los Angeles, CA: Alfred Music Publishing.

Barrett, F. S., Grimm, K. J., Robins, R. W., Wildschut, T., Sedikides, C., & Janata, P. (2010). Music-evoked nostalgia: Affect, memory, and personality. Emotion, 10, 390–403.

Bellmann, H. G. (2005). About the Determination of Key of a Musical Excerpt. Proceedings of Computer Music Modeling and Retrieval. Springer Berlin Heidelberg.

Broze, Y., & Huron, D. (2013). Is higher music faster? Pitch-speed relationships in Western compositions. Music Perception: An Interdisciplinary Journal, 31, 19–31.

Broze, Y., & Shanahan, D. (2013). Diachronic Changes in Jazz Harmony: A Cognitive Perspective. Music Perception: An Interdisciplinary Journal, 3, 32–45.

Capraro, R. M., & Capraro, M. M. (2001). Commonality analysis: Understanding variance contributions to overall canonical correlation effects of attitude toward mathematics on geometry achievement. Multiple Linear Regression Viewpoints, 27, 16-23-16–23.

Clendinning, J. P., & Marvin, E. W. (2016). The musician’s guide to theory and analysis. WW Norton & Company.

Cvach, M. M. (2012). Monitor alarm fatigue: An integrative review. Biomedical Instrumentation & Technology, 46, 268–277.

Dalla Bella, S., Peretz, I., Rousseau, L., & Gosselin, N. (2001). A developmental study of the affective value of tempo and mode in music. Cognition, 80, B1–B10.

Edworthy, J. (2013). Medical audible alarms: A review. Journal of the American Medical Informatics Association, 20, 584–589.

Edworthy, J., & Hellier, E. (2006). Alarms and human behaviour: Implications for medical alarms. British Journal of Anaesthesia, 97, 12–17.

Eerola, T., Friberg, A., & Bresin, R. (2013). Emotional expression in music: Contribution, linearity, and additivity of primary musical cues. Frontiers in Psychology, 4, 1–12.

Eerola, T., & Vuoskoski, J. K. (2013). A Review of Music and Emotion Studies: Approaches, Emotion Models, and Stimuli. Music Perception, 30, 307–340.

Ernst, M. O., & Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415, 429–433.

Fairbanks, G., & Pronovost, W. (1939). An experimental study of the pitch characteristics of the voice during the expression of emotion∗. Speech Monographs, 6, 87–104.

Fennell, A. M., Bugos, J. A., Payne, B. R., & Schotter, E. R. (2021). Music is similar to language in terms of working memory interference. Psychonomic Bulletin & Review, 28, 512–525.

Gagnon, L., & Peretz, I. (2003). Mode and tempo relative contributions to” happy-sad” judgements in equitone melodies. Cognition and Emotion, 17, 25–40.

Gaver, W. W. (1993). How do we hear in the world?: Explorations in ecological acoustics. Ecological Psychology, 5, 285–313.

Gemmeke, J. F., Ellis, D. P. W., Freedman, D., Jansen, A., Lawrence, W., Moore, R. C., … Ritter, M. (2017). Audio Set: An ontology and human-labeled dataset for audio events. 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 776–780.

Grahn, J. A., & Brett, M. (2007). Rhythm and beat perception in motor areas of the brain. Journal of Cognitive Neuroscience, 19, 893–906.

Grassi, M., & Casco, C. (2010). Audiovisual bounce–inducing effect: When sound congruence affects grouping in vision. Attention, Perception, & Psychophysics, 72, 378–386.

Harasim, D., Moss, F. C., Ramirez, M., & Rohrmeier, M. (2021). Exploring the foundations of tonality: Statistical cognitive modeling of modes in the history of Western classical music. Humanities and Social Sciences Communications, 8, 1–11.

Hatten, R. S. (2004). Interpreting musical gestures, topics, and tropes: Mozart, Beethoven, and Schubert. Bloomington, IN: Indiana University Press.

Hui, A. (2012). The Psychophysical Ear: Musical Experiments, Experimental Sounds, 1840-1910. MIT Press.

Ilie, G., & Thompson, W. F. (2006). A comparison of acoustic cues in music and speech for three dimensions of affect. Music Perception: An Interdisciplinary Journal, 23, 319–330.

Janata, P., Tomic, S. T., & Rakowski, S. K. (2007). Characterisation of music-evoked autobiographical memories. Memory, 15, 845–860.

Jantzen, M. G., Large, E. W., & Magne, C. (2016). Editorial: Overlap of Neural Systems for Processing Language and Music. Frontiers in Psychology, 7. https://doi.org/10.3389/fpsyg.2016.00876

Joris, P. X., Schreiner, C. E., & Rees, A. (2004). Neural processing of amplitude-modulated sounds. Physiological Reviews, 84, 541–577.

Juslin, P. N, & Lindstrom, E. (2010). Musical expression of emotions- Modelling listeners’ judgements of composed and performed features.

Juslin, Patrik N., & Sloboda, J. A. (2001). Music and emotion: Theory and research (p. 487). New York, NY: Oxford University Press.

Juslin, & Timmers, R. (2010). Expression and communication of emotion in music performance. Handbook of Music and Emotion: Theory, Research, Applications, 453–489.

Kiernan, F., Krause, A. E., & Davidson, J. W. (2022). The impact of biographical information about a composer on emotional responses to their music. Musicae Scientiae, 26, 558–584.

Kowalewski, D. A. (2023). The sound of manufactured music: Reviewing the role of artificial stimuli in music cognition research. Psychomusicology: Music, Mind, and Brain, 33, 70–91.

Leman, M. (2007). Embodied Music Cognition and Mediation Technology. MIT Press.

Leman, M., & Maes, P.-J. (2014). Music Perception and Embodied Music Cognition. In The Routledge Handbook of Embodied Cognition. Routledge.

Margulis, E. H., Loui, P., & Loughridge, D. (2023). The Science-Music Borderlands: Reckoning with the Past and Imagining the Future. MIT Press.

Mook, D. G. (1983). In defense of external invalidity. American Psychologist, 38, 379–387.

Neuhoff, J. G. (2004). Ecological psychoacoustics (p. 13; J. G. Neuhoff, Ed.). Amsterdam: Elsevier Academic Press.

Palmer, C. (1997). Music performance. Annual Review of Psychology, 48, 115–138.

Parncutt, R. (2014). The emotional connotations of major versus minor tonality: One or more origins? Musicae Scientiae, 18, 324–353.

Patel, A. D. (1998). Syntactic Processing in Language and Music: Different Cognitive Operations, Similar Neural Resources? Music Perception, 16, 27–42.

Patel, A. D. (2003). Language, music, syntax and the brain. Nature Neuroscience, 6, 674–681.

Patel, A. D. (2008). Music, language, and the brain. Oxford, England: Oxford University Press.

Patel, A. D., & Daniele, J. R. (2003). An empirical comparison of rhythm in language and music. Cognition, 87, B35–B45.

Peretz, I., Vuvan, D., Lagrois, M.-É., & Armony, J. L. (2015). Neural overlap in processing music and speech. Philosophical Transactions of the Royal Society B: Biological Sciences, 370, 20140090.

Phillips, D. P., Hall, S. E., & Boehnke, S. E. (2002). Central auditory onset responses, and temporal asymmetries in auditory perception. Hearing Research, 167, 192–205.

Quinn, I. (2010). Are Pitch-Class Profiles Really “Key for Key”? Zeitschrift Der Gesellschaft Für Musiktheorie [Journal of the German-Speaking Society of Music Theory], 7, 151–163.

Russell, J. A. (1980). A Circumplex Model of Affect. Journal of Personality and Social Psychology, 39, 1161–1178.

Sapp, C. S. (2011). Computational Methods for the Analysis of Musical Structure. Stanford University.

Schellenberg, E. G., Krysciak, A. M., & Campbell, J. R. (2000). Perceiving emotion in melody: Interactive effects of pitch and rhythm. Music Perception: An Interdisciplinary Journal, 18, 155–171.

Scherer, K. R. (2003). Vocal communication of emotion: A review of research paradigms. Speech Communication, 40, 227–256.

Schoenberg, A., & Stein, L. (1969). Structural functions of harmony. WW Norton & Company.

Schön, D., & Morillon, B. (2019). In The Oxford Handbook of Music and the Brain. Oxford University Press.

Seibold, D. R., & McPhee, R. D. (1979). Commonality Analysis: A Method for Decomposing Explained Variance in Multiple Regression Analyses. Human Communication Research, 5, 355–365.

Steege, B. (2012). Helmholtz and the Modern Listener. Cambridge University Press.

Tan, S.-L., Pfordresher, P., & Harré, R. (2010). The joy of (the psychology of) music. PsycCRITIQUES, 55. https://doi.org/10.1037/a0021130

Temperley, D. (2007). Music and Probability. MIT Press.

Temperley, D., & de Clercq, T. (2013). Statistical Analysis of Harmony and Melody in Rock Music. Journal of New Music Research, 42, 187–204.

Temperley, D., & Tan, D. (2013). Emotional connotations of diatonic modes. Music Perception: An Interdisciplinary Journal, 30, 237–257.

Thompson, S. (2007). Determinants of listeners’ enjoyment of a performance. Psychology of Music, 35, 20–36.

Thompson, W. F., Bullot, N. J., & Margulis, E. H. (2022). The psychological basis of music appreciation: Structure, self, source. Psychological Review, 130, 260.

Thompson, W. F., & Russo, F. A. (2007). Facing the music. Psychological Science, 18, 756–757.

Timmers, R., & Ashley, R. (2007). Emotional ornamentation in performances of a Handel sonata. Music Perception, 25, 117–134.

Walker, J. T., & Scott, K. J. (1981). Auditory-visual conflicts in the perceived duration of lights, tones and gaps. Journal of Experimental Psychology: Human Perception and Performance, 7, 1327–1339.

Weiß, C., Mauch, M., Dixon, S., & Müller, M. (2019). Investigating style evolution of Western classical music: A computational approach. Musicae Scientiae, 23, 486–507.

Welch, R. B., DuttonHurt, L. D., & Warren, D. H. (1986). Contributions of audition and vision to temporal rate perception. Perception & Psychophysics, 39, 294–300.

White, C. (2022). The Music in the Data: Corpus Analysis, Music Analysis, and Tonal Traditions. New York: Routledge. Zatorre, R. J., Chen, J. L., & Penhune, V. B. (2007). When the brain plays music: Auditory–motor interactions in music perception and production. Nature Reviews Neuroscience, 8, 547-558-547–558.