AMBIENT Bodily Entrainment to Audiovisual Rhythms

• Guo, Jinyue; T?rresen, Jim & Jensenius, Alexander Refsum (2026). Investigating Auditory¨CVisual Perception Using Multi-Modal Neural Networks with the SoundActions Dataset. Transactions of the International Society for Music Information Retrieval. 9(1), p. 85¨C85. doi: 10.5334/tismir.223. Full text in Research Archive Show summary

  Musicologists, psychologists, and computer scientists study relationships between auditory and visual stimuli from very different perspectives and using various terminologies and methodologies. This article aims to bridge the gap between phenomenological sound theory, auditory¨Cvisual theory, and audio¨Cvideo processing and machine learning. We introduce the SoundActions dataset, a collection of 365 audio¨Cvideo recordings of (primarily) short sound actions. Each recording has been human?labeled and annotated according to Pierre Schaeffer¡¯s theory of reduced listening, which describes the property of the sound itself (e.g., ¡®an impulsive sound¡¯) instead of the source (e.g., ¡®a bird sound¡¯). With these reduced?type labels in the audio¨Cvideo dataset, we conducted two experiments: (1) fine?tuning the latest audio¨Cvideo transformer model on the reduced?type labels in the SoundActions dataset, proving that the model can recognize reduced?type labels, and observing that the modality?imbalance phenomenon is similar to the added value theory by Michel Chion and (2) proposing the Ensemble of Perception Mode Adapters method inspired by Pierre Schaeffer¡¯s three listening modes, improving the audio¨Cvideo model also on reduced?type tasks.

• Riaz, Maham; Erdem, Cagri & Jensenius, Alexander Refsum (2026). Inverse and indirect mappings in embodied AI systems in everyday environments. Frontiers in Computer Science. 7. doi: 10.3389/fcomp.2025.1603769. Full text in Research Archive Show summary

  This paper explores how musicking technologies¡ªinteractive systems with musical properties¡ªcan enhance everyday public environments. We are particularly interested in investigating the effects of musical interactions in non-musical settings, such as offices, meeting rooms, and social work areas. Traditional music technologies (such as instruments) are built for goal-directed, conscious, and voluntary interactions. We propose a new perspective on embodied AI through systems that utilize indirect, inverse, unconscious, and, at times, involuntary interactions. Four different sound/music systems are examined and discussed with regard to their activity level: a reactive ¡°birdbox,¡± a reactive painting, active self-playing guitars, and interactive music balls. All these systems are multimodal, containing sensors that detect various physical inputs to produce sound and light, and having varying levels of perceived agency. The paper explores differences between direct/indirect and regular/inverse embodied AI paradigms. This study demonstrates how minimalistic interactions have the potential to yield complex and engaging musicking experiences, challenging the norms of overly intricate AI implementations.

• Christodoulou, Anna-Maria; Arnim, Hugh Alexander von & Jensenius, Alexander Refsum (2025). Supporting Narrative Comprehension in Programmatic Music through Music and Light. In McArthur, Angela; Matthews, Emma-Kate & Holberton, Tom (Ed.), Proceedings of the 17th International Symposium on Computer Music Multidisciplinary Research. The Laboratory PRISM ¡°Perception, Representations, Image, Sound, Music¡±. ISSN 9791097498061. p. 447¨C454. doi: 10.5281/zenodo.17496754. Full text in Research Archive Show summary

  Programmatic music, such as Tchaikovsky¡¯s Overture Romeo and Juliet, relies on the audience¡¯s ability to associate musical motifs with narrative elements. This is a demanding task for less experienced listeners, particularly when cues are subtle, such as those conveyed through timbre. This paper explores how dynamic stage lighting, driven by physiological signals, can enhance narrative comprehension in orchestral performance. Using the LightHearted interactive lighting system, different characters of the Overture were mapped to distinct colored lights, whose intensities were dynamically modulated in real time by the heart rates of the conductor and selected musicians. This integration aimed to convey subtle narrative cues to the audience in real time. Audience feedback suggests that this approach not only clarifies musical narratives but also enhances the overall experience.

• Riaz, Maham; Guo, Jinyue; Erdem, Cagri & Jensenius, Alexander Refsum (2025). Where to Put That Microphone? A Study of Sound Localization in Ambisonics Recordings. In McArthur, Angela; Matthews, Emma-Kate & Holberton, Tom (Ed.), Proceedings of the 17th International Symposium on Computer Music Multidisciplinary Research. The Laboratory PRISM ¡°Perception, Representations, Image, Sound, Music¡±. ISSN 9791097498061. p. 455¨C466. doi: 10.5281/ZENODO.17497086. Full text in Research Archive Show summary

  This paper examines the effects of microphone placement on sound localization in first-order Ambisonics recordings. Two microphone setups were used to capture a moving audio source in a lab environment. Array A, a tetrahedral microphone, was placed in the centre of the recording space. Array B consisted of four similar tetrahedral microphones charting a rectangular perimeter surrounding the space. Motion capture data of the moving sound source shows that anglegrams calculated from the Ambisonics recordings can be effectively used for sound localization. An additional perceptual listening study with binaural renders of the audio signals showed that the centrally-placed Array A provided superior localization. However, the corner-placed Array B performed better than expected.

• Guo, Jinyue; T?rresen, Jim & Jensenius, Alexander Refsum (2025). Cross-modal Analysis of Spatial-Temporal Auditory Stimuli and Human Micromotion when Standing Still in Indoor Environments. In McArthur, Angela; Matthews, Emma-Kate & Holberton, Tom (Ed.), Proceedings of the 17th International Symposium on Computer Music Multidisciplinary Research. The Laboratory PRISM ¡°Perception, Representations, Image, Sound, Music¡±. ISSN 9791097498061. p. 871¨C882. doi: 10.5281/ZENODO.17502603. Full text in Research Archive Show summary

  This paper examines how a soundscape influences human stillness. We are particularly interested in how spatial and temporal features of a soundscape influence human micromotion and swaying patterns. The analysis is based on 345 Ambisonics audio recordings of different indoor environments and corresponding accelerometer data captured at the chest of a person standing still for ten minutes. We calculated the temporal and spatial correlation between the person's quantity of motion and the sound energy of the Ambisonic recordings. While no clear temporal correlations were found, we discovered a correlation between the spatial directionality of the micromotion and the sound direction of arrival. The results suggest a potential entrainment between the directionality of environmental sounds and human swaying patterns, which have not been thoroughly studied previously compared to the temporal or spectral features of indoor soundscapes.

• Laczko, Balint & Jensenius, Alexander Refsum (2025). Pixasonics: An Image Sonification Toolbox for Python. In Cardoso, F. Am¨ªlcar; Vickers, Paul; Martins, Pedro & Roddy, Stephen (Ed.), Proceedings of the 30th International Conference on Auditory Display (ICAD 2025). Department of Informatics Engineering, University of Coimbra, Portugal. ISSN 9798991456210. p. 28¨C35. doi: https:/hdl.handle.net/1853/79958. Full text in Research Archive Show summary

  Pixasonics is a new Python library for interactive image analysis and exploration through image sonification. It uses real-time audio and visualization to help uncover patterns in image data. With Pixasonics, users can launch one or more small web applications (running in a Jupyter Notebook), probe image data using various feature extraction methods, and map those feature vectors to synthesis parameters. The target users are researchers interested in exploring image and volumetric data and creative users who want an intuitive tool for experimental sound design. Pixasonics¡¯ design aims to strike a balance between an easy-to-use web application with minimal boilerplate code necessary and a library that can be integrated into more advanced workflows. Real-time exploration is at the heart, but it can also be used to script non-real-time sonifications of large datasets. This paper presents Pixasonics, its structure, interface, and advanced features, and discusses preliminary feedback from biology researchers and music technologists.

• Riaz, Maham; Guo, Jinyue; G?ks¨¹l¨¹k, Bilge Serdar & Jensenius, Alexander Refsum (2025). Where is That Bird? The Impact of Artificial Birdsong in Public Indoor Environments. In Sei?a, Mariana & Wirfs-Brock, Jordan (Ed.), AM '25: Proceedings of the 20th International Audio Mostly Conference. Association for Computing Machinery (ACM). ISSN 9798400720659. p. 344¨C351. doi: 10.1145/3771594.3771629. Full text in Research Archive Show summary

  This paper explores the effects of nature sounds, specifically bird sounds, on human experience and behavior in indoor public environments. We report on an intervention study where we introduced an interactive sound device to alter the soundscape. Phenomenological observations and a survey showed that participants noticed and engaged with the bird sounds primarily through causal listening; that is, they attempted to identify the sound source. Participants generally responded positively to the bird sounds, appreciating the calmness and surprise it brought to the environment. The analyses revealed that relative loudness was a key factor influencing the experience. A too-high sound level may feel unpleasant, while a too-low sound level makes it unnoticeable due to background noise. These findings highlight the importance of automatic level adjustments and considering acoustic conditions in soundscape interventions. Our study contributes to a broader discourse on sound perception, human interaction with sonic spaces, and the potential of auditory design in public indoor environments.

• Sveen, Henrik Haraldsen; Bishop, Laura & Jensenius, Alexander Refsum (2025). Cyclic Patterns and Spatial Orientations in Artificial Impulsive Autonomous Sensory Meridian Response (ASMR) Sounds. In Sei?a, Mariana & Wirfs-Brock, Jordan (Ed.), AM '25: Proceedings of the 20th International Audio Mostly Conference. Association for Computing Machinery (ACM). ISSN 9798400720659. p. 124¨C131. doi: 10.1145/3771594.3771651. Full text in Research Archive Show summary

  Autonomous Sensory Meridian Response (ASMR) is a tingling sensation in the neck and spine often triggered by specific sounds. This paper reports a study on the impact of different cyclic patterns and spatial orientations¡ªdefined here as the perceived directionality and motion of sound sources in a three-dimensional auditory space¡ªon inducing ASMR experiences. The results demonstrate that both the type of cyclic pattern and the spatial orientation significantly influence the intensity and nature of ASMR experiences. Furthermore, the research explores synthesizing ASMR-inducing sounds while preserving key audio characteristics from acoustically recorded ASMR content. Through survey data analysis and regression modeling, distinct patterns emerge regarding the relationship between personality traits and ASMR experience. The findings contribute to a deeper understanding of ASMR as a sensory phenomenon and provide insights into the potential applications of artificially generated ASMR stimuli. Additionally, the research sheds light on the role of spatiality in ASMR experiences and the synthesis of ASMR-inducing sounds for future studies and practical applications

• Riaz, Maham; Theodoridis, Ioannis; Erdem, Cagri & Jensenius, Alexander Refsum (2025). VentHackz: Exploring the Musicality of Ventilation Systems. In Cavdir, Doga & Berthaut, Florent (Ed.), Proceedings of the International Conference on New Interfaces for Musical Expression. The International Conference on New Interfaces for Musical Expression. doi: 10.5281/zenodo.15698831. Full text in Research Archive Show summary

  Ventilation systems can be seen as huge examples of interfaces for musical expression, with the potential of merging sound, space, and human interaction. This paper explores conceptual similarities between ventilation systems and wind instruments and explores approaches to ¡°hacking¡± ventilation systems with components that produce and modify sound. These systems enable the creation of unique sonic and visual experiences by manipulating airflow and making mechanical adjustments. Users can treat ventilation systems as musical interfaces by altering shape, material, and texture or augmenting vents. We call for heightened attention to the sound-making properties of ventilation systems and call for action (#VentHackz) to playfully improve the soundscapes of our indoor environments.

• Riaz, Maham; Guo, Jinyue & Jensenius, Alexander Refsum (2025). Comparing Spatial Audio Recordings from Commercially Available 360-degree Video Cameras. In Brooks, Anthony L.; Banakou, Domna & Ceperkovic, Slavica (Ed.), Proceedings of the 13th EAI International Conference on ArtsIT, Interactivity and Game Creation, ArtsIT 2024. Springer. ISSN 9783031972546. p. 160¨C172. doi: 10.1007/978-3-031-97254-6_12. Full text in Research Archive Show summary

  This paper investigates the spatial audio recording capabilities of various commercially available 360-degree cameras (GoPro MAX, Insta360 X3, Garmin VIRB 360, and Ricoh Theta S). A dedicated ambisonics audio recorder (Zoom H3VR) was used for comparison. Six action sequences were performed around the recording setup, including impulsive and continuous vocal and non-vocal stimuli. The audio streams were extracted from the videos and compared using spectrograms and anglegrams. The anglegrams show adequate localization in ambisonic recordings from the GoPro MAX and Zoom H3VR. All cameras feature undocumented noise reduction and audio enhancement algorithms, use different types of audio compression, and have limited audio export options. This makes it challenging to use the spatial audio data reliably for research purposes.

• Grosz, Patrick Georg; Solberg, Ragnhild Torvanger; Katz, Jonah; Vu, Mai Ha; Jensenius, Alexander Refsum & Patel-Grosz, Pritty (2025). An outline of the narrative grammar of electronic dance music. Musicae Scientiae. ISSN 1029-8649. 29(4), p. 556¨C575. doi: 10.1177/10298649251321709. Full text in Research Archive Show summary

  We argue that electronic dance music (EDM) exhibits a parallel structural organization to that which has been proposed for cartoons (comics) after the model of hierarchical structure proposed in theoretical linguistics. According to this parallel, both systems are governed by general cognitive mechanisms for the narrative organization of tension and release, which are not modality-specific. We show that notions from visual narrative analysis, such as an Establisher¨CInitial¨CPeak¨CRelease template, can be applied directly to EDM tracks as an Intro/Breakdown¨CBuildup¨CCore¨COutro/Cut template. In doing so, we focus on how to formally define and operationalize relevant notions such as Breakdown, Buildup, and Core. As part of our analysis, we show that the scene-setting Establisher segments of visual narratives map onto two distinct categories in EDM: they correspond to intro sections at the beginning of a track and to breakdown sections in the middle of a track; we strengthen the analogy to visual narrative analysis by introducing refinements such as a pre-drop break that often occurs at the end of a buildup segment. To adjudicate between competing hypotheses on the hierarchical structure of a given EDM track, we demonstrate that analytical tests from linguistics and visual narrative analysis can be successfully applied. By introducing these analytical tools, this article sets the stage for further explorations in the linguistically informed analysis of the structure and meaning of EDM.

• Guo, Jinyue; Christodoulou, Anna-Maria; Laczko, Balint & Glette, Kyrre (2024). LVNS-RAVE: Diversified audio generation with RAVE and Latent Vector Novelty Search. In Li, Xiaodong & Handl, Julia (Ed.), GECCO '24 Companion: Proceedings of the Genetic and Evolutionary Computation Conference Companion. Association for Computing Machinery (ACM). ISSN 9798400704956. p. 667¨C670. doi: 10.1145/3638530.3654432. Full text in Research Archive Show summary

  Evolutionary Algorithms and Generative Deep Learning have been two of the most powerful tools for sound generation tasks. However, they have limitations: Evolutionary Algorithms require complicated designs, posing challenges in control and achieving realistic sound generation. Generative Deep Learning models often copy from the dataset and lack creativity. In this paper, we propose LVNS-RAVE, a method to combine Evolutionary Algorithms and Generative Deep Learning to produce realistic and novel sounds. We use the RAVE model as the sound generator and the VGGish model as a novelty evaluator in the Latent Vector Novelty Search (LVNS) algorithm. The reported experiments show that the method can successfully generate diversified, novel audio samples under different mutation setups using different pre-trained RAVE models. The characteristics of the generation process can be easily controlled with the mutation parameters. The proposed algorithm can be a creative tool for sound artists and musicians.

• Jensenius, Alexander Refsum (2024). Embodied Musicking Technologies: Inspired by Professor Marc Leman. In Maes, Pieter-Jan (Eds.), Liber Amicorum Marc Leman: A life in music, science, and technology. Ghent University. Full text in Research Archive Show summary

  In his seminal book ¡°Embodied Music Cognition and Mediation Technology¡±, Marc Leman Leman (2008a) drew up a theoretical framework that has influenced a whole new generation of researchers, myself included. Building on a long tradition of systematic musicology, combined with ecological psychology and modern technology, he convincingly set the direction for a fresh approach to scientific studies of musical experiences. In the following, I will reflect on some concepts that he raised in his discussion, and I will point out some that he left for others, like me, to explore in more detail.

• G?ks¨¹l¨¹k, Bilge Serdar (2024). The clash between physical and digital realm: hybrid movement training during the pandemic. Discover Education. 3(1). doi: 10.1007/s44217-024-00158-y. Full text in Research Archive Show summary

  This article is based on ethnographic research conducted in one of the physical training institutions that offer the Laban/Bartenieff Movement Studies (LBMS) certification program in 2021. Because of the COVID-19 pandemic crisis, the training was held in a hybrid format in which some participants were in the studio while others were attending remotely via Zoom. Zoom-mediated movement training for long hours revealed how the intervention of telematic technologies challenged practitioners¡¯ sensorial experience and sense-making process. Moreover, bringing co-located and remote participants¡¯ experiences together in the hybrid setting disclosed different modes of interaction dynamics in the studio and online. Overall, participants described their hybrid experience as a clash. In the article, starting from unfolding those clashes from the enactive perspective, I discuss how remote intercorporeality through an audio¨Cvideo streaming system, Zoom, challenges participants¡¯ sensorial experience and how remote interaction affects the shared sense-making process in the hybrid format setting.

• Guo, Jinyue; Riaz, Maham & Jensenius, Alexander Refsum (2024). Comparing Four 360-Degree Cameras for Spatial Video Recording and Analysis, Proceedings of the Sound and Music Computing Conference 2024. SMC Network. ISSN 9789893520758. Full text in Research Archive Show summary

  This paper reports on a desktop investigation and a lab experiment comparing the video recording capabilities of four commercially available 360-degree cameras: GoPro MAX, Insta360 X3, Garmin VIRB 360, and Ricoh Theta S. The four cameras all use different recording formats and settings and have varying video quality and software support. This makes it difficult to conduct analyses and compare between devices. We have implemented new functions in the Musical Gestures Toolbox (MGT) for reading and merging files from the different platforms. Using the capabilities of FFmpeg, we have also made a new function for converting between different 360-degree video projections and formats. This allows (music) researchers to exploit 360-degree video recordings using regular video-based analysis pipelines.

• G?ks¨¹l¨¹k, Bilge Serdar (2024). Digital intervention into dramaturgical thoughts: The dramaturgy of remote dance improvisation. In Parviainen, Pessi & Rouhiainen, Leena (Ed.), Solvitur Ambulando "solved by moving" : dramaturgies of artistic research : proceedings of CARPA8. Theatre Academy, University of the Arts. ISSN 9789523530744. doi: https:/nivel.teak.fi/carpa8/digital-intervention-into-dramaturgical-thoughts-the-dramaturgy-of-remote-dance-improvisation/. Full text in Research Archive
• H?ffding, Simon; Hansen, Niels Christian & Jensenius, Alexander Refsum (2024). Music Research ¡°in the Wild¡± ¨C Introducing the MusicLab Copenhagen Special Collection. Music & Science. 7. doi: 10.1177/20592043241294161. Full text in Research Archive Show summary

  This special collection of Music & Science contains 111 articles. They thoroughly describe a particular instantiation of a research concert, namely the innovative and complex event MusicLab Copenhagen. This took place over 14?hours on October 26, 2021, in Copenhagen, Denmark. Working with The Danish String Quartet (DSQ), one of the world's best chamber ensembles, a research team from RITMO, complemented with researchers from several other European institutions, ran experiments and studied how mind and body are engaged during a concert. This was a unique opportunity to capture concurrent qualitative, behavioral, and physiological measurements in a concert hall, delicately balancing the scientific ideals of reliability and ecological validity.

• Campbell, Edward; Souza, Jonathan De & Jensenius, Alexander Refsum (2024). Gestures, Actions and Play In Bj?rn Heile's 3 ¡Á 10 Musical Actions For Three Socially Distanced Performers. Tempo. ISSN 0040-2982. 78(310), p. 51¨C61. Full text in Research Archive Show summary

  Bj?rn Heile¡¯s 3 ¡Á 10 Musical Actions for Three Socially Distanced Performers features frequent changes in musical material, playing style and instrumental combinations. Throughout a series of short sections, the performers play, sing, speak, conduct and move around, following instructions that appear on tablets. This article reflects on audiences¡¯ experiences of the work and on musical actions more generally. We consider musical actions as short, coherent motion chunks and distinguish between several types of action that appear in the piece: gestures (communicative actions, with or without sound), reactions (where a player responds to another) and interactions (where players mutually coordinate). The musicians¡¯ individual and collective actions create a sense of play: on the one hand, they seem free and depart from standard concert conventions; on the other hand, they seem to be following a set of rules, even if these rules are not explained to the audience. As such, we approach the piece via theories of play and relate it to earlier modernist musical games. Ultimately, 3 ¡Á 10 Musical Actions emphasises several aspects of musical actions, as social, functional, expressive, playful and embodied.

• Docherty, Claire; Iddon, Martin; Jensenius, Alexander Refsum; MacDonald, Raymond & Stanley, Jane (2024). ¡®Are You Still There?¡¯ Experiencing Sonic Bothy¡¯S Verbaaaaatim. Tempo. ISSN 0040-2982. 78(310). Full text in Research Archive Show summary

  Sonic Bothy is an inclusive experimental and new-music organisation with an ensemble of musicians with and without disabilities and neurodiversities. This article considers their audiovisual piece Verbaaaaatim (2020¨C21), its form marked by the context of its development and composition during the COVID-19 pandemic, using a set of interlayered perspectives that mirror the formal layers of the piece. Recorded in a single take, it comprises instrumental sounds, spoken words, written words, static and dynamic graphics and videos of the performers, aligned so that the piece seems consistently to flow onwards, although it is not always clear which element impels its forward motion. The article considers, in particular, Verbaaaaatim¡¯s presentation of modes of embodied conviviality between its performers, the ways these find resonance in wider histories of experimental music and the ways in which its elements can be understood in an ecological framework as ¡®sound actions¡¯.

• Jensenius, Alexander Refsum (2024). Embodied music learning. In Schilhab, Theresa & Groth, Camilla (Ed.), Embodied Learning and Teaching using the 4E Cognition Approach: Exploring Perspectives in Teaching Practices. Routledge. ISSN 9781003341604. doi: 10.4324/9781003341604-21. Full text in Research Archive Show summary

  This chapter presents a pedagogical approach based on the author¡¯s experience teaching interactive music technology design from an embodied music cognition perspective. The ¡°musicking quadrant¡± is introduced as a framework to understand the experiences of those who make music in real-time (performers) and non-real-time (instrument makers, composers, producers), and those who experience music in real-time (perceivers) and non-real-time (analysts). New technologies challenge these roles and allow for new types of musical engagement that align with the 4E cognition perspectives.

• Riaz, Maham (2023). An Investigation of Supervised Learning in Music Mood Classification for Audio and MIDI. In Andreopoulou, Areti & Boren, Braxton (Ed.), Proceedings of the Audio Engineering Society 155th Convention. Audio Engineering Society, Inc.. ISSN 9781713894667. Full text in Research Archive Show summary

  This study aims to use supervised learning ¨C specifically, support vector machines ¨C as a tool for a music mood classification task. Four audio and MIDI datasets, each containing over four hundred files, were composed for use in the training and testing processes. Mood classes were formed according to the valence-arousal plane, resulting in the following: happy, sad, relaxed, and tense. Additional runs were also conducted with the linear discriminant analysis, a dimensionality reduction technique commonly used to better the performance of the classifier. The relevant audio and MIDI features were carefully selected for extraction. MIDI datasets for the same music generated better classification results than corresponding audio datasets. Furthermore, when music is composed with each mood associated with a particular key instead of mixed keys, the classification accuracy is higher.

• Riaz, Maham & Christodoulou, Anna-Maria (2023). Using SuperCollider with OSC Commands for Spatial Audio Control in a Multi-Speaker Setup. In Andreopoulou, Areti & Boren, Braxton (Ed.), Proceedings of the Audio Engineering Society 155th Convention. Audio Engineering Society, Inc.. ISSN 9781713894667. Full text in Research Archive Show summary

  With the ever-increasing prevalence of technology, its application in various music-related processes, such as music composition and performance, has become increasingly prominent. One fascinating area where technology finds utility is in music performance, offering opportunities for extensive sound exploration and manipulation. In this paper, we introduce an approach utilizing SuperCollider and Open Sound Control (OSC) commands in a multi-speaker setup, enabling spatial audio control for a truly interactive audio spatialization experience. We delve into the musicological dimensions of these distinct methods, examining their integration within a live performance setting to uncover their artistic and expressive potential. By merging technology and musicology, our research aims to unlock new avenues for immersive and captivating musical experiences.

• Guo, Jinyue & McFee, Brian (2023). Automatic Recognition of Cascaded Guitar Effects. In Serafin, Stefania; Fontana, Federico & Willemsen, Silvin (Ed.), Proceedings of the 26th International Conference on Digital Audio Effects. Aalborg University Copenhagen. p. 189¨C195. doi: 10.5281/zenodo.7973536. Full text in Research Archive Show summary

  This paper reports on a new multi-label classification task for guitar effect recognition that is closer to the actual use case of guitar effect pedals. To generate the dataset, we used multiple clean guitar audio datasets and applied various combinations of 13 commonly used guitar effects. We compared four neural network structures: a simple Multi-Layer Perceptron as a baseline, ResNet models, a CRNN model, and a sample-level CNN model. The ResNet models achieved the best performance in terms of accuracy and robustness under various setups (with or without clean audio, seen or unseen dataset), with a micro F1 of 0.876 and Macro F1 of 0.906 in the hardest setup. An ablation study on the ResNet models further indicates the necessary model complexity for the task.

• Riaz, Maham; Upham, Finn; Burnim, Kayla; Bishop, Laura & Jensenius, Alexander Refsum (2023). Comparing inertial motion sensors for capturing human micromotion, Proceedings of the Sound and Music Computing Conference 2023. SMC Network . ISSN 9789152773727. doi: 10.5281/zenodo.8316051. Full text in Research Archive Show summary

  The paper presents a study of the noise level of accelerometer data from a mobile phone compared to three commercially available IMU-based devices (AX3, Equivital, and Movesense) and a marker-based infrared motion capture system (Qualisys). The sensors are compared in static positions and for measuring human micromotion, with larger motion sequences as reference. The measurements show that all but one of the IMU-based devices capture motion with an accuracy and precision that is far below human micromotion. However, their data and representations differ, so care should be taken when comparing data between devices.

• Masu, Raul; Morreale, Fabio & Jensenius, Alexander Refsum (2023). The O in NIME: Reflecting on the Importance of Reusing and Repurposing Old Musical Instruments. In Ortiz, Miguel & Marquez-Borbon, Adnan (Ed.), Proceedings of the International Conference on New Interfaces for Musical Expression. Universidad Aut¨®noma Metropolitana. Full text in Research Archive Show summary

  In this paper, we reflect on the focus of ¡°newness¡± in NIME research and practice and argue that there is a missing O (for ¡°Old¡±) in framing our academic discourse. A systematic review of the last year¡¯s conference proceedings reveals that most papers do, indeed, present new instruments, interfaces, or pieces of technology. Comparably few papers focus on the prolongation of existing NIMEs. Our meta-analysis identifies four main categories from these papers: (1) reuse, (2) update, (3) complement, and (4) long-term engagement. We discuss how focusing more on these four types of NIME development and engagement can be seen as an approach to increase sustainability.

• Karbasi, Seyed Mojtaba; Jensenius, Alexander Refsum; God?y, Rolf Inge & T?rresen, Jim (2023). Exploring Emerging Drumming Patterns in a Chaotic Dynamical System using ZRob. In Ortiz, Miguel & Marquez-Borbon, Adnan (Ed.), Proceedings of the International Conference on New Interfaces for Musical Expression. Universidad Aut¨®noma Metropolitana. Full text in Research Archive Show summary

  ZRob is a robotic system designed for playing a snare drum. The robot is constructed with a passive flexible spring-based joint inspired by the human hand. This paper describes a study exploring rhythmic patterns by exploiting the chaotic dynamics of two ZRobs. In the experiment, we explored the control configurations of each arm by trying to create un- predictable patterns. Over 200 samples have been recorded and analyzed. We show how the chaotic dynamics of ZRob can be used for creating new drumming patterns.

• Lesteberg, Mari & Jensenius, Alexander Refsum (2022). MICRO and MACRO - Developing New Accessible Musicking Technologies. In Iber, Michael & Enge, Kajetan (Ed.), Audio Mostly 2022: What you hear is what you see? Perspectives on modalities in sound and music interaction. ACM Publications. ISSN 9781450397018. p. 147¨C150. doi: 10.1145/3561212.3561231. Full text in Research Archive Show summary

  This paper describes the development of two musical instrument prototypes developed to explore how non-haptic music technologies can be accessed from a web browser and how they can offer accessibility for people with low fine motor skills. Two approaches to browser-based motion capture were developed and tested during an iterative design process. This was followed by observational studies of two user groups: one with low fine motor skills and one with normal motor skills. Contrary to our expectations, we found that avoiding the use of buttons and mice did not make the apps more accessible for the participants with low fine motor skills. Furthermore, motion speed was considered more important for people with low motor skills than the size of the control action. The most important finding is that browser-based musical instruments using sensor-based and video-based motion tracking are not only feasible but allow for reaching much larger groups of people than previously possible. This may ultimately lead to both more personalized and accessible musical experiences.

• Remache-Vinueza, Byron; Trujillo-Le¨®n, Andr¨¦s; Clim, Maria-Alena; Sarmiento-Ortiz, Fabi¨¢n; Topon-Visarrea, Liliana & Jensenius, Alexander Refsum [Show all 7 contributors for this article] (2022). Mapping Monophonic MIDI Tracks to Vibrotactile Stimuli Using Tactile Illusions. In Saitis, Charalampos; Farkhatdinov, Ildar & Papetti, Stefano (Ed.), Haptic and Audio Interaction Design. Springer Nature. ISSN 9783031150197. Full text in Research Archive Show summary

  In this project, we propose an algorithm to convert musical features and structures extracted from monophonic MIDI files to tactile illusions. Mapping music to vibrotactile stimuli is a challenging process since the perceptible frequency range of the skin is lower than that of the auditory system, which may cause the loss of some musical features. Moreover, current proposed models do not warrant the correspondence between the emotional response to music and the vibrotactile version of it. We propose to use tactile illusions as an additional resource to convey more meaningful vibrotactile stimuli. Tactile illusions enable us to add dynamics to vibrotactile stimuli in the form of movement, changes of direction, and localization. The suggested algorithm converts monophonic MIDI files into arrangements of two tactile illusions: ¡°phantom motion¡± and ¡°funneling¡±. The validation of the rendered material consisted of presenting the audio rendered from MIDI files to participants and then adding the vibrotactile component to it. The arrangement of tactile illusions was also evaluated alone. Results suggest that the arrangement of tactile illusions evokes more positive emotions than negative ones. This arrangement was also perceived as more agreeable and stimulating than the original audio. Although musical features such as rhythm, tempo, and melody were mostly recognized in the arrangement of tactile illusions, it provoked a different emotional response from that of the original audio.

• Erdem, Cagri; Wallace, Benedikte & Jensenius, Alexander Refsum (2022). CAVI: A Coadaptive Audiovisual Instrument¨CComposition. In McPherson, Andrew & Frid, Emma (Ed.), Proceedings of the International Conference on New Interfaces for Musical Expression. The International Conference on New Interfaces for Musical Expression. doi: 10.21428/92fbeb44.803c24dd. Full text in Research Archive
• Jensenius, Alexander Refsum (2021). Best versus Good Enough Practices for Open Music Research. Empirical Musicology Review. 16(1). doi: 10.18061/emr.v16i1.7646. Full text in Research Archive Show summary

  Music researchers work with increasingly large and complex data sets. There are few established data handling practices in the field and several conceptual, technological, and practical challenges. Furthermore, many music researchers are not equipped for (or interested in) the craft of data storage, curation, and archiving. This paper discusses some of the particular challenges that empirical music researchers face when working towards Open Research practices: handling (1) (multi)media files, (2) privacy, and (3) copyright issues. These are exemplified through MusicLab, an event series focused on fostering openness in music research. It is argued that the "best practice" suggested by the FAIR principles is too demanding in many cases, but "good enough practice" may be within reach for many. A four-layer data handling "recipe" is suggested as concrete advice for achieving "good enough practice" in empirical music research.

• Laczko, Balint & Jensenius, Alexander Refsum (2021). Reflections on the Development of the Musical Gestures Toolbox for Python. In Kantan, Prithvi Ravi; Paisa, Razvan & Willemsen, Silvin (Ed.), Proceedings of the Nordic Sound and Music Computing Conference. Aalborg Universitetsforlag. Full text in Research Archive Show summary

  The paper presents the Musical Gestures Toolbox (MGT) for Python, a collection of modules targeted at researchers working with video recordings. The toolbox includes video visualization techniques such as creating motion videos, motion history images, and motiongrams. These visualizations allow for studying video recordings from different temporal and spatial perspectives. The toolbox also includes basic computer vision methods, and it is designed to integrate well with audio analysis toolboxes. The MGT was initially developed to analyze music-related body motion (of musicians, dancers, and perceivers) but is equally helpful for other disciplines working with video recordings of humans, such as linguistics, pedagogy, psychology, and medicine.

View all works in NVA

• G?ks¨¹l¨¹k, Bilge Serdar (2024). Immersive Technologies and Their Implications in Theatre for Young Audiences:Challenges and Opportunities. C?ndido. ISBN 9786587602479. 15 p. Full text in Research Archive Show summary

  Today¡¯s immersive technology creates a real-like ambience, offering a unique interactive and multimodal experience onstage. These implications might look promising for new aesthetic forms. However, using them on the stage in this technology-driven world raises some concerns about their potential long-term impact on young people¡¯s development. In this paper, I will critically evaluate the use of immersive technology in TYA, questioning whether performing arts can offer a new form of aesthetic experience.

• Jensenius, Alexander Refsum (2024). Sonic Design: Explorations Between Art and Science. Springer Nature. ISBN 9783031578922. 347 p. doi: 10.1007/978-3-031-57892-2. Full text in Research Archive Show summary

  This edited volume is based on a selection of contributions at an international seminar organized in May 2022 to celebrate the achievements of Professor God?y upon his retirement from the University of Oslo. The 17 chapters cover different approaches to sonic design practice and theory, giving readers historical backdrops and an overview of the current state of both artistic and scientific research in the field.

• Jensenius, Alexander Refsum (2022). Sound Actions: Conceptualizing Musical Instruments. MIT Press. ISBN 9780262544634. 304 p. doi: 10.7551/mitpress/14220.001.0001. Full text in Research Archive Show summary

  A techno-cognitive look at how new technologies are shaping the future of musicking. ¡°Musicking¡± encapsulates both the making of and perception of music, so it includes both active and passive forms of musical engagement. But at its core, it is a relationship between actions and sounds, between human bodies and musical instruments. Viewing musicking through this lens and drawing on music cognition and music technology, Sound Actions proposes a model for understanding differences between traditional acoustic ¡°sound makers¡± and new electro-acoustic ¡°music makers.¡± What is a musical instrument? How do new technologies change how we perform and perceive music? What happens when composers build instruments, performers write code, perceivers become producers, and instruments play themselves? The answers to these pivotal questions entail a meeting point between interactive music technology and embodied music cognition, what author Alexander Refsum Jensenius calls ¡°embodied music technology.¡± Moving between objective description and subjective narrative of his own musical experiences, Jensenius explores why music makes people move, how the human body can be used in musical interaction, and how new technologies allow for active musical experiences. The development of new music technologies, he demonstrates, has fundamentally changed how music is performed and perceived.

View all works in NVA

• Mathiesen, Anlov Peter & Jensenius, Alexander Refsum (2026). Musikkmaskinene | Aftenposten Innsikt. [Journal]. Aftenposten Innsikt. Full text in Research Archive Show summary

  N?r KI lager og spiller musikken, hva gjenst?r for mennesket?

• Fr?yland, Rolf & Jensenius, Alexander Refsum (2026). Er 528 Hz og 432 Hz magiske frekvenser? [Journal]. Stavanger Aftenblad. Full text in Research Archive Show summary

  H?rer du p? musikk i 528 Hz, 432 Hz eller 8D kan det gj?re underverker for den mentale helsen din, if?lge en rekke videoer p? sosiale medier. Er det sant ¨C eller bare tull?

• Jensenius, Alexander Refsum (2026). Creativity Between Art and Science. Full text in Research Archive Show summary

  First, I will present MishMash Centre for AI and Creativity, a new Norwegian research centre advancing AI to explore and shape human-machine creativity. Funded by the Research Council of Norway in 2025, the centre brings together artists, engineers, and scholars across disciplines to create, explore, and reflect on AI systems that augment creative practice while foregrounding agency, inclusion, and sustainability. Organized into seven work packages, the centre addresses technical challenges such as real-time multi-agent systems and hybrid symbolic learning methods, societal concerns including bias, copyright, and equitable value distribution, and applied domains spanning health, education, cultural heritage, and the creative industries.Second, I will present some of my own ongoing explorations into embodied AI, including inverse control, small language models, and distributed computing. This approach challenges current monolithic, generative models, suggesting an alternative future for creative AI.

• Jensenius, Alexander Refsum (2026). "Soft" and "Hard" research? Experiences from running a radically interdisciplinary research centre. doi: https:/www.uc.pt/ceis20/conferencias/alexander-jensenius-eixos-do-conhecimento-interdisciplinar/. Full text in Research Archive Show summary

  In this presentation, Alexander Refsum Jensenius explores the practical and theoretical dimensions of running radically interdisciplinary research centres, focusing on his experiences with RITMO and the newly established MISHMASH Centre for AI and Creativity. He introduces the "coffee machine" philosophy, which advocates for physical colocation and social meeting points as essential tools to overcome institutional silos and bridge the diverse research motivations of fields like musicology, informatics, and psychology. Jensenius highlights the innovative potential of this approach through projects that translate artistic research into medical applications, such as using dance analysis software to screen infants for cerebral palsy and investigating the impact of musical stimuli on biological cells. He further details the MusicLab initiative, which scales data collection to full symphony orchestras to study embodied music cognition and human behaviour in real-life concert settings. The talk concludes by introducing MISHMASH, a national consortium dedicated to fostering human-centric AI that integrates artistic practice with technological development while navigating ethical challenges such as copyright and the preservation of cultural heritage.

• Jensenius, Alexander Refsum (2026). Hva er "flytsonen"? [Radio]. NRK P2. Full text in Research Archive Show summary

  "Kan kunst skape seg selv?", sp?r Abels T?rnpanel fra Kunsth?gskolen i Oslo (KHIO). Send inn dine sp?rsm?l til v?re eksperter!

• Jensenius, Alexander Refsum & S?rum, Tuva Marie (2026). Nesten alle lever i sin egen stille boble. [Journal]. NRK.no. Full text in Research Archive Show summary

  Vi s?ker stillhet som aldri f?r, og hele 95 prosent av hodetelefonene som selges er st?yreduserende.

• Jensenius, Alexander Refsum (2026). Netsten alle hodetelefoner er st?yreduserenede. [Radio]. NRK. Full text in Research Archive Show summary

  Innslag p? NRK nyhetsmorgen

• Jensenius, Alexander Refsum & Lindahl, Nikoline Riis (2026). Ekspert om st?ydemping-trenden: ¨C Vi lever i parallelle verdener. [Journal]. Aftenposten. Full text in Research Archive Show summary

  St?ydemping er blitt normalen. Sp?rsm?let er hva som skjer n?r fellesskapets lyd forsvinner.

• Jensenius, Alexander Refsum (2025). Permeating Art & Science Collaboration. Full text in Research Archive Show summary

  Panel discussion with Robertina ?ebjani?, Anetta Mona Chi?a, Alexander Refsum Jensenius. Moderated by Benedetta D'Ettorre. This panel examines the boundary zones where artistic and scientific approaches intersect, entangle, and permeate into one another. Bringing together practitioners working across more-than-human ecologies, technological imaginaries, and embodied research, the conversation will explore how meaningful collaboration can emerge from inter- and trans-disciplinary exchange. Rather than framing art and science as opposites, we ask how their methods can become mutually generative; how artistic mindsets can expand scientific inquiry, and how scientific perspectives can deepen artistic experimentation. The session aims to discuss questions related to collaborative ethics, shared vocabularies, and the value of embracing ¡°noise¡± as a catalyst for new forms of knowledge-making.

• J?re, Lisbet & Jensenius, Alexander Refsum (2025). Verdens st?rste musikkeksperiment viste at publikum holdt pusten samtidig. [Internet]. °ÄÃŻʹÚÌåÓý,»Ê¹Ú×ãÇò±È·Ö.no. Full text in Research Archive Show summary

  Publikum holder pusten samtidig, og n?r musikken blir emosjonell sitter alle helt stille sammen. Det avsl?rer de f?rste funnene fra verdens st?rste musikkeksperiment.

• Snaprud, Per; Jensenius, Alexander Refsum; Endestad, Tor & W?ien, Randi (2025). Concientia. doi: https:/happeningnext.com/event/samtale-om-bevissthet-og-det-%C3%A5-skape-eid3a0d68lba3. Full text in Research Archive Show summary

  I forbindelse med utstillingen Conscientia p? Gamle Munch arrangeres en samtale om bevissthet og det ? skape. Utgangspunktet for tema til utstillingen er bevissthet og forhold knyttet til det ? skape. En del av utstillingen tar utgangspunkt i en serie med selvportretter av Randi W?ien basert p? MR bilder tatt av hennes eget hode. Bildene representerer et sett av intrikate m?nstre i ulike st?rrelser og sammensetninger og kan refereres til ulike organer, andre vesener og ren natur. Samtidig er de en representasjon av kunstneren slik hun er satt sammen i sitt eget hode. Keramiker Jorid Krosse lager objekter med form og m?nster som tar inspirasjon fra naturen og kan relateres til organiske strukturer, hoder og andre vesener. I samspill med maleriene vil de keramiske objektene settes i en relasjon til det kroppslige. Samtalen om bevissthet og det ? skape bruker utstillingen som et utgangspunkt til ? f? belyst hva den skapende prosessen kan bety for v?r egen utvikling og hvordan hjernen fungerer og responderer p? skapende prosesser. Tema for samtalen vil v?re forholdet mellom kunst og bevissthet, om relasjonen mellom maleri og objekt og om hvordan det ? skape kunst kan p?virke v?r forst?else av oss selv og omgivelsene. For tiden forskes det mye p? hva som faktisk skjer i hjernen n?r man skaper noe. Vi har f?tt med oss to av de fremste forskerne p? temaet fra universitetet i Oslo. Alexander Refsum Jensenius er professor i musikkteknologi ved Universitetet i Oslo, hvor han ogs? leder RITMO Senter for tverrfaglige studier av rytme, tid og bevegelse og MishMash Senter for KI og kreativitet. Han forsker p? hvordan lyd og musikk p?virker kropp og sinn, bevisst og ubevisst. Tor Endestad er f?rsteamanuensis i kognitiv- og nevropsykologi p? univeristetet i Oslo og er tilknyttet Ritmo. Han leder FRONT neurolab og forsker p? kognitiv psykologi og kognitiv nevrovitenskap med fokus p? hjerneavbildningsmetodikk. P?g?ende forskningsprosjekter omfatter studier av basale mekanismer i oppfattelse av rytme og tid, oppmerksomhet og hukommelse. Til ? moderere samtalen har vi f?tt med oss Per Snaprud. Han er vitenskapsjournalist og f?r det hjerneforsker. Han arbeider i det Stockholm baserte magasinet °ÄÃŻʹÚÌåÓý,»Ê¹Ú×ãÇò±È·Ö og Framsteg og har tidligere v?rt virksom ved Dagens Nyheters og Sveriges Radios vitenskapsredaksjoner. Han er ogs? forfatter av boken ?Medvetandets ?terkomst, om hj?rnan, kroppen och universum?. Victoria Johnson er fiolinist, underviser ved Institutt for musikkvitenskap og deltar i ulike forskningsprosjekter ved UiO. Hun har hatt solokonserter blant annet under Festspillene i Bergen, Ultima, Borealisfestivalen og Soundwaves i London. Hennes lidenskap for samtidsmusikk har resultert i flere bestillingsverk og plateinnspillinger. I denne sammenhengen vil hun spille musikk som er direkte komponert til bildene og objektene i utstillingen.

• Jensenius, Alexander Refsum (2025). Kan musikk skape fred? [Internet]. Ungdomsavisa. doi: https:/ungdomsavisa.com/index.php?artID=763&navB=1. Full text in Research Archive Show summary

  I kveld var en rekke personligheter fra musikkmilj?et samlet til debatt ved Universitetet i Oslo. Temaet var ?Kan musikk skape fred??. Blant deltakerne var Birgitte Grimstad og Lars Klevstrand , som har underholdt med musikk i flere ti?r. Debatten ble ledet av blant annet professor i musikkvitenskap ved UiO, Alexander Refsum Jensenius.

• Jensenius, Alexander Refsum (2025). Are we still needed? doi: https:/filmskolen.no/artikler/2025/ki-i-filmbransjen-2-0. Full text in Research Archive Show summary

  Den kunstige intelligensens frammarsj fortsetter ? v?re den st?rste kulturelle og samfunnsmessige omveltningen siden den industrielle revolusjonen. Siden fjor?rets konferanse har det skjedd vanvittig mye, derfor inviterer vi igjen til en dag fylt med internasjonale n?kkelpersoner, banebrytende prosjekter og nye perspektiver p? hvordan KI endrer m?ten vi utvikler, produserer og opplever film.

• Jensenius, Alexander Refsum; Bjerkestrand, Kari Anne Vadstensvik; Johnson, Victoria Christine ?rang & Rao, Shabari (2025). Stillness ¨C Silence. doi: https:/www.hf.uio.no/imv/english/research/news-and-events/events/Research-Forum/2025/research-forum-stillness-and-silence.html. Full text in Research Archive Show summary

  What can be learned by standing still in silence? Dancers typically move, and musicians move to produce sound. In this research forum, we explore the opposite: musicians and dancers who stand still in silence.

• Jensenius, Alexander Refsum (2025). Musikk og kunstig intelligens. [TV]. TV2. doi: https:/play.tv2.no/nyheter/god-morgen-norge-y05mec7j?play=true. Full text in Research Archive
• Jensenius, Alexander Refsum (2025). What is the role of AI in creative activities? Full text in Research Archive
• Guo, Jinyue; T?rresen, Jim & Jensenius, Alexander Refsum (2025). Cross-modal Analysis of Spatial-Temporal Auditory Stimuli and Human Micromotion when Standing Still in Indoor Environments (poster). doi: 10.5281/zenodo.17502603. Full text in Research Archive
• Duch, Michael Francis; Furunes, Alexander Eriksson; Jensenius, Alexander Refsum & Olsen, Cecilie Sachs (2025). Kunstnerisk forskning for en kompleks verden. doi: https:/akademietforyngreforskere.no/wp-content/uploads/2025/11/Jubileumsbok-digital-3.pdf. Full text in Research Archive Show summary

  Kunstfagene spiller en viktig rolle i ? utvide m?ten vi jobber med og forst?r komplekse samfunnsproblemer. Likevel blir kunstfagene stadig oversett og nedprioritert i forskningspolitikken. Vi sp?r derfor: hva er, b?r og kan kunstens rolle v?re i det norske forskningslandskapet?

• Jensenius, Alexander Refsum (2025). Technologies supporting research on music-related body motion. doi: https:/www.liser.lu/events/EXPAR2025-09-18. Full text in Research Archive Show summary

  As researchers, we are increasingly using emerging technologies, such as multiple mobile eye tracking, virtual reality, and physiological indicators (e.g., heart rate and respiration) to study professionals¡¯ individual and collaborative work practices. In this workshop, we will demonstrate how these technologies can be provided to professionals in various fields (e.g., education, healthcare, business, engineering, the arts) as a resource for self-reflection, enabling them to study and improve their own practices. The goal of this workshop is to introduce and facilitate participants to experience novel approaches that use these emerging technologies and tools to help practitioners study their own skills and understand their learning processes. We will also show how focus groups and stimulated recall interviews can encourage and guide professionals to discover ways to incorporate these new technologies into their practice as resources for reflection and growth. The workshop¡¯s theme is educational practice and research, with a focus on showing how we can offer teachers theoretically driven and empirically validated methodologies for witnessing the micro-processes of collaborative mathematics learning. We will show and discuss how multiple mobile eye-tracking and virtual reality can be used in educational practice and for teacher training and professional development. This approach and these emerging technologies are applicable not only in education, but also in all other fields of research that aim to study individual and collective practices, as well as professional learning, during the process of acquiring new skills or improving existing ones.

• Jensenius, Alexander Refsum (2025). Video Visualization - Learn to use MG Toolbox. doi: https:/www.liser.lu/events/EXPAR2025-09-19. Full text in Research Archive Show summary

  This workshop is targeted at students and researchers working with video recordings You will learn to use MG Toolbox, a Python package with numerous tools for visualizing and analyzing video files. This includes visualization techniques such as motion videos, motion history images, and motiongrams; techniques that, in different ways, allow for looking at video recordings from different temporal and spatial perspectives. It also includes some basic computer vision analysis, such as extracting quantity and centroid of motion, and using such features in analysis. MG Toolbox for Python is a collection of high-level modules that generate all of the above-mentioned visualizations.The toolbox is relevant for everyone working with video recordings of humans, such as in linguistics, psychology, medicine, human-computer interaction, and educational sciences.

• Jensenius, Alexander Refsum (2025). Noen resultater fra tre ?r med forsknings°ÄÃŻʹÚÌåÓý,»Ê¹Ú×ãÇò±È·Ö med tre orkestre. Full text in Research Archive Show summary

  Denne presentasjonen oppsummerer resultater fra forskningsstudier p? og med tre skandinaviske symfoniorkestre. I alle tilfeller har b?de kvalitative og kvantitative data blitt samlet inn p? pr?ver og konserter i konsertsaler.

• Jensenius, Alexander Refsum (2025). What happens in the body when you stand still? Full text in Research Archive Show summary

  Professor Alexander Refsum Jensenius will talk about his decade-long exploration of human micromotion. Motion data from the 365 standstill sessions he carried out during 2023 reveals lots of biomechanical noise, but also some interesting signals.

• Olsen, Cecilie Sachs; Jensenius, Alexander Refsum & Duch, Michael Francis (2025). Kunstnerisk forskning for en kompleks verden. Full text in Research Archive
• Jensenius, Alexander Refsum (2025). °ÄÃŻʹÚÌåÓý,»Ê¹Ú×ãÇò±È·Ösfronten - Mensblod mot Alzheimers. [Radio]. NRK P2 Abels t?rn. Full text in Research Archive Show summary

  Kan personlighetstrekket avgj?re om du liker ? danse?

• Riaz, Maham (2025). Where is That Bird? The Impact of Artificial Birdsong in Public Indoor Environments. Full text in Research Archive Show summary

  This paper explores the effects of nature sounds, specifically bird sounds, on human experience and behavior in indoor public environments. We report on an intervention study where we introduced an interactive sound device to alter the soundscape. Phenomenological observations and a survey showed that participants noticed and engaged with the bird sounds primarily through causal listening; that is, they attempted to identify the sound source. Participants generally responded positively to the bird sounds, appreciating the calmness and surprise it brought to the environment. The analyses revealed that relative loudness was a key factor influencing the experience. A too-high sound level may feel unpleasant, while a too-low sound level makes it unnoticeable due to background noise. These findings highlight the importance of automatic level adjustments and considering acoustic conditions in soundscape interventions. Our study contributes to a broader discourse on sound perception, human interaction with sonic spaces, and the potential of auditory design in public indoor environments.

• Riaz, Maham (2025). VentHackz: Exploring the Musicality of Ventilation Systems. Full text in Research Archive Show summary

  Ventilation systems can be seen as huge examples of interfaces for musical expression, with the potential of merging sound, space, and human interaction. This paper explores conceptual similarities between ventilation systems and wind instruments and explores approaches to "hacking" ventilation systems with components that produce and modify sound. These systems enable the creation of unique sonic and visual experiences by manipulating airflow and making mechanical adjustments. Users can treat ventilation systems as musical interfaces by altering shape, material, and texture or augmenting vents. We call for heightened attention to the sound-making properties of ventilation systems and call for action (#VentHackz) to playfully improve the soundscapes of our indoor environments.

• Sveen, Henrik; Bishop, Laura & Jensenius, Alexander Refsum (2025). Cyclic Patterns and Spatial Orientations in Artificial Impulsive Autonomous Sensory Meridian Response (ASMR) Sounds. Full text in Research Archive Show summary

  Autonomous Sensory Meridian Response (ASMR) is a tingling sensation in the neck and spine often triggered by specific sounds. This paper reports a study on the impact of different cyclic patterns and spatial orientations¡ªdefined here as the perceived directionality and motion of sound sources in a three-dimensional auditory space¡ªon inducing ASMR experiences. The results demonstrate that both the type of cyclic pattern and the spatial orientation significantly influence the intensity and nature of ASMR experiences. Furthermore, the research explores synthesizing ASMR-inducing sounds while preserving key audio characteristics from acoustically recorded ASMR content. Through survey data analysis and regression modeling, distinct patterns emerge regarding the relationship between personality traits and ASMR experience. The findings contribute to a deeper understanding of ASMR as a sensory phenomenon and provide insights into the potential applications of artificially generated ASMR stimuli. Additionally, the research sheds light on the role of spatiality in ASMR experiences and the synthesis of ASMR-inducing sounds for future studies and practical applications

• Jensenius, Alexander Refsum (2025). What happens in the body when you stand still? Full text in Research Archive Show summary

  Professor Alexander Refsum Jensenius will talk about his decade-long exploration of human micromotion. Motion data from the 365 standstill sessions he carried out during 2023 reveals lots of biomechanical noise, but also some interesting signals.

• Jensenius, Alexander Refsum (2025). KI og musikkens fremtid. Full text in Research Archive Show summary

  Alexander Refsum Jensenius leder RITMO, Senter for tverrfaglig forskning p? rytme, tid og bevegelse, med 60 ansatte. Han leter for tiden systematisk etter mulighetene og perspektivene KI kommer med. KI er en disruptiv teknologi som griper inn i etablerte n?ringsmodeller. Hvor er vi p? vei? Mange av perspektivene kan virke overveldende. Det er imidlertid viktig ? huske p? at selv om maskiner n? er med p? ? utvikle seg selv, er det prim?rt mennesker som vil utvikle ogs? morgendagens teknologier. Han mener det er sentralt at vi i Norge er med p? denne utviklingen. Her mener kunst- og kulturfeltet har en unik mulighet til ? bidra gjennom eksperimentell utforskning og kritisk refleksjon. Han mener vi vil se flere systemer som fokuserer p? kontinuerlig samhandling mellom mennesker og maskiner, slik som n?r musikere improviserer. Men at man ikke kommer videre med KI uten at de f?r en kropp som kan sanse og handle. Og at KI-systemer vil kunne bli mer empatiske, noe som vil forbedre menneske-maskin-kommunikasjon, men som ogs? reiser mange etiske problemstillinger.

• Jensenius, Alexander Refsum (2025). Improvisasjon for muskelarmb?nd. Full text in Research Archive
• Jemterud, Torkild; Jensenius, Alexander Refsum; Undheim, Vegard & R?islien, Jo (2025). Wonderful Nachspiel med Torkild Jemterud. Full text in Research Archive
• Lerdahl, Erik; Buene, Eivind; Berg, Anna & Jensenius, Alexander Refsum (2025). Musikk, stillhet og kreativitet. Full text in Research Archive Show summary

  Alexander Refsum Jensenius har st?tt stille 10 min hver dag i ett ?r. Han kalles Professor Stillstand. Han leder et senter med 60 ansatte som forsker p? rytme, tid og bevegelse, og vil gjerne forst? mer og dypere om hvordan lydene og inntrykkene av det vi omgir oss med p?virker oss. Hans f?rste erkjennelse er at han tror verden ville kunne bli et bedre sted om alle stod stille 10 minutter hver dag. Hva gj?r musikk og stillhet med oss selv, v?rt velv?re og v?r kreativitet?

• Schau, Kristopher & Jensenius, Alexander Refsum (2025). Nysgjerrige p?: rytmens hemmeligheter. [Internet]. Nysgjerrige Norge. Full text in Research Archive Show summary

  I denne episoden bes?ker Kristopher forskningssenteret RITMO ved Universitetet i Oslo. Der forsker de p? alt fra trommeroboter og mikromusikalske problemstillinger til hvordan vi p?virkes av ventilasjonslyd. Han m?ter senterleder Alexander Refsum Jensenius som forteller om forskning i skj?ringspunktet mellom musikk, bevegelse, psykologi og robotikk.

• Riaz, Maham (2025). The Art and Science of Immersive Sound Design in Games - What's the Secret? Full text in Research Archive Show summary

  In modern games, sound design is far more than mere background noise¡ªit conveys a story and shapes entire worlds. We will explore how gamification principles¡ªinteraction, feedback, progression, challenge, exploration, and motivation¡ªintegrate with sound design techniques such as spatial audio, adaptive mixing, and procedural audio to create responsive audio environments. Practical aspects of implementing game audio will be discussed within Unity (and Wwise).

• Jensenius, Alexander Refsum (2025). Video Visualization - Learn to use MG Toolbox. Full text in Research Archive Show summary

  This workshop is designed for students and researchers who work with video recordings. You will learn to use MG Toolbox, a Python package with numerous tools for visualizing and analyzing video files. This includes visualization techniques such as motion videos, motion history images, and motiongrams, which allow for viewing video recordings from different temporal and spatial perspectives in various ways. It also includes some fundamental computer vision analysis, such as extracting the quantity and centroid of motion, and using such features in analysis. MG Toolbox for Python is a collection of high-level modules that generate all of the visualizations mentioned above. The toolbox is relevant for everyone working with video recordings of humans, including linguists, psychologists, medical professionals, human-computer interaction specialists, and educators in the educational sciences.

• Jensenius, Alexander Refsum (2025). Music, RITMO and AI. Full text in Research Archive Show summary

  An introduction to RITMO and ongoing research on the topic of music and AI for a workshop between researchers from the University of Oslo, Queen Mary University of London, and KTH Royal Institute of Technology.

• G?ks¨¹l¨¹k, Bilge Serdar & Tidemann, Aleksander (2024). Digital Collaboration in Dance and Music: Remote Interaction and Improvisation with Zoom and LoLa. doi: https:/www.ultima.no/en/ulysses-online-session-remote-connections-co-creation-across-distances. Full text in Research Archive Show summary

  This digital forum explores artistic collaboration through online platforms, examining how technology can facilitate sustainable and eco-friendly ways of creating music collectively. Participants will gain insights into artist-driven initiatives and practical tools for creative co-creation, regardless of geographical distance. Following three short presentations from invited contributors, there will be an open dialogue and exchange of experiences, allowing ULYSSES artists to share their own projects.

• Jensenius, Alexander Refsum (2024). From Sound to Science: Open Science Practices at the RITMO Centre. [Internet]. Pathos. Full text in Research Archive Show summary

  A PathOS interview about how Open Science (Open Access to publications, Open/FAIR data and software, collaborations with citizens) has made a positive or negative impact.

• Jensenius, Alexander Refsum & Laczko, Balint (2024). Video Visualization. Full text in Research Archive Show summary

  This workshop is targeted at students and researchers working with video recordings. You will learn to use MG Toolbox, a Python package with numerous tools for visualizing and analyzing video recordings. This includes visualization techniques such as motion videos, motion history images, and motiongrams; techniques that, in different ways, allow for looking at video recordings from different temporal and spatial perspectives. It also includes some basic computer vision analysis, such as extracting quantity and centroid of motion, and using such features in analysis.MG Toolbox for Python is a collection of high-level modules for generating all of the above-mentioned visualizations and analyses. This toolbox was initially developed to analyze music-related body motion but is equally helpful for other disciplines working with video recordings of humans, such as linguistics, psychology, medicine, and educational sciences.

• Jensenius, Alexander Refsum (2024). Labprat #3: NM i stillstand. Full text in Research Archive Show summary

  Klarer du ? st? stille til favorittl?ta di? Pr?v selv og vinn 1000kr! Folk sier ofte at det er umulig ? ikke bevege seg til musikk, men stemmer det? Onsdag 3. april kan du teste deg selv n?r professor Alexander Refsum Jensenius ¨C ogs? kjent som Professor stillstand ¨C inviterer til ?NM i stillstand? her p? Popsenteret. Vinneren k?res samme kveld p? LAB.prat #3 med nettopp Alexander! Her f?r du ogs? vite mer om hva som faktisk skjer i kroppen n?r vi h?rer p? musikk. Som vanlig ledes kvelden av fasilitator og ?MC? Dr. Kjell Andreas Oddekalv, ogs? kjent som ?Dr. Kjell? (eller hele Norges Kjelledegge som han selv liker ? si) fra Hiphop orkesteret Sinsenfist. Sammen med Alexander inviterer han til en uformell samtale og Q&A om kroppsrytmer og hvordan de p?virkes av omgivelsene v?re. I tidsrommet mellom stillstandkonkurransen og LAB.prat er Popsenteret ?pent og du er velkommen til ? bes?ke utstillingen v?r og alt den har ? by p?!

• Jensenius, Alexander Refsum (2024). 20 years of concert research at the University of Oslo. Full text in Research Archive Show summary

  In my talk I will give an overview of the concert research conducted in the fourMs Lab at the University of Oslo from the early 2000s to today. Over the years, we have explored and refined numerous data captures methods, from qualitative observation studies, interviews, and diaries to motion capture and physiological sensing. At the core has always been the attempt to shed light on the complexity of music performance. This includes understanding more about the subtleties of performer's sound-producing actions, sound-facilitating motion, and communicative and expressive gestures. It also includes the intricacies of inter-personal synchronization. Over the years, we have been able to expand from studying duos, trios, and quartets to full orchestras. Today, we have lots of data, some answers, and even more questions than when we started. An excellent starting point for future research.

• Jensenius, Alexander Refsum (2024). Video Visualization and Analysis. Full text in Research Archive Show summary

  In this workshop, I will introduce video visualization as a method for understanding more about music-related body motion. Examples will be given of various methods implemented in the standalone application VideoAnalysis and the Musical Gestures Toolbox for Python.

• Jensenius, Alexander Refsum (2024). Blikksporing av musikere og maler p? scenen. Full text in Research Archive Show summary

  Hvor ser en kunstner som maler p? scenen under en konsert? Forskere fra UiO fors?ker ? finne ut av dette ved hjelp av avansert blikksporingsteknologi.

• Jensenius, Alexander Refsum (2024). The Ambient project at RITMO. Full text in Research Archive Show summary

  The AMBIENT project aims to study how such elements influence people's bodily behaviors and how they feel about the rhythms in an environment. This will be done by studying how different auditory and visual stimuli combine to create rhythms in various settings.

• Jensenius, Alexander Refsum (2024). From air guitar to self-playing guitars. Full text in Research Archive Show summary

  What can air guitar performance tell about people's musical experience and how does it relate to real guitar performance? Alexander Refsum Jensenius will tell about his decade-long research into music-related body motion of both performers and perceivers. He will also tell about how this has informed new performance paradigms, including the self-playing guitars that will be showcased at the festival. ? Alexander Refsum Jensenius is a professor of music technology at the University of Oslo and Director of RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion. He studies how and why people move to music and uses this knowledge to create new music with untraditional instruments. He is widely published, including the books Sound Actions and A NIME Reader.

• Jensenius, Alexander Refsum (2024). Embodied music-related design. Full text in Research Archive Show summary

  Abrahamson et al. (2022) recently called for a merging of Embodied Design-Based Research and Learning Analytics to establish a coherent and integrated focus on Multimodal Learning Analytics of Embodied Design. In Spring 2022, members of EDRL and selected international collaborators of the lab participated in ¡°Rhythm Rising,¡± a workshop week hosted at University of Oslo¡¯s RITMO Centre for Interdisciplinary Studies in Rhythm, Time, and Motion. The workshop featured activities for graduate students to learn the scientific research methodologies of gathering physical, physiological, and neurobiological data from study participants engaged in interactive learning of STEM content. The activities combined the respective expertise of Abrahamson (learning sciences) and Jensenius (embodied music cognition and technology) to investigate sensorimotor micro-processes hypothesized to form the cognitive basis of conceptual understandings, such as hand- and eye actions leading to the emergence of mathematical insight. Whereas the Oslo workshop spurred great enthusiasm among the graduate students, its duration only allowed time for initial data collection. Therefore, we would like to regather in Spring 2024 to continue our collaborative work and to share insights about data analysis, visualization, and interpretation. Concurrently, we¡¯ll develop ideas for future joint research projects.

• Jensenius, Alexander Refsum (2024). MusicLab som et ?pen forskningsprosjekt mellom RITMO og UB. Full text in Research Archive Show summary

  MusicLab er et °ÄÃŻʹÚÌåÓý,»Ê¹Ú×ãÇò±È·Ö mellom RITMO og Universitetsbiblioteket. M?let er ? utforske nye m?ter ? samle inn og formidle musikkrelaterte forskningsdata p?.

• Jensenius, Alexander Refsum (2024). ?pen forskning muliggj?r forskningsn?r utdanning. Full text in Research Archive Show summary

  Selv om vi liker ? si at driver med forskningsbasert utdanning, er organiseringen av forskning og utdanning gjerne plassert i ulike siloer, skriver Alexander Refsum Jensenius.

• G?ks¨¹l¨¹k, Bilge Serdar (2024). Conducting Semi-Structured Dance Research in Motion Capture Labs. Full text in Research Archive
• G?ks¨¹l¨¹k, Bilge Serdar (2024). Remote Intercorporeality Through Telematic Technologies. Full text in Research Archive
• G?ks¨¹l¨¹k, Bilge Serdar (2024). Remote Dance Improvisation Through Advanced Telematic Technologies. Full text in Research Archive
• Jensenius, Alexander Refsum (2024). Muskelmusikk. Full text in Research Archive Show summary

  Hva skjer i musklene n?r vi fors?ker ? st? stille? Hvordan kan men lage musikk fra kroppen. I pausen p? Forsker Grand Prix vil jeg underholde med et sceneshow hvor jeg utforsker interaktive muskelarmb?nd og en musikkhanske.

• G?ks¨¹l¨¹k, Bilge Serdar (2024). Immersive Technologies in TYA: Bodily Concerns, Challenges and Opportunities. Full text in Research Archive
• G?ks¨¹l¨¹k, Bilge Serdar (2024). Immersive Technologies and Their Implications in Theatre for Young Audiences. Full text in Research Archive
• Jensenius, Alexander Refsum (2024). Hvorfor trenger vi lisenser p? data? Full text in Research Archive Show summary

  QualiFAIR huben inviterer til en presentasjon og en diskusjon om rettighetene til data og behov for lisenser for data og annet forskningsmateriale.

• Jensenius, Alexander Refsum & Lilleeng, Sverre (2024). Professor stillstand. [Internet]. NRK. Full text in Research Archive
• Riaz, Maham (2024). Comparing Spatial Audio Recordings from Commercially Available 360-degree Video Cameras. Full text in Research Archive Show summary

  This paper investigates the spatial audio recording capabilities of various commercially available 360-degree cameras (GoPro MAX, Insta360 X3, Garmin VIRB 360, and Ricoh Theta S). A dedicated ambisonics audio recorder (Zoom H3VR) was used for comparison. Six action sequences were performed around the recording setup, including impulsive and continuous vocal and non-vocal stimuli. The audio streams were extracted from the videos and compared using spectrograms and anglegrams. The anglegrams show adequate localization in ambisonic recordings from the GoPro MAX and Zoom H3VR. All cameras feature undocumented noise reduction and audio enhancement algorithms, use different types of audio compression, and have limited audio export options. This makes it challenging to use the spatial audio data reliably for research purposes.

• Riaz, Maham & Theodoridis, Ioannis (2024). Ventilation hacking. Full text in Research Archive Show summary

  We examine innovative approaches to mitigate the issue of unwanted ventilation noise, transforming it from a disruptive element into a source of ambient or musical sound. We propose a range of solutions, from mechanical adjustments to acoustic treatments and digital interventions.

• Jensenius, Alexander Refsum (2024). Stod stille hver dag i 10 minutter. [TV]. NRK Helgemorgen. Full text in Research Archive
• Guo, Jinyue (2024). Comparing Four 360-Degree Cameras for Spatial Video Recording and Analysis. Full text in Research Archive Show summary

  This paper reports on a desktop investigation and a lab experiment comparing the video recording capabilities of four commercially available 360-degree cameras: GoPro MAX, Insta360 X3, Garmin VIRB 360, and Ricoh Theta S. The four cameras all use different recording formats and settings and have varying video quality and software support. This makes it difficult to conduct analyses and compare between devices. We have implemented new functions in the Musical Gestures Toolbox (MGT) for reading and merging files from the different platforms. Using the capabilities of FFmpeg, we have also made a new function for converting between different 360-degree video projections and formats. This allows (music) researchers to exploit 360-degree video recordings using regular videobased analysis pipelines.

• Jensenius, Alexander Refsum (2024). Can doing nothing tell us everything? Full text in Research Archive Show summary

  Can doing nothing tell us everything? Meet Professor Alexander Refsum Jensenius, a music researcher exploring the deep connections between sound, space, and the human body. Through his fascinating studies on stillness and motion, Alexander has discovered surprising insights into how we interact with our environment.

• Jensenius, Alexander Refsum & Jerve, Karoline Ruderaas (2024). Verdens st?rste musikkeksperiment. [Journal]. Ballade. Full text in Research Archive Show summary

  I kveld m?tes NRKs popul?rvitenskapelige radioprogram Abels t?rn, KORK og forskningsprosjektet MusicLab for ? m?le hva som skjer mellom musikere og publikum n?r de utsettes for musikk.

• Jemterud, Torkild; Jensenius, Alexander Refsum; L?seth, Guro Engvig & Holthe, Kolbj?rn (2024). ABELS KORK - Verdens st?rste(?) musikkeksperiment. [Radio]. NRK. Full text in Research Archive Show summary

  Hvordan p?virker musikk oss? Hva skjer i hjernen v?r n?r vi h?rer en melodi vi liker ¨C eller misliker? Hvorfor reagerer vi forskjellig p? ulike typer musikk? Og hvordan klarer et helt orkester ? spille plettfritt sammen? Og forresten: trenger de egentlig ? ha en dirigent? Hver fredag svarer panelet i Abels t?rn p? alle slags vitenskapelige sp?rsm?l, store og sm?, fra lytterne. Noen vil langt ut i verdensrommet, og andre er mer opptatt av hva som skjer p? kj?kkenbenken. Men musikk er noe vi alle har et forhold til. Den er rundt oss hele tiden, og det er mye ? undre seg over n?r det gjelder musikk og hvordan den taler til oss p? dype personlige plan. Derfor har Abels t?rn og KORK g?tt sammen med RITMO og Universitetsbiblioteket for ? lage en musikalsk utgave av det popul?re vitenskapsprogrammet. Vi introduserer: Abels KORK!

• Jensenius, Alexander Refsum; Riaz, Maham; Oldfield, Thomas L & Juarez, Karenina (2024). RITMO-studenter presenterer nye installasjoner. Full text in Research Archive Show summary

  Studenter tilknyttet RITMO stiller ut prosjektene sine p? Popsenteret: en interaktiv symaskin fra 1911, et lyttende og snakkende speil, og et interaktivt maleri. Hvordan kan slike objekter gi musikalske opplevelser?

• Jensenius, Alexander Refsum (2024). Challenges and Possibilities of Open Music Data. Full text in Research Archive Show summary

  The Sempre Autumn conference was an online student study day, held on Friday 8th November 2024, with a combination of student presentations, research speed dating, and a special session on open research featuring Professor Iain Brennan (University of Hull), Professor Tuomas Eerola (Durham University), and Professor Alexander Refsum Jensenius (University of Oslo). The event was open to doctoral students at any stage of their research and those thinking of applying for doctoral study. We invited proposals for short presentations (10 minutes + 5 for Q&A) from doctoral students, on any aspect of music psychology or music education.

• G?ks¨¹l¨¹k, Bilge Serdar; Tidemann, Aleksander & Jensenius, Alexander Refsum (2024). Telematic Testing: One Performance in Three Locations. Full text in Research Archive
• Jensenius, Alexander Refsum; Vo, Synne; Kelkar, Tejaswinee & Kjus, Yngvar (2024). Musikksnakk: Musikk p? Spotify - hvordan funker algoritmene? Full text in Research Archive Show summary

  Hvorfor er det slik at plateselskaper ?nsker at artister skal lage TikTok?er for ? promotere musikken sin? Hva bestemmer hvilke musikkanbefalinger du f?r i Spotify? Og hvordan bruker plateselskapene dataene dine til ? generere klikk og lytt? Bli med p? en samtale om algoritmer p? apper som TikTok og Spotify - og hvordan de p?virker musikksmaken din! Til ? diskutere dette kommer: - Synne Vo. Hun er en artist som slo igjennom p? TikTok, og bruker plattformen aktivt for ? promotere musikken sin. Hun kommer til panelet for ? dele sine erfaringer med bransjen og appene. - Yngvar Kjus. Han er professor i musikk og medier p? UiO, og har forsket mye p? popul?rmusikk, musikkproduksjon og musikkbransjen. - Tejaswinee Kelkar. Hun er er en sanger og forsker innen musikk og bevegelse. Hun har tidligere jobbet som dataanalytiker i Universal Music Norway og ved RITMO Center of Excellence ved Universitetet i Oslo. Samtalen ledes av Alexander Refsum Jensenius. Han er professor i musikk ved Universitetet i Oslo, og leder av RITMO - Senter for tverrfaglig forskning p? rytme, tid og bevegelse. Han pr?ver hele tiden ? forst? mer om hvordan og hvorfor mennesker beveger seg til musikk.

• Jensenius, Alexander Refsum (2024). Interdisiplin?ritet - et musikkperspektiv. Full text in Research Archive Show summary

  Skal snakke om skj?ringspunktet mellom psykologi, informatikk og musikk og arbeidet som foreg?r p? instituttet han leder: RITMO, Senter for Interdisiplin?re studier i rytme, tid og bevegelse ved Universitetet i Oslo. Alexander er b?de forsker og musiker. Han har en sammensatt bakgrunn best?ende av musikk, informatikk, fysikk og matematikk og hans praktisk rettede forskning har bredt nedslagsfelt. Digitale verkt?y som har blitt utviklet ved RITMO blir n? ogs? brukt innen medisinsk forskning p? ADHD og Cerebral Parese.

• Jensenius, Alexander Refsum (2024). 20 Years of Piano Research at the University of Oslo. Full text in Research Archive Show summary

  In this lecture-recital, I will present piano-related research from the Department of Musicology over the last twenty years. I will also reflect on my role in this history, both as an artist and scientist. Finally, I will scrutinize the department's new Disklavier while performing various exploratory etudes.

• Jensenius, Alexander Refsum (2024). Hjernen i sentrum: Kunst. Full text in Research Archive Show summary

  Hvorfor er noen musikalske og andre ikke? Hvordan har det seg at kunst kan treffe oss s? voldsomt - og s? ulikt! Ulike kunstneriske uttrykk som musikk, malerkunst, litteratur, dans og teater kommer uten fasit og tolkes vidt forskjellig fra person til person. Er det hjernen som styrer dette? Det er ?penbart at hjernen v?r er aktiv og ikke passiv n?r vi opplever kunst. Hvorfor er det s?nn? Gir kunstneriske opplevelser god hjernetrim? Er kunst viktig for hjernehelsen?

• Jensenius, Alexander Refsum (2024). MusicLab as an Open Science innovation project between a research centre and the University library. Full text in Research Archive
• Jensenius, Alexander Refsum (2024). Interdisciplinarity. Full text in Research Archive
• Jensenius, Alexander Refsum (2024). Musikk, Data og KI. Full text in Research Archive Show summary

  Musikk er en av de mest komplekse menneskelige kommunikasjonsformene som finnes og egner seg derfor godt for ? utforske kunstig intelligens. Presentasjonen beskriver hvordan musikkforskere, psykologer og informatikere jobber sammen ved RITMO for ? forst? mer om rytme, tid og bevegelse hos mennesker og maskiner.

• Jensenius, Alexander Refsum (2023). Wishful thinking about CVs: Perspectives from a researcher. Full text in Research Archive
• Jensenius, Alexander Refsum (2023). Sound Actions: An Embodied approach to a Digital Organology. Full text in Research Archive Show summary

  What is an instrument in our increasingly electrified world? In this talk I will present a set of theoretical building blocks from my forthcoming book on "musicking in an electronic world". At the core of the argument is the observation that the introduction of new music technologies has led to an increased separation between action and sound in musical performance. This has happened gradually, with pianos and organs being important early examples of instruments that introduced mechanical components between the performer and resonating objects. Today's network-based instruments represent an extreme case of a spatiotemporal dislocation between action and sound. They challenge our ideas of what an instrument can be, who can perform on them, and how they should be analyzed. In the lecture I will explain how we can use the concepts of action-sound couplings and mappings to structure our thinking about such instruments. This will be used at the heart of a new organology that embraces the qualities of both acoustic and electroacoustic instruments.

• Jensenius, Alexander Refsum (2023). Conceptualizing Musical Instruments. Full text in Research Archive Show summary

  What is an instrument in our increasingly electrified world? In this talk I will present a set of theoretical building blocks from my recent book "Sound Actions". At the core of the argument is the observation that the introduction of new music technologies has led to an increased separation between action and sound in musical performance. This has happened gradually, with pianos and organs being important early examples of instruments that introduced mechanical components between the performer and resonating objects. Today's network-based instruments represent an extreme case of a spatiotemporal dislocation between action and sound. They challenge our ideas of what an instrument can be, who can perform on them, and how they should be analyzed. In the lecture I will explain how we can use the concepts of action-sound couplings and mappings to structure our thinking about such instruments.

• Jensenius, Alexander Refsum (2023). Explorations of human micromotion through standing still. Full text in Research Archive Show summary

  Throughout 2023, I will stand still for ten minutes around noon every day, in a different room each day. The aim is to collect data about my micromotion and compare it to the qualities of the environment. This project follows a decade-long exploration of human micromotion from both artistic and scientific perspectives. In the talk, I will present results from the annual Norwegian Championships of Standstill, where we have studied the influence of music on people's micromotion. I will also talk about how micromotion can be used in interactive music systems, allowing for conscious and unconscious control of musical sounds.

• Jensenius, Alexander Refsum (2023). Conceptualizing Musical Instruments. Full text in Research Archive Show summary

  What is an instrument in our increasingly electrified world? In this talk I will present a set of theoretical building blocks from my forthcoming book on "musicking in an electronic world". At the core of the argument is the observation that the introduction of new music technologies has led to an increased separation between action and sound in musical performance. This has happened gradually, with pianos and organs being important early examples of instruments that introduced mechanical components between the performer and resonating objects. Today's network-based instruments represent an extreme case of a spatiotemporal dislocation between action and sound. They challenge our ideas of what an instrument can be, who can perform on them, and how they should be analyzed. In the lecture I will explain how we can use the concepts of action-sound couplings and mappings to structure our thinking about such instruments. This will be used at the heart of a new organology that embraces the qualities of both acoustic and electroacoustic instruments.

• Jensenius, Alexander Refsum (2023). Sound Actions: Conceptualizing Musical Instruments. Full text in Research Archive Show summary

  How do new technologies change how we perform and perceive music? What happens when composers build instruments, performers write code, perceivers become producers, and instruments play themselves? These are questions addressed in the new book by Professor Alexander Refsum Jensenius: Sound Actions: Conceptualizing Musical Instruments published by the MIT Press.

• Jensenius, Alexander Refsum (2023). Explorations of human micromotion through standing still. Full text in Research Archive Show summary

  Throughout 2023, I will stand still for ten minutes around noon every day, in a different room each day. The aim is to collect data about my micromotion and compare it to the qualities of the environment. This project follows a decade-long exploration of human micromotion from both artistic and scientific perspectives. In the talk, I will present results from the annual Norwegian Championships of Standstill, where we have studied the influence of music on people's micromotion. I will also talk about how micromotion can be used in interactive music systems, allowing for conscious and unconscious control of musical sounds.

• Jensenius, Alexander Refsum (2023). Sound Actions - Conceptualizing Musical Instruments. Full text in Research Archive
• Jensenius, Alexander Refsum (2023). Exploring Human Micromotion Through Standing Still. Full text in Research Archive Show summary

  Moving slowly likely puts us into a special state of mind. Subjective reports from various practices including dance, Tai Chi and walking meditation suggest that slow movements can bring participants into a special state involving increased relaxation and awareness. Interestingly, relatively little research has been performed specifically to understand the underlying mechanisms and the possible applications of human slow movement. One reason might be that slow movements are not common in day-to-day life: when we want to move ¨C for example to pick up our cup of coffee - we usually want to do it now. Some evidence suggests that humans tend to avoid moving slowly in different tasks, for example, when improvising movements together. The goal of this meeting is to bring together scholars and practitioners interested in slow movement, and to foster interdisciplinary research on this somewhat neglected topic.

• Jensenius, Alexander Refsum (2023). Tverrfaglig forskning p? rytme, tid og bevegelse. Full text in Research Archive Show summary

  RITMO er et unikt SFF p? grunn av sin radikalt tverrfaglige oppbygning. Hvordan fungerer det i praksis?

• Riaz, Maham (2023). Sound Design in Unity: Immersive Audio for Virtual Reality Storytelling. Full text in Research Archive Show summary

  Research talk on sound design for games and immersive environments. The Unity game engine is used for environmental modeling. The Oculus Spatializer plugin provides control over binaural spatialization with native head related transfer functions (HRTF). Game scenes included C# scripts, which accounted for intermittent emitters (randomly triggered sounds of nature, critters and birds), crossfades, occlusion and raycasting. In the mixing stage, mixer groups, mixer snapshsots, snapshot triggers, SFX reverb sends, and low/high-pass filters were some of the tools demonstrated.

• Jensenius, Alexander Refsum & Tytko, James (2023). Emerging tech creates music from dance movements. [Internet]. The Naked Scientists. Full text in Research Archive Show summary

  Listen to the melodies composed with the help of motion capture body suits...

• Jensenius, Alexander Refsum (2023). Still Standing: The effects of sound and music on people standing still. Full text in Research Archive Show summary

  Throughout 2023, I have been standing still for ten minutes around noon every day, in a different room each day. This project follows a decade-long exploration of human micromotion from both artistic and scientific perspectives. In the talk, I will present results from the annual Norwegian Championships of Standstill, where we have studied the influence of music on people's micromotion. I will also talk about how micromotion can be used in interactive music systems, allowing for the conscious and unconscious control of musical sounds.

• Jensenius, Alexander Refsum (2023). Still Standing: The effects of sound and music on people standing still. Full text in Research Archive Show summary

  Throughout 2023, I have been standing still for ten minutes around noon every day, in a different room each day. This project follows a decade-long exploration of human micromotion from both artistic and scientific perspectives. In the talk, I will present results from the annual Norwegian Championships of Standstill, where we have studied the influence of music on people's micromotion. I will also talk about how micromotion can be used in interactive music systems, allowing for the conscious and unconscious control of musical sounds.

• Jensenius, Alexander Refsum & Poutaraud, Joachim (2023). Video Visualization. Full text in Research Archive Show summary

  This workshop is targeted at students and researchers working with video recordings. Even though the workshop will be based on quantitative tools, the aim is to provide solutions for qualitative research. This includes visualization techniques such as motion videos, motion history images, and motiongrams, which, in different ways, allow for looking at video recordings from different temporal and spatial perspectives. It also includes basic computer vision analysis modules, such as extracting quantity and centroid of motion, and using such features in analysis. The participants will learn to use the Musical Gestures Toolbox for Python, a collection of high-level modules for easily generating all of the above-mentioned visualizations and analyses. This toolbox was initially developed for analyzing music-related body motion but is equally helpful for other disciplines working with video recordings of humans, such as linguistics, psychology, medicine, and educational sciences.

• Olaisen, Sofie Retterst?l; Jensenius, Alexander Refsum & Vuoskoski, Jonna Katariina (2023). Una m? danse n?r ho h?yrer musikk: ¨C Eit urgamalt instinkt. [Internet]. NRK. Full text in Research Archive Show summary

  Urgamle instinkt blir sett i sving n?r hjernen din oppfattar musikk. No kan forskarane ogs? sj? danselysta i augo dine.

• Jensenius, Alexander Refsum (2023). Ny teknologi vil alltid endre musikken. Aftenposten (morgenutg. : trykt utg.). ISSN 0804-3116. Full text in Research Archive Show summary

  Musikerne forsvant ikke med grammofonen, det gj?r de ikke n? heller.

• G?ks¨¹l¨¹k, Bilge Serdar (2023). The Implications of Laban/Bartenieff Movement Studies in the Field of Dance Anthropology. Full text in Research Archive Show summary

  In my presentation, I will discuss the application of LBMS in the field of dance anthropology and provide insights into its future implications. While kinetography (Labanotation) is commonly recognized and used in dance anthropology, the embodied aspects of Laban¡¯s work are often overlooked. Therefore, I will focus on the embodied aspects of LBMS in dance anthropology, rather than just notation. To start, I will provide a general overview of how dance analysis is understood within the discipline of dance anthropology. Then, I will argue how LBMS impacts the discourse of dance analysis. In the second part of my presentation, I will bolster my argument with an example by analyzing a short segment of the Caucasian folk dance 'Zafak' performed by the Nalmes State Folk Dance Company of Adygea. Through this example, I aim to demonstrate how dance analysis using LBMS can contribute to anthropological research.

• Riaz, Maham (2023). An Investigation of Supervised Learning in Music Mood Classification for Audio and MIDI. Full text in Research Archive Show summary

  This study aims to use supervised learning ¨C specifically, support vector machines ¨C as a tool for a music mood classification task. Four audio and MIDI datasets, each containing over four hundred files, were composed for use in the training and testing processes. Mood classes were formed according to the valence-arousal plane, resulting in the following: happy, sad, relaxed, and tense. Additional runs were also conducted with the linear discriminant analysis, a dimensionality reduction technique commonly used to better the performance of the classifier. The relevant audio and MIDI features were carefully selected for extraction. MIDI datasets for the same music generated better classification results than corresponding audio datasets. Furthermore, when music is composed with each mood associated with a particular key instead of mixed keys, the classification accuracy is higher.

• G?ks¨¹l¨¹k, Bilge Serdar (2023). The Challenges and Possibilities of The Hybrid Format Creative Process. Full text in Research Archive
• G?ks¨¹l¨¹k, Bilge Serdar (2023). Phenomenological Inquiry of Movement as a Methodology in Performing Arts Education. Full text in Research Archive
• G?ks¨¹l¨¹k, Bilge Serdar (2023). Embodied Knowledge Production Through Telematics in the Hybrid Realm. Full text in Research Archive
• G?ks¨¹l¨¹k, Bilge Serdar (2023). Digital Intervention Into Dramaturgical Thoughts. Full text in Research Archive
• G?ks¨¹l¨¹k, Bilge Serdar (2023). Hybrid Format Movement Training Under the Pandemic Measures: A Clash Between Physical and Digital Realm. Full text in Research Archive
• G?ks¨¹l¨¹k, Bilge Serdar (2023). Performative Quality of Aesthetics in Bio-Cultural Paradigm. Full text in Research Archive
• Jensenius, Alexander Refsum (2023). How Findable, Accessible, Interoperable and Reusable data enables research-led education. Full text in Research Archive Show summary

  FAIR data is an essential component of the open research ecosystem. In this article, Alexander Refsum Jensenius argues that "FAIRification" can also benefit research-based and research-led education, providing opportunities to bring together different university missions.

• Jensenius, Alexander Refsum & Tidemann, Grethe (2023). Cristin forsvinner. Uklart hva som blir bedre i det nye systemet. [Internet]. Uniforum. Full text in Research Archive Show summary

  Cristin, det nasjonale systemet for forskningsdokumentasjon, skal erstattes av Nasjonalt vitenarkiv. Men hva som blir bedre i det nye systemet kan verken IT-direkt?ren eller forskningsdirekt?ren ved UiO svare p?.

• Guo, Jinyue (2023). Automatic Recognition of Cascaded Guitar Effects. Full text in Research Archive
• Riaz, Maham; Upham, Finn; Burnim, Kayla; Bishop, Laura & Jensenius, Alexander Refsum (2023). Comparing inertial motion sensors for capturing human micromotion. Full text in Research Archive Show summary

  The paper presents a study of the noise level of accelerometer data from a mobile phone compared to three commercially available IMU-based devices (AX3, Equivital, and Movesense) and a marker-based infrared motion capture system (Qualisys). The sensors are compared in static positions and for measuring human micromotion, with larger motion sequences as reference. The measurements show that all but one of the IMU-based devices capture motion with an accuracy and precision that is far below human micromotion. However, their data and representations differ, so care should be taken when comparing data between devices.

• Riaz, Maham (2023). Using SuperCollider with OSC Commands for Spatial Audio Control in a Multi-Speaker Setup. Full text in Research Archive Show summary

  With the ever-increasing prevalence of technology, its application in various music-related processes, such as music composition and performance, has become increasingly prominent. One fascinating area where technology finds utility is in music performance, offering opportunities for extensive sound exploration and manipulation. In this paper, we introduce an approach utilizing SuperCollider and Open Sound Control (OSC) commands in a multi-speaker setup, enabling spatial audio control for a truly interactive audio spatialization experience. We delve into the musicological dimensions of these distinct methods, examining their integration within a live performance setting to uncover their artistic and expressive potential. By merging technology and musicology, our research aims to unlock new avenues for immersive and captivating musical experiences.

• Jensenius, Alexander Refsum (2023). Exploring large datasets of human, music-related standstill. Full text in Research Archive Show summary

  Throughout 2023, I will stand still for ten minutes around noon every day, in a different room each day. The aim is to collect data about my micromotion and compare it to the qualities of the environment. This project follows a decade-long exploration of human micromotion from both artistic and scientific perspectives. In the talk, I will present results from the annual Norwegian Championships of Standstill, where we have studied the influence of music on people's micromotion. I will also talk about how micromotion can be used in interactive music systems, allowing for conscious and unconscious control of musical sounds.

• Jensenius, Alexander Refsum & Rosenberg, Ingvild (2023). Unik forskningskonsert. [Radio]. NRK P1. Full text in Research Archive
• Jensenius, Alexander Refsum (2023). Introducing MusicLab. Full text in Research Archive Show summary

  In 2021, one of the world¡¯s finest string quartets, The Danish String Quartet (DSQ), and a large team of international researchers based at RITMO, co-hosted MusicLab Copenhagen ¨C a groundbreaking event where DSQ performed their best repertoire while researchers experimented with, measured, and analyzed the experiences and behavior of musicians and audience. Some of the questions we tried to answer were: Do we become one grand ¡°we¡± when absorbed in music together? How do we synchronize our bodily rhythms with the music during a concert? As an innovative musical and scientific format, the concert has been widely reported and won ¡°Event of the Year¡± by the Danish National Broadcasting Corporation (DR P2). Now, the researchers have completed their analyses, and we are excited to share findings in a hybrid launch event.

• Haaland, Tonette N. & Jensenius, Alexander Refsum (2023). SSO deltar i forskning: ¨C Skal finne ut hvordan musikk p?virker oss. [Journal]. Rogalands avis. Full text in Research Archive Show summary

  Stavanger Symfoniorkester (SSO) inviterer elever p? 5.-10. trinn p? konsert, for ? gjennomf?re forskning.

• Jensenius, Alexander Refsum & Burnim, Kayla (2023). Forskere inntok Konserthuset. [Journal]. Stavanger Aftenblad. Full text in Research Archive Show summary

  Hundrevis av elever kom for ? h?re p? Stavanger symfoniorkester. Mens orkesteret spilte, var musikerne, dirigenten og publikum del av et unikt forskningsprosjekt.

• Jensenius, Alexander Refsum (2023). Rhythmic Data Science. Full text in Research Archive Show summary

  Rhythm is everywhere, from how we walk, talk, dance and play to telling stories about our past and even predicting the future. Rhythm is key to how we interact with our world. Our heartbeat, nervous system, and other bodily cycles work through rhythm. As such, rhythm is a crucial aspect of human action and perception, and it is in complex interaction with the world's cultural, biological and mechanical rhythms. At RITMO, they research rhythmic phenomena and their complex relationships with the rhythms of human bodies and brains. In the talk, Alexander will present examples of how they record, synchronize, and analyze data of complex, rhythmic human behavior, such as real-world concerts.

• Bukvic, Ivica Ico; Jensenius, Alexander Refsum; Wittman, Hollis & Masu, Raul (2023). Implementing the new template for NIME music proceedings with the community. Full text in Research Archive Show summary

  We will analyze a new possible template for NIME submissions which would simplify the integration of NIME music performances in the COMPEL, a database which facilitates navigation across different categories (pieces, persons, instruments). The template emerges from a workshop run last year at NIME about the structure of COMPEL and the process of entering all performances presented last year. From this workshop we expect to improve the template and validate it with a community.

• Karbasi, Seyed Mojtaba; Jensenius, Alexander Refsum; God?y, Rolf Inge & T?rresen, Jim (2023). Exploring Emerging Drumming Patterns in a Chaotic Dynamical System using ZRob. Full text in Research Archive Show summary

  ZRob is a robotic system designed for playing a snare drum. The robot is constructed with a passive flexible spring-based joint inspired by the human hand. This paper describes a study exploring rhythmic patterns by exploiting the chaotic dynamics of two ZRobs. In the experiment, we explored the control configurations of each arm by trying to create un- predictable patterns. Over 200 samples have been recorded and analyzed. We show how the chaotic dynamics of ZRob can be used for creating new drumming patterns.

• Jensenius, Alexander Refsum (2023). Innovasjon og ?pen forskning. Full text in Research Archive
• Masu, Raul; Morreale, Fabio & Jensenius, Alexander Refsum (2023). The O in NIME: Reflecting on the Importance of Reusing and Repurposing Old Musical Instruments. Full text in Research Archive Show summary

  In this paper, we reflect on the focus of ¡°newness¡± in NIME research and practice and argue that there is a missing O (for ¡°Old¡±) in framing our academic discourse. A systematic review of the last year¡¯s conference proceedings reveals that most papers do, indeed, present new instruments, interfaces, or pieces of technology. Comparably few papers focus on the prolongation of existing NIMEs. Our meta-analysis identifies four main categories from these papers: (1) reuse, (2) update, (3) complement, and (4) long-term engagement. We discuss how focusing more on these four types of NIME development and engagement can be seen as an approach to increase sustainability.

• Jensenius, Alexander Refsum & Z¨¹rn, Christof (2023). Standing still with Alexander Refsum Jensenius. [Internet]. The Power of Music Thinking. Full text in Research Archive Show summary

  What is the use of standing still for 10 minutes? I was asking myself when I saw a post on social media. It was a double picture of a man with a mobile phone around his neck displaying some data, and another picture showed the view he saw at that moment. I learned that he stood there for 10 minutes without any movement, listening to the sound that was already there. There were many pictures like this, and I decided to get in contact. So, today, we are in Oslo. We speak with Alexander Refsum Jensenius, a professor of music technology at the University of Oslo, a book author, a music researcher and researching musician working in the fields of embodied music cognition and new interfaces for musical expression. Alexander shares with us his experiences while performing and testing with artistic methods of embodied listening and how people experience music and sound. This goes from experiments with and without the conductor of a Symphony Orchestra to the sounds of our kitchen appliances. We talk about his motion capture lab, where a person¡¯s exact location and micro-movements can be detected while they hear different kinds of music, and how the researchers can understand what moves them. Alexander shares insights about the Norwegian Championship of Stand Still, where until now, 1000s of people have participated, and the winner is the person with the lowest average velocity on standing the stillest over some time. Alexander explains the interplay of body and mind and reveals some secrets on how to move people, for example, on the dance floor or to calm them down. It all has to do with our bpm, the average heartbeat of about 60 beats a minute.

• Jensenius, Alexander Refsum (2023). Observing spaces while standing still. Full text in Research Archive Show summary

  Throughout 2023, I stand still for ten minutes around noon every day, in a different room each day. This project follows a decade-long exploration of human micromotion from both artistic and scientific perspectives. Previously, I have been interested in the impact of music. Now, I am listening to ventilation systems, elevators, and people walking and talking and reflecting on how they influence my body and mind. The aim is to understand more about the rhythms of the environment.

• Jensenius, Alexander Refsum (2023). RITMO Senter for tverrfaglig forskning p? rytme, tid og bevegelse. Full text in Research Archive Show summary

  RITMO er et tverrfaglig senter som ?nsker ? avdekke de kognitive mekanismene som ligger til grunn for menneskelig rytme, i musikk, bevegelse og audiovisuelle medier.

• Jensenius, Alexander Refsum (2023). Hvordan en videreutvikling av vurderingssystemet endrer hvordan man jobber faglig. Full text in Research Archive
• Jensenius, Alexander Refsum (2023). Musikk og kunstig intelligens. Full text in Research Archive Show summary

  Kunstig intelligens kan allerede skrive noter og mikse musikk. I tiden fremover vil vi se mange eksempler p? hvordan maskinl?ring tas i bruk i musikkut?ving og -produksjon og til ? skape nye lytteopplevelser. Men hva er egentlig musikalsk kunstig intelligens? Hva vil det si ? trene en maskinl?ringsmodell? Vil maskinene gj?re musikere og komponister overfl?dige? Denne forelesningen vil gi deg en del svar, men ogs? flere sp?rsm?l.

• Jensenius, Alexander Refsum (2022). Exploring music performance and perception through motion capture. Full text in Research Archive Show summary

  This talk will present different approaches to capturing human bodily activity. Motion capture can be performed with sensor-based and camera-based systems, each of which has benefits and limitations. Sensor-based systems are flexible and scalable and can easily be used outside laboratory environments. They are good at tracking relative motion and rotation information but less suitable for tracking position. Camera-based systems come in many flavors and can be used with and without markers. They excel at tracking positions but are prone to reflections and environmental noise. As a consequence, camera-based motion capture systems are better suited for laboratory settings. I will discuss my twenty-year-long experience using different motion capture systems to study music-related body motion. This includes research on musicians, including rehearsal techniques and performance strategies. Such studies push the limits of the technology when it comes to precision and accuracy. It is particularly challenging when using motion capture equipment in real-world concert settings. At the University of Oslo, we have successfully captured the motion of both solo and ensemble performances and are currently trying to scale up to a full orchestra. We are also carrying out motion capture of perceivers, audience members in concerts, dancers, and other people moving to music. Through the Norwegian Championship of Standstill, we have delved into human micromotion, the tiniest actions we can perform and perceive. At this level, motion capture can detect physiological signals, such as breathing and heart rate. Data from such studies are interesting scientifically and have also been used in artistic practice. Finally, I will give examples of how real-time motion capture can be used in various creative applications, including "inverse" sonic interaction.

• G?ks¨¹l¨¹k, Bilge Serdar (2022). From Bodily Interactions to Embodied Concepts. Full text in Research Archive
• Jensenius, Alexander Refsum (2022). Responsible Research and Innovation in Sound and Music Computing. Full text in Research Archive Show summary

  My presentation will focus on how the ongoing shift to Open Research within the field of sound and music computing (SMC) promotes Responsible Research and Innovation (RRI).

• Jensenius, Alexander Refsum (2022). Data? ?pen forskningspraksis for ikke-datadrevne fagfelt. Full text in Research Archive Show summary

  Hva er ?pen forskning og hva skal til for ? etablere en kultur for ?pen forskning i humanistiske fag og samfunnsfag? Hvordan vi skal komme til en ny normal der det vi i dag omtaler som ??pen forskning? kun kalles forskning?

• Lesteberg, Mari & Jensenius, Alexander Refsum (2022). MICRO and MACRO - Developing New Accessible Musicking Technologies. Full text in Research Archive Show summary

  This paper describes the development of two musical instrument prototypes developed to explore how non-haptic music technologies can be accessed from a web browser and how they can offer accessibility for people with low fine motor skills. Two approaches to browser-based motion capture were developed and tested during an iterative design process. This was followed by observational studies of two user groups: one with low fine motor skills and one with normal motor skills. Contrary to our expectations, we found that avoiding the use of buttons and mice did not make the apps more accessible for the participants with low fine motor skills. Furthermore, motion speed was considered more important for people with low motor skills than the size of the control action. The most important finding is that browser-based musical instruments using sensor-based and video-based motion tracking are not only feasible but allow for reaching much larger groups of people than previously possible. This may ultimately lead to both more personalized and accessible musical experiences.

• Jensenius, Alexander Refsum & Platou, Jeanette (2022). Kan kunstig intelligens v?re kreativ? [Radio]. NRK P2 Arena. Full text in Research Archive Show summary

  Hva er AI, eller kunstig intelligens, som vi kaller det p? norsk. I Arena i dag ser vi p? hvor kunstig intelligensk blir brukt, og hva det funker i. Kan vi f? en data til ? skrive poesi, og hva med musikken og kunsten?

• Jensenius, Alexander Refsum (2022). Erfaringer med ? lage 3xMOOC. Full text in Research Archive Show summary

  I denne presentasjonen vil jeg presentere hvordan vi gjennom ?rene har utviklet tre komplette nettkurs ved Universitetet i Oslo: Music Moves (2016), Motion Capture (2022) og Pupillometry (2023). Fokuset vil ligge p? muligheter og utfordringer i video i utdanningssammenheng.

• Remache-Vinueza, Byron & Jensenius, Alexander Refsum (2022). Groundbreaking New Technology Allows People To Listen to Music Through Touch. [Internet]. SciTechDaily. Full text in Research Archive Show summary

  An audio-tactile algorithm created by University of Malaga scientists conveys melodic information through vibration.

• Jensenius, Alexander Refsum (2022). Kunstfag og ?pen forskning. Full text in Research Archive Show summary

  Hvilke dilemmaer oppst?r n?r forskningsdata og resultater skal deles og gjenbrukes? Og hvilke muligheter medf?rer mer ?penhet og ?kt deling av data for fag som eksempelvis musikk, visuell kunst, film, scenekunst og design?

• Jensenius, Alexander Refsum (2022). RITMO and Interdisciplinarity. Full text in Research Archive Show summary

  In this presentation I will discuss how we have been developing an interdisciplinary research centre, in which researchers from the arts and humanities and the social and natural sciences.

• Remache-Vinueza, Byron; Trujillo-Le¨®n, Andr¨¦s; Clim, Maria-Alena; Sarmiento-Ortiz, Fabi¨¢n; Topon-Visarrea, Liliana & Jensenius, Alexander Refsum [Show all 7 contributors for this article] (2022). Mapping Monophonic MIDI Tracks to Vibrotactile Stimuli Using Tactile Illusions. Full text in Research Archive Show summary

  In this project, we propose an algorithm to convert musical features and structures extracted from monophonic MIDI files to tactile illusions. Mapping music to vibrotactile stimuli is a challenging process since the perceptible frequency range of the skin is lower than that of the auditory system, which may cause the loss of some musical features. Moreover, current proposed models do not warrant the correspondence between the emotional response to music and the vibrotactile version of it. We propose to use tactile illusions as an additional resource to convey more meaningful vibrotactile stimuli. Tactile illusions enable us to add dynamics to vibrotactile stimuli in the form of movement, changes of direction, and localization. The suggested algorithm converts monophonic MIDI files into arrangements of two tactile illusions: ¡°phantom motion¡± and ¡°funneling¡±. The validation of the rendered material consisted of presenting the audio rendered from MIDI files to participants and then adding the vibrotactile component to it. The arrangement of tactile illusions was also evaluated alone. Results suggest that the arrangement of tactile illusions evokes more positive emotions than negative ones. This arrangement was also perceived as more agreeable and stimulating than the original audio. Although musical features such as rhythm, tempo, and melody were mostly recognized in the arrangement of tactile illusions, it provoked a different emotional response from that of the original audio.

• Jensenius, Alexander Refsum (2022). Open music research between art and science. Full text in Research Archive Show summary

  Many music researchers are turning towards studying music performance and perception in real-world settings. Collecting data in a concert situation is non-trivial, and FAIRifying the data is even more challenging. In this talk, I will discuss some challenges with handling privacy and copyright matters in music research. I will also discuss some benefits of working towards more open music research.

• Jensenius, Alexander Refsum (2022). Publish or Perish? Researcher assessment is about to change. Full text in Research Archive Show summary

  In July 2022, the European Commission launched an Agreement On Reforming Research Assessment. After years of talking, there is significant momentum for changing how researchers are assessed. In this talk, I will present some work leading up to the new agreement and how Universities Norway took a lead when developing the Norwegian Career Assessment Matrix (NOR-CAM). The core idea is that academics need to get recognition for a broader range of activities. This is important for transitioning to more open research practices and diverse career paths within and outside academia.

• Outa, Amani al; Kn?velsrud, Helene; Laczko, Balint & Jensenius, Alexander Refsum (2022). Winner of RRI-inspired transdisciplinary side quest call. [Internet]. Centre for Digital Life Norway. Full text in Research Archive Show summary

  Centre for Digital Life Norway (DLN) is excited to congratulate the team behind the project ¡°The autophagic symphony ¨C Unveiling the final rhythm¡± as winner of DLN¡¯s RRI-inspired transdisciplinary side quest call.

• Jensenius, Alexander Refsum (2022). Alternatives to journal-based metrics in research assessment. Full text in Research Archive Show summary

  Science Europe invites institutional leaders, researchers at all stages of their careers, and experts from the field to join its 18 and 19 October 2022 conference on Open Science to discuss two key questions: (1) Is Open Science ready to become the norm in research? (2) How do we ensure this becomes an equitable transition? To find answers to these questions, the conference will provide a comprehensive overview of practical and policy initiatives, research assessment reforms, and financial measures that support the transition to Open Science. We will also look forward to new and emerging trends.

• Jensenius, Alexander Refsum (2022). Experiencing the world through sound actions. Full text in Research Archive Show summary

  This talk will reflect on my year-long project recording a daily "sound action". These are multimodal entities consisting of body motion and its resultant sound. When we only see a sound action, we can imagine its sound. If we only hear a sound action, we can imagine the body motion and objects involved in the interaction. Sound actions are ubiquitous in everyday life yet rarely discussed and reflected upon. My attempts at analyzing sound actions show some of the complexity involved in making sense of actions, reactions, and interactions with the world. This complexity can also inspire creative usage. I will present examples of meaningless and cognitively conflicting sound actions in the talk.

• Jensenius, Alexander Refsum (2022). From ideas to reality: interdisciplinary collaborations. Full text in Research Archive
• Jensenius, Alexander Refsum (2021). Open Research as Communication Strategy. Full text in Research Archive
• Laczko, Balint & Jensenius, Alexander Refsum (2021). Reflections on the Development of the Musical Gestures Toolbox for Python. Full text in Research Archive Show summary

  The paper presents the Musical Gestures Toolbox (MGT) for Python, a collection of modules targeted at researchers working with video recordings. The toolbox includes video visualization techniques such as creating motion videos, motion history images, and motiongrams. These visualizations allow for studying video recordings from different temporal and spatial perspectives. The toolbox also includes basic computer vision methods, and it is designed to integrate well with audio analysis toolboxes. The MGT was initially developed to analyze music-related body motion (of musicians, dancers, and perceivers) but is equally helpful for other disciplines working with video recordings of humans, such as linguistics, pedagogy, psychology, and medicine.

View all works in NVA