scieee AI-readable full text Open interactive document viewer

AirPens: Musical Doodling

Frame, Ciaran; O'Hara, Steph; Trolland, Sam; Ilsar, Alon

Abstract

AirPens is an installation/activation that invites participants to make music while mark-making. NIME attendees are invited to reflect on this year's conference by doodling, scribbling or sketching onto a whiteboard with one of four AirPens — a gestural DMI that utilises IMU sensors to convert movement into sound. Part of the larger AirSticks project which includes PCB design, 3D printing and fabrication developed at Monash University's SensiLab, the AirPen takes the physical affordance and potential of a whiteboard marker, and extends the marker's utility from simply converting movement with '2D mark-making,' to '3D music-making.' AirPens is designed as an ice-breaker experience, inviting attendees to share their thoughts on the state of NIME while improvising gestural music in small groups. While writing, participants may change the way they write to accommodate a different sonic output, or focus more on the 'sonification' of their natural writing style. But participants are not restricted to just writing with the AirPen — participants can explore the full scope of the AirPen as a gestural DMI away from the whiteboard, going off into free musical improvisations that may inspire discussions about the technology and project more generally. Each of the four AirPens available will have their own unique mapping that is in harmony with the other AirPens, inviting participants to freely go between writing ideas and improvising gestural music together.

Full text

AirPens: Musical Doodling CIARAN FRAME, SensiLab, Monash University, Australia STEPH O’HARA, SensiLab, Monash University, Australia SAM TROLLAND, SensiLab, Monash University, Australia ALON ILSAR, SensiLab, Monash University, Australia 1 Project Description AirPens is an installation/activation that invites participants to make music while mark-making. NIME attendees are invited to reflect on this year’s conference by doodling, scribbling or sketching onto a whiteboard with one of four AirPens — a gestural DMI that utilises IMU sensors to convert movement into sound. Part of the larger AirSticks project [ 1 ] which includes PCB design, 3D printing and fabrication developed at Monash University’s SensiLab, the AirPen takes the physical affordance and potential of a whiteboard marker, and extends the marker’s utility from simply converting movement with ‘2D mark-making,’ to ‘3D music-making.’ AirPens is designed as an ice-breaker experience, inviting attendees to share their thoughts on the state of NIME while improvising gestural music in small groups. While writing, participants may change the way they write to accommodate a different sonic output, or focus more on the ‘sonification’ of their natural writing style. But participants are not restricted to just writing with the AirPen — participants can explore the full scope of the AirPen as a gestural DMI away from the whiteboard, going off into free musical improvisations that may inspire discussions about the technology and project more generally. Each of the four AirPens available will have their own unique mapping that is in harmony with the other AirPens, inviting participants to freely go between writing ideas and improvising gestural music together. Fig. 1. The AirPen being held Authors’ Contact Information: Ciaran Frame, SensiLab, Monash University, Melbourne, Australia; Steph O’Hara, SensiLab, Monash University, Melbourne, Australia; Sam Trolland, SensiLab, Monash University, Melbourne, Australia; Alon Ilsar, SensiLab, Monash University, Melbourne, Australia. This work is licensed under a Creative Commons Attribution 4.0 International License. NIME ’25, June 24–27, 2025, Canberra, Australia ©2025 Copyright held by the owner/author(s). NIME ’25, June 24–27, 2025, Canberra, Australia Frame et al. 2 Technical Notes We will provide all equipment including laptop, devices, speakers, table and whiteboard. We ask for access to power and to ideally be set up at the registrations table, allowing us to interact with all conference participants. Fig. 2. The AirPen 3 Program Notes AirPens is an installation/activation that invites participants to make music while mark-making. NIME attendees are invited to reflect on this year’s conference by doodling, scribbling or sketching onto a whiteboard with one of four AirPens — a gestural DMI that utilises IMU sensors to convert movement into sound. The AirPen takes the physical affordance and potential of a whiteboard marker, and extends the marker’s utility from simply converting movement into ‘2D mark-making,’ to ‘3D music-making.’ AirPens is designed as an ice-breaker experience, inviting attendees to share their thoughts on the state of NIME while improvising gestural music in small groups. Each of the four AirPens available will have its own unique mapping that is in harmony with the other AirPens, inviting participants to freely go between writing ideas and improvising gestural music together. AirPens: Musical Doodling NIME ’25, June 24–27, 2025, Canberra, Australia 4 Ethical Standards This project is being conducted with the necessary ethical consent and permissions through Monash University. Acknowledgments The authors would like to thank all current early adopters, particularly Melinda Smith, Sabrina Chan D’Angelo and Erick Mitsak, and the whole AirSticks team, particularly Edward Turner. References [1] Sam Trolland, Alon Ilsar, Ciaran Frame, Jon McCormack, and Elliott Wilson. 2022. AirSticks 2.0: Instrument design for expressive gestural interaction. In NIME 2022. PubPub.