CrowdForge
Effects of audio and visual audience participation modalities on agency, collaboration, and engagement in AI-mediated mixed reality performances.
Publication and Scientific Works
Scientific, technical, and creative research spanning AI, extended reality, neuroscience, and music. Filter by theme, and open any project for the full story: motivation, methods, findings, media, and papers. Games and tools for teaching are under Music Education and Creative Tools.
Effects of audio and visual audience participation modalities on agency, collaboration, and engagement in AI-mediated mixed reality performances.
How visual features shape the symbol-perception-action loop in musical notation.
Co-designing technologies with multiple stakeholders for stroke rehabilitation.
Free browser apps for practicing, learning, and teaching music with a seven-color system: Fret Sudoku, an ear trainer, a fretboard, Chord Builder, and more.
An open, modular DAW for Linux where people, controllers, and AI agents share every control of the signal chain.
A live looper that runs in the browser, built for footswitch performance with any instrument or voice.
A unified framework and neural network architecture that enables automatic multitrack music arrangement.
A more-than-human design pictorial: knitting as a material inquiry into the “unknown” trees of a municipal tree dataset.
Using psychological methods and eye-tracking to investigate the effectiveness of several popular approaches to music literacy.
Designing AI-driven music interaction for networked VR/AR/MR environments.
Dynamically shifting musical agency between audience and performer based on the performer’s neurally measured trust in an improvised performance.
AI-driven, animated virtual musicians for human-in-the-loop musical improvisation.
Investigating neural network architectures for musical interaction, with Ericsson Research.
Doctoral research framework presented at the NIME Doctoral Consortium.
Exploring how the limitations of AR displays affect musical collaboration with holographic musicians.
Networked musical interaction and real-time collaboration between remote drummers in augmented reality.
Investigating the interaction between visual and audio perceptual delays in networked music.
Personifying loopers and generative music tools as humanoid avatars in augmented reality, for creativity and collaboration.
Jamming with audience-controlled, improvising AI-driven drummers.
Spatially sharing selves and surroundings in remote communication, using mobile devices and augmented reality.
Algorithmically detecting collaboration in a collaborative musical instrument.
Investigating alternative, color-based music notation and tools for novice improvisation.
Plugins that manipulate notation software to aid reading and pedagogical techniques in music.
Music combinatorics: isolating the number of unique scale rotations, building on Miller’s and others’ work.
Custom Ableton functions connected to Python and other programs, used in teaching and performance.
Investigating the interactions of expert and novice musicians with tangible musical objects.
Book chapter on the future of user interfaces in smart cities.
Designed and built applications for the gTar smart guitar.
Designed and led technology-enhanced jamming workshops for over 50 high school students.
Comparing machine learning algorithms with trained linguists at uncovering morphological grammar rules.
Original music for an animated short in the Annals of Internal Medicine’s Graphic Medicine series.
Investigating the role of the transcription factor Foxp3 in mice.
Investigating the role of the transcription factor Foxd1 in mice.
fMRI study investigating mechanisms of motor control and learning (data analyst).
Investigating the role of rehearsal in perceptual and visual span (data analyst).
Investigating the role of the hippocampus in sensorimotor control (data analyst).
Games and tools I use in teaching and workshops. For AI tools, see AI Music Resources; for the story behind the apps, see SolJAMM Apps.
Free, in the browser, nothing to install.
Open-source tools to download and run.