CrowdForge
Effects of audio and visual audience participation modalities on agency, collaboration, and engagement in AI-mediated mixed reality performances.
Publication and Scientific Works
Research
Scientific, technical, and creative research spanning AI, extended reality, neuroscience, and music. Filter by theme, and open any project for the full story: motivation, methods, findings, media, and papers.
Embodied Symbol Systems
How visual features shape the symbol-perception-action loop in musical notation.
AI-Assisted Songwriting for Stroke Rehabilitation
Co-designing technologies with multiple stakeholders for stroke rehabilitation.
Automatic Arrangement
A unified framework and neural network architecture that enables automatic multitrack music arrangement.
How Do We Learn to Read Music?
Using psychological methods and eye-tracking to investigate the effectiveness of several popular approaches to music literacy.
Networking AI-Driven Virtual Musicians in XR
Designing AI-driven music interaction for networked VR/AR/MR environments.
Stringesthesia
Dynamically shifting musical agency between audience and performer based on the performer’s neurally measured trust in an improvised performance.
Virtual AI Jam
AI-driven, animated virtual musicians for human-in-the-loop musical improvisation.
Towards Jamming with Jimmy Page
Investigating neural network architectures for musical interaction, with Ericsson Research.
Computer-Supported Musical Improvisation
Doctoral research framework presented at the NIME Doctoral Consortium.
Limited Field of View in AR
Exploring how the limitations of AR displays affect musical collaboration with holographic musicians.
AR Drum Circle
Networked musical interaction and real-time collaboration between remote drummers in augmented reality.
How Late Is Too Late?
Investigating the interaction between visual and audio perceptual delays in networked music.
Rhythmic Conversations
Jamming with audience-controlled, improvising AI-driven drummers.
The Jam Station
Algorithmically detecting collaboration in a collaborative musical instrument.
Jam Tabs
Investigating alternative, color-based music notation and tools for novice improvisation.
Custom Plugins for Music Notation Software
Plugins that manipulate notation software to aid reading and pedagogical techniques in music.
How Many Musical Scales Are There?
Music combinatorics: isolating the number of unique scale rotations, building on Miller’s and others’ work.
Hacking DAWs: Custom Functions in Ableton
Custom Ableton functions connected to Python and other programs, used in teaching and performance.
Tangible Musical Objects
Investigating the interactions of expert and novice musicians with tangible musical objects.
User Interfaces in Smart Cities
Book chapter on the future of user interfaces in smart cities.
Building Applications for the gTar
Designed and built applications for the gTar smart guitar.
SolJAMM Workshops
Designed and led technology-enhanced jamming workshops for over 50 high school students.
Linguist vs. Machine
Comparing machine learning algorithms with trained linguists at uncovering morphological grammar rules.
FOXP3: A Critical Role in Fertility in Mice
Investigating the role of the transcription factor Foxp3 in mice.
Foxd1 Is Necessary for Pituitary LH Expression
Investigating the role of the transcription factor Foxd1 in mice.
Hippocampal Connectivity: Laterality and Motor Learning
fMRI study investigating mechanisms of motor control and learning (data analyst).
Music Rehearsal Increases the Perceptual Span for Notation
Investigating the role of rehearsal in perceptual and visual span (data analyst).
Hippocampal Connectivity II: Spatial and Temporal Selectivity
Investigating the role of the hippocampus in sensorimotor control (data analyst).