Audio Technology & Interactive Sound
An ongoing exploration of sound—how it can be shaped, triggered, and translated through design and technology. This page features projects that blend code, interaction, and audio experimentation, using custom-built interfaces and real-time systems. From emotionally driven responses to data-informed visuals, each piece investigates new ways to experience sound both visually and physically, expanding the language of creative technology.
DRUM MACHINE
An experimental interactive interface that transforms rhythmic beats into dynamic visuals, merging sound and motion into an engaging audiovisual experience. Designed for tactile and auditory exploration, the interface reimagines rhythm-making as a visually immersive process.
Technical
- Utilized p5.js and Tone.js to build an interactive step sequencer with synchronized real-time audio visualization.
- Designed dynamic animations driven by waveform analysis for an engaging user experience.
- Developed a customizable interface with user-defined audio samples (kick, snare, hi-hats) and intuitive controls for play, reset, and grid-based interaction.
- Envisioned Drum Machine as a bridge between tactile sound creation and visual expression.
- Designed an intuitive grid-based sequencer with responsive animations tied to user input.
BUNCHED MACHINE
This virtual synth and visual interface explores the intersection of sound, visuals, and human interaction. The project introduces playfulness into performances, enabling real-time, synchronized sound-visual interactions that captivate audiences. The vision was to elevate musical performances by empowering performers to engage audiences through live, expressive audiovisual manipulation.
Technical
- Used handtrack.js to implement real-time hand tracking, optimizing detection accuracy and experimenting with oscillator functionalities to synchronize audio and visuals.
- Created dynamic, generative visuals responsive to hand and head gestures, enhancing the sensory experience.
BIRD MACHINE
Using abstract visuals and ambient bird sounds, this project creates a meditative space celebrating natural rhythms. Inspired by Jim Wilson’s 1992 experiment slowing down cricket sounds to reveal hidden melodies, it reimagines bird recordings from Cornell’s Lab of Ornithology through both natural and experimental sound processing to uncover new auditory dimensions.
- Click Play to start.
- Use the sliders to adjust speed and panning.
- Press keys the A,S,D,F + G to play different bird tones.
Technical
- Integrated a physical drum pad machine to trigger synchronized audio and visuals, enhancing interactivity and immersion.
- Used Max/MSP for real-time audio processing and seamless system integration.
- Processed and mixed slowed bird recordings with ambient soundscapes in Ableton Live to craft a rich auditory environment.
- Developed generative visuals dynamically linked to sound inputs, creating a cohesive and responsive experience.