Audio Technology & Interactive Sound

An ongoing exploration of sound—how it can be shaped and transformed through design and technology. This page features projects that blend code, interaction, and audio experimentation, using custom interfaces and real-time systems. From emotionally driven responses to data-informed visuals, each piece explores new ways of experiencing sound — visually, physically, and emotionally — expanding the language of creative technology.















DRUM MACHINE



A sequencer that transforms beats into sound-reactive visuals.

An interactive drum machine that turns beats into dynamic visuals — merging rhythm, sound, and motion into a visually immersive performance tool. Designed for tactile and auditory exploration, it reimagines rhythm-making as both playful and expressive.

   Code



Technical    

  • Built with p5.js and Tone.js for interactive step sequencing and real-time audio visualization
  • Designed  waveform-driven animations for responsive, engaging visuals
  • Created a customizable interface with user-defined samples and intuitive controls (play, reset, grid)
  • Bridged tactile rhythm-making with generative visual expression
  • Added a slider control for tempo, enabling real-time speed adjustments



















BUNCHED MACHINE




A hand-tracking synthesizer turning gestures into real-time sound and visuals.


    This experimental instrument turns simple hand movements into live audiovisual expressions.     It brings playfulness and immediacy to performance, letting performers captivate audiences     through synchronized sound–visual manipulation.

Technical

  • MediaPipe Hands for real-time gesture tracking
  • Web Audio API for synthesis (vertical = pitch, horizontal = effects)
  • Canvas-based visuals responding to finger tips and motion






BIRD MACHINE



A meditative soundscape instrument blending bird recordings with generative visuals.


This project creates a meditative audiovisual space using abstract visuals and ambient bird sounds. Inspired by Jim Wilson’s 1992 slowed-cricket experiment, it reimagines recordings from Cornell’s Lab of Ornithology through both natural and experimental sound processing. By uncovering hidden rhythms and tones, the work transforms bird calls into a contemplative performance instrument.

Code

Interaction

- Click Play to start
- Use the sliders to adjust speed and panning.
- Press A, S, D, F, G to play different bird tones

Technical    

  • Integrated a drum pad controller to trigger synchronized audio and visuals
  • Used Max/MSP for real-time sound processing and seamless integration
  • Processed slowed bird recordings with ambient soundscapes in Ableton Live
  • Developed generative visuals dynamically linked to sound inputs for a responsive, immersive experience