Interactive Learning

Scan Sequencer Javascript

Scan Sequencer Javascript is an innovative tool that transforms real-time webcam images into music by detecting changes in the color of pixels and generating trigger signals. The tool works like a virtual keyboard, with the vertical keys responding to pixel color changes, creating a unique auditory experience.

Learning Activities in the Studio
  • Music and Art Integration
    Encourage your students to experiment with different visuals, patterns, and color combinations to create their own compositions. This can be a unique way to explore the relationship between visual arts and music, as well as an opportunity to discuss the concept of synesthesia.
  • Coding and Algorithm Exploration
    Encourage your students to explore the underlying code and algorithms that power this tool. This can serve as an introduction to coding principles, algorithm design, and creative applications of technology.
  • Science and Math Connections
    Use the tool to explore the connection between frequency, pitch, and color. Students can create graphs or charts to represent the relationship between these elements and discuss the underlying scientific and mathematical concepts.
  • Collaborative Performances
    Have your students work in groups to design and perform a multimedia presentation that combines live webcam images, music, and visual art. This can foster teamwork, communication, and creative problem-solving skills.

Keyboard is an interactive musical keyboard experiment that allows users to play music using their face, body, mouse, or keyboard. With a webcam, the experiment tracks a specific point on the user’s body, such as their nose, to control the musical notes. The experiment does not store or send images to any servers.

Learning Activities in the Studio
  • Accessible Music Creation
    Introduce your students to an accessible way of creating music, regardless of their physical abilities or prior musical experience. This experiment can help break down barriers and encourage students to explore their musical potential.
  • Motion Tracking and Technology
    Discuss the principles of motion tracking and computer vision technology that power this experiment. Encourage students to think about other applications of this technology in different fields, such as gaming, virtual reality, or sports analysis.
  • Music Theory and Composition
    Use this experiment to teach basic music theory concepts, such as scales, intervals, and chords. Students can experiment with various scales and create their own melodies, fostering an understanding of musical structures.
  • Interdisciplinary Projects
    Combine this experiment with other artistic mediums or STEAM subjects for collaborative projects. For example, students could create a performance that combines music generated by this experiment with dance or visual arts, or explore the physics of sound waves and resonance through the experiment.

Body Synth is an interactive musical experiment that allows users to create music simply by moving their bodies. The experiment uses a webcam to detect body movements and translates them into different notes or sounds. The images are not stored or sent to any servers. Users can adjust the sensitivity for big or small movements, change chords, and switch instruments using voice commands, like “C chord” or “guitar.”

Learning Activities in the Studio
  • Movement and Music
    Encourage your students to explore the relationship between movement and music by creating their own compositions using their body movements. This can help students develop a deeper understanding of rhythm, tempo, and coordination.
  • Music and Dance Collaboration
    Organize a collaborative project where students work in pairs or groups to choreograph a dance routine that produces a unique musical composition using this experiment. This activity fosters teamwork, creativity, and communication skills.
  • Exploring Sound and Motion
    Discuss the principles of sound and motion, and how they are interconnected in this experiment. Encourage students to think about other ways in which motion can be used to generate sound or music, and vice versa.
  • Inclusive Music-Making
    Use it as a tool to promote inclusivity in music-making, as it allows students of all physical abilities to participate and create music. This can help build an understanding of accessibility and the importance of inclusive design in technology.

Body Synth is an interactive musical experiment that allows users to create music simply by moving their bodies. The experiment uses a webcam to detect body movements and translates them into different notes or sounds. The images are not stored or sent to any servers. Users can adjust the sensitivity for big or small movements, change chords, and switch instruments using voice commands, like “C chord” or “guitar.”

Learning Activities in the Studio
  • Movement and Music
    Encourage your students to explore the relationship between movement and music by creating their own compositions using their body movements. This can help students develop a deeper understanding of rhythm, tempo, and coordination.
  • Music and Dance Collaboration
    Organize a collaborative project where students work in pairs or groups to choreograph a dance routine that produces a unique musical composition using this experiment. This activity fosters teamwork, creativity, and communication skills.
  • Exploring Sound and Motion
    Discuss the principles of sound and motion, and how they are interconnected in this experiment. Encourage students to think about other ways in which motion can be used to generate sound or music, and vice versa.
  • Inclusive Music-Making
    Use it as a tool to promote inclusivity in music-making, as it allows students of all physical abilities to participate and create music. This can help build an understanding of accessibility and the importance of inclusive design in technology.