For my final project, I wanted to explore music interaction through the use of user controlled and visual elements. My submission is an interactive canvas on which the participant can use certain keys to move my drawn instruments and “shoot” or play the music notes. I used particles to create parts of perpetual movement that also make sounds when they collide with other elements or boundaries of the screen. In addition, if the user chooses to drag the mouse instead of click, boxes are created rather than particles, allowing for more control by the user and further exploring the elements of animation and movement through p5.js. Along with my theme of music, the project allows for players to initiate scrolling music notes, which they can follow on screen with the controlled ‘note’ objects to simulate a song. Depending on their location on the screen, the music notes play varying pitches.
I had trouble executing all of what I intended in this project, however, am overall satisfied with what I was able to create from the techniques we learned in class and assignments. If I were to continue with this project, I would focus on creating more precise and varying interactions depending on the different objects that collide, and make a larger range of differing sounds. I would also like to explore changing the movement of the elements to be more intricate/interesting instead of the current format(similar to the space invaders example). Lastly, I would want to try and implement more of an interaction with the scrolling music notes and make the canvas pitches more accurate so to allow for a better/more enjoyable experience and display of music through my project.
For my final project, I would like to create something that allows for visualization of complex information, whether it be research data or something else, such as sound.
I was initially inspired by projects such as those by Nicholas Feltron and Aaron Koblin, who use easily understandable visuals to represent large amounts of data such as weather patterns, or flight paths around the world.
For my first idea, I wanted to do something similar to these projects in representing data on a global scale. I was thinking of representing something such as water resources and quality across countries. I would plan to show an initial map (similar to shown below) and then present further information as the viewer scrolls or clicks through different areas.
However, I was also really interested in one of Koblin’s specific projects which compiles users’ “random” sounds to create a song. I am fascinated with the visualization of sounds/music, similar to patatap, and would like to incorporate that aspect into my project as well.
In thinking of this as a project direction, I wanted to make use of what we learned with particles, and create something similar to patatap in that each feature represents a different sound, however the music would be created in their interaction with each other. Therefore, the elements would remain on the screen (in some cases) and make different sounds as they bounce into or spring away from each other, as well as enter and leave the canvas bounds. Hopefully, the viewer would control which elements are added and each would create new sounds, thus building the music over time (as well as interaction between visual elements).
This seems as it would be its own project in the visualization of sound through image/animation. Thus, I will have to choose between this idea or representation of more statistical data, such as the water resources for my final project.
For my final project, I was inspired by several of the artists that created forms of information visualization. A few that I looked at in particular were Aaron Koblin, Nicholas Feltron, Chris Harrison, and Amanda Cox. I am fascinated in their use of images and sometimes interactive elements to represent complex information or statistical data on a large scale. I especially like some of Koblin’s projects such as the ‘Bicycle Built For 2,000’ which compiles over 2,000 human voices recorded through the internet to create a song, and the ‘eCloud Project’ which is an installation made from tiles that fade between transparent and opaque states to reflect the weather from around the world. I also like Feltron’s projects, which use graphics to portray reports of yearly information.
I am inspired by their use of engaging visual elements and interactive features that allow for easy understanding of statistical information. I hope to incorporate similar elements into my own work for my final project.
For my creature project, I made particles to represent bees flying around a hive. There is a force of attraction to the edge of the beehive within a certain proximity, and when the mouse is clicked the attraction is released, allowing the bees to scatter/ fly freely.
The artist I chose to look at this week was Beatrice Lartigue. Beatrice creates interactive art installations and investigates ‘invisible relationships within images, space and time.’ The particular project I found interesting is called “Moc,” which explores interactions between sound and image. It is an interactive piece that allows viewers to whistle into a microphone and watch a tree grow on the accompanying projector, uniquely based on the sound spectrum they produce. I enjoyed this project in that participants can visualize their own actions evolve through image, and am fascinated in Beatrice’s aim to represent immaterial data, such as sound, through her projects in a way that is fun and engaging for a community. I admire her humanistic approach, aimed at designing for all people as to empower an audience and encourage interaction with technology and physical architecture in our daily environments.
For my project, I created different turtles to follow curves of various widths, to make seemingly random line patterns. Each turtle’s line weight and orientation is affected by the mouse’s position on the canvas.
My project is made up of different sized squares that appear both automatically and follow the mouse’s location on the canvas. It also has lines that appear to reveal the portrait. I tried to make my project so that the shapes seem random at first, but when left on the screen for long enough, make the pattern of the image visible. When the mouse is pressed, the portrait changes color.
I found the subject of Lily’s Looking Outwards #4 to be especially interesting. She discovered a series of visual sound experiments created by Mark Wheeler in collaboration with Russ Chimes and Clay Wieshaar. In the experiments, the artists use live MIDI values to generate animations corresponding with musical notes and projecting into the real world. Like Lily, I am intrigued by this project in the way that it makes use of elements of vision and sound in real world settings. Wheeler says, “At first we planned on shooting at more wild, natural locations. However, after doing a test shoot in suburbia we realized there was something quite magical about the projections transforming these more mundane settings.” I agree with Lily in that the music feels almost tangible in these physical spaces, and that it’s beautiful to see the interaction of sound and image within the “collision of digital and physical worlds.” I find it fascinating that the patterns are always captivating and unexpected, while being generated from computed algorithms.
Lily Looking Outwards: http://cmuems.com/2015c/lfulop/09/23/lfulop_looking-outwards_04/
The speaker I studied this week was artist and programmer Zach Lieberman. Zach studied Fine Arts at Hunter College and Design & Technology at Parsons School of Design. He describes himself as “an artist, researcher, hacker, dedicated to exploring new modes of expression and play.”
Zach started out as a painter and printmaker, but since he has started using the computer, he makes use of code to create drawing tools for himself and to build his own means for creative exploration. I find his work fascinating because it is largely performance or installation based and encourages interaction with the public. In the video, Zach says he like to inspire “surprise and wonder”, and reach people through his work.
I’m interested in his collaboration with advertisement and design and using creative practice to solve problems. I especially liked his projects dealing with interest in movement and the human body, such as a tool he helped build to allow a paralyzed graffiti artist continue making art. I also liked similar projects such as the ones that tracked movement to turn runs into paintings and used a car’s path to create a font.
I admire Zach’s work because he explores how art can be used in functional and everyday activities and how to come up with creative solutions to ordinary problems. As a designer, I can learn from Zach’s process of creative exploration and research through artistic approaches.
For this project, I wanted to make a landscape with cars passing by. I used the noise function to create mountains and clouds in the background and added cars passing through at different speeds. There are small cars of changing colors farther away and larger yellow ones in the foreground that come through at a more infrequent rate.