Final Project: Audiovisual mixer

For this project, I wanted to create a program that takes sounds and relates images to them via a mixer or board style. The keys used are a,s,d,f,j,k,l. Each key corresponds to a component of a short song I made using LogicPro. Basically, when each key is pressed, the sound will go on, and when it is released, the sound will stop, so it is more of a killswitch board. I am using primitive shapes right now and would like to eventually develop them into gifs or images to make it more complex. The current result, I feel, is not optimal since the synchronization is quite awful at the moment(not a p5.js problem – I trimmed one of the audio clips too short by mistake), so please excuse the urge to vomit. Here is a quick demo:

sketch to be uploaded in a minute

Looking Outwards 11: Final Project

For my final project I decided to do something similar to Patatap. It is interesting to debate whether or not this can be classified as an instrument, as it makes music and has a player. The duo that made this piece are audiovisual artists and also in one of my favorite bands called Lullatones. I think they were spot on with the graphics correlating to each sound, allowing for another kind of way to experience music. This is a clip of me demoing Patatap:

Another interesting piece I found is called Keylight. It uses 3d space as a visualization for sound. Different tones are played based on where they are placed, and they ping back and forth from eachother. Both these pieces are interesting audiovisual pieces. Patatap is great because the forms correlate so well with each sound.

Screen Shot 2015-12-18 at 11.52.39 AM

Project 10: Creature

For a while I had this image of a fat, fleshy creature sitting in a box, going about his business, possibly living in another dimension or world.  (The sandwich he is eating is invisible because it exists in a virtual non-space). In this project, I wanted to give the sense of invading someone else’s living space.  I wanted to create a little bit of humor that refers to this kind of aesthetic in my drawing through the movements of this creature that make it seem alive. Using the spring template, I  added a trait where the spring ball will hide every time the cursor moves towards him. He might try and peek out if you wait for a few seconds.  You can try to pick him up but he will eventually break from terror.
Screen Shot 2015-12-18 at 8.42.34 AM

Screen Shot 2015-12-18 at 11.12.52 AM Screen Shot 2015-12-18 at 11.13.19 AM



Looking Outwards 10: Andrea Polli

e-Oculus is interesting because it is put in a commercial setting. Large sky-filled projections in the shape of Utah’s lakes are suspended above the walls. It is advertised as a main feature inside Utah Eccles School of Business. It is supposed to directly correlate to the stock market, where stormy/red weather is BAD and blue skies are GOOD. The introduction of this fairly conceptual data-visualization project into the commercial public is novel since it is considered ‘new media.’

Andrea Polli is an artist and writer, blending art and science through tech art to make work related to environmental issues. She is currently an Associate Professor of Art and Ecology at the University of New Mexico and got her MFA from SAIC.

Project 08: Generative Portrait

For this project, I chose to render my brother. I originally had wanted to use particle systems to create a water-like simulation on top of the loaded pixels using a mutual repulsion force. In this sketch, however, I used a gaussian distribution to create a black hole in which the array of tiny pixel ellipses would form and disappear. The sketch did not turn out as I had hoped since I did not use a gradually added velocity and just layered the gaussian particles on top of the grid, and used too many ellipses in the for loops. This made the transition abrupt and the program slow.
Screen Shot 2015-12-18 at 6.28.11 AM

Screen Shot 2015-12-18 at 6.28.30 AM

Screen Shot 2015-12-18 at 6.29.13 AM

Screen Shot 2015-12-18 at 6.29.31 AM



Project 07: Generative Landscape

When asked to plan a generative moving landscape, I immediately thought of the game, Journey. This is a visually stunning, emotionally oriented game where you, a cloaked wanderer fly through a landscape of sand dunes, old buildings, ruins and caves.

I tried to refer to the color scheme and the my favorite structures, the posts, in this sketch. I used noise functions to render the scenery. I used a random function for the color of the posts to create a dust-wind effect.





Looking Outwards 07: Chris Sugrue

Chris Sugrue is an artist, programmer, and designer who does interactive installations, audiovisual performance, and algorithmic animations. Her works focus on getting a digital work to invade our space or break away from the rectangular confines of a screen. Her project, Delicate Boundaries (2007) investigates the imaginative worlds inside our digital devices. She makes small bugs made out of light projections that come off a screen onto the bodies who make contact with them. They crawl up the participants hand and arm and eventually drop to the floor.


This intimate experience causes the participant to become lost within the work. For the most part digital technology takes place only with the eyes consuming the screen, and I think it is admirable that she uses this experience to integrate an intimate virtual experience with one’s own body.

In her presentation she uses individual projects as stepping stones to explain the progress of her works. Using this technique makes it easy to understand her thinking patterns in why and how her investigations took place. For example, she focuses a lot on hands to create intimate experiences, and one can see how she moved from Delicate Boundaries to the negative hand space projections, to Augmented Hand series, and so on.

Link to website here

Looking Outwards 05: Aligning Humans and Mammals


Ben Fry – Aligning Humans and Mammals

This data visualization compares parts of the human genome with other mammals. All the data is from the Mammalian Genome Project at the Broad Institute. The top white line represents human DNA and the additional rows show DNA from other mammals. The rows are roughly in the sequential evolutionary distance, so the first row after human is chimp, then rhesus monkey, elephant dog, armadillo, guinea pig, then cow etc. The colored letters are the base pairs that are different from human DNA (T and A in red, G and G in blue.)

I admire the simplicity and starkness of this visualization that boils down our existence to the core truth in our DNA. It is interesting to note the visually different patterns throughout the sequential evolutionary distances, and proves how similar we are to other mammals.

Link here