Virtual Harp – Damin Jung & Joo Yun Han

In this project, the user uses the webcam to touch the lines to play the harp. The user knows that he or she touched a certain line because it will not only bounce but produce colorful particles. The way this project works is that it subtracts the current pixel from the previous pixel of body parts and if the absolute value of that is greater than 100, then the sound plays. In order to prevent this program from slowing down, we removed particles once they leave the canvas. Originally we created a virtual piano, however we realized that adding a string sound would be more interesting. We recorded the harp sounds using the electronic piano. (This project does not work on Chrome but it seems to work fine on Edge)
To those who are crying due to our hard coding, we are sorry we’re making your eyes hurt. We spent the first week trying to figure out how to detect motion, and we spent the second week adding particles and figuring out how to make the sound stop playing frequently. By the time we figured this out, we didn’t have enough time to make our codes more neat.

Harp Demonstration


Looking Outwards for the Final Project

Two projects that I found interesting and relevant to my final project were Piano Stairs and The Projected Instrument Augmentation system (PIANO). Piano Stairs was created by Volkswagen Sweden and an ad company, DDB Stockholm in 2013. They made this project to see if people were more likely to use the stairs, if stairs played musical notes when they stepped on them. They were partially successful in doing so because people who chose stairs over escalator increased by 66%. They were also successful in making someone’s day more special. PIANO was created by was developed by German pianists Katja Rogers and Amrei Röhlig and their colleagues in 2013. In this project they used a technicolor projection screen to teach beginners how to play the piano. It shows which key to play and for how long and tells you if you’re wrong or right. I think these two projects were relevant to my final project in that both are interactive and make piano playing more approachable. I think these two projects are different in terms of purpose, because the piano stairs is more of a social experiment and PIANO is educational.

Final Project Proposal

For our final project, we are going to create a Projection Piano. Here, we will use a projector to project a virtual piano keyboard, create a software that would detect when a person is touching the key and what key it is. When the keyboard is touched, it will also display a visualization effect that is special to that key. Although, we are going to project this on a flat surface, to make things more interesting, we hope to project this on water if time permits. We will also add different tones to our Projection Piano, such as guitar, trumpet, flute or violin like digital piano. In order to detect the surface of piano keyboard, we are going to use the webcam. We will research more on what kind of tools and algorithm we should implement for this project. We hope that our project would allow piano to become more accessible to people. Damin Jung and JooYun Han will work as a team for the final project.



Homage to Subway Pizza Rat.

My creature is inspired by the subway pizza rat. Although the creature already has two slices of pizza, it’s very greedy and doesn’t want to share. So when the cursor tries to take the second pizza away, it springs back to the creature. The creature then gets angry and turns red and moves rapidly. The only way to take away the pizzas is to randomly relocate them by pressing any key.




Looking Outwards 10

The woman practitioner I chose is Lorna Barnshaw. She is a 3D Designer based in London, U.K. She received her Bachelor of Fine Arts from Winchester School of Art in 2010. Her works focus on digital animation and computer animation. I liked her projects because I have always been interested in animation and special effects. She has various projects, but my favorite was the 3D Printed Head from 2013. I though this was original because before I only saw head sculptures made from white marbles. In her project, instead of using marble or clay, she used 3D scanning and printing method. The 3D Printed Head is realistic and doesn’t fail to capture every feature of the person, whereas sculptures made from white marbles are often aestheticized.


Lorna Barnshaw’s Page


For this weeks Looking Outwards, I looked at JooYun Han’s review of eCLOUD project. I thought this project was interesting because it was based on real world data. I do agree with JooYun in that this project is not only visually stunning, but also serves an important purpose of making people aware of real time weather data. These polycarbonate clouds can “adapt” to weathers of different cities by fading itself within transparent and opaque range. Through these movements, eCLOUD can show what the weather is like, the temperature, wind speed, and the direction of the wind. I think art projects like eCLOUD are really important because they help people by showing information.


JooYun Han- Looking Outwards – 05


Project-07-Landscape : Polar Express

My project is inspired by the movie The Polar Express. The perspective of this project is looking out the window of a train heading to the North Pole. I created functions for houses and snow. The houses come in random sizes and colors. I made the windows of the houses to flash in order to create a fireplace effect. The snows also come in random sizes, but they fall at random speed.




Zach Lieberman is an artist and a computer programmer based in New York. In his lecture, Lieberman stated that his projects are inspired by his father who was a professional storyteller. His father once said that “we are drowning in data, and we need people to weave stories” and Lieberman derives his works from this idea. He thinks of computer science as another way of storytelling. For example, he says “plot point” could mean the plot of a story. He believes that through drawing on computer, we can tell a story. Drawing lines, setting their angles and rotation can have different meanings. He also states that computers are capable of drawing what people can’t do. Not exclusive to drawing, storytelling can happen through sound. For example, my favorite project of Lieberman, he developed a program, where you press a piano key and the program selects some country and turns on the radio from that country that has the same note as the piano key. I admire his works because I think it relates to this class. It has many similarities in that we are focusing on visual side of computation. He also encourages me to get inspired not only by work of other artists, but from your life even if it may be trifling, such as listening sounds that you hear as you walk past the street, or what your parents say.

He is also a co-founder of School for Poetic Computation and he encourages students to develop their ideas into reality. For example, one of his students created an “Insecurity Camera.” The Insecurity Camera looks away when a person looks into it.

thesystemis Lieberman’s web site

openFrameworks Lieberman’s web site

Eyeo 2015 – Zach Lieberman from Eyeo Festival // INSTINT on Vimeo.