Final project- Shaungnh

Looking back at all the deliverables we have done so far in this class, I realized how much I loved the text rain assignment in particular and how motivated to figure out the correct code. So for the final project, I came up with two ideas about making the final project both involved the use of a webcam. I chose to stick to the second one, which is an interactive percussion instrument made of digital tubes that is color sensitive.
The first challenge I encountered was how to compare how close the fetched color is to a pre-determined color (in this case red). But this problem was solved after I understood the concept of distance between colors, and how to calculate the percent different between two colors by their RGB values. So in my program, the max tolerance of color difference is set to 25%.
The biggest challenge I faced was that since the color of the capture device was fetched at every frame, once you hold a red color underneath the tubes, the corresponding sound tracks would be constantly start playing every frame and thus create this very disturbing overlapping of sounds. In oder to fix that problem, I came up with the idea of using a array of two values to keep track of weather a tube is hit by the correct color. However, I ad to learn how to make 2d array first because I have multiple tube objects in my program. 2d arrays were kind of confusing, but fortunately everything made sense after some googling and I was able to successfully use it in the way I want it work.
Here is a quick demo about this project (sorry for the last 5 sec awkward silence..I couldn’t figure out how to stop recording..)(also, password to the video: password)

Here are the codes (I don’t think this sketch work here because there are music files included locally):


The two projects that I found both interesting and relevant are Base 8 by Chris Sugrue and Treachery of Sanctuary by James George. Both pieces are made possible by tracking cameras to detriment the exact positions of the viewers. In Surgue’s work, she focuses on the elaborate shape of human hands and plays with those hands by integrating 2D shapes and 3D forms together in a shared frame. In order for this to work, she really puts in a lot effort to determine the outline of the hand form in order to later manipulate its surroundings. On the other hand, George focuses less on the detail but rather the general outline of a human form. His piece determines where the arms of the viewers are located and they manipulates the shadow of he arms into the shapes of wings. Similarly in my piece, I would also need to figure out a way to track the movement of the hand thus allow the viewers to draw with their hands through webcame.
link to Sugrue’s project:

link ti George’s project:

Final Project Proposal

For my final project, since I’ve always been very interested in interactions between computers and humans, I want to make an interactive pice that is fun to play with. As a result, I’m planning on making a program that allows the user to draw with their hands on the canvas directly by using cameras to track the motion of his or her hand. After the trail of the moving hand is determined, the brush stroke will also follow the same path to crate a map which shows the exact motion of the hand. It would be ideal if the thickness of the stroke also varies depending on how close the hand is to the camera, but I’m not sure how achievable this is.
At the same time, I also have a second idea, which is making some kind of percussion game that gives off different sounds when the player hits the target objects. At this point, I still cant decide which idea to go with, but I’m leaning towards the first one for now.


Lia is an Austrian artist who is considered an important leading figure in the field of software and net art. She primarily works with code as a new material to create new tools for art making.Lia’s project Rain(2012), was particularly interesting to me after looking through many other works by different artists. First of all, this piece is consisted of three very distinct parts, interactive media box, prints and texts. I truly admire the media box part of this project, because it is an instrument created by the artist to give out opportunities for viewers to come up with their own versions of the rain patterns. Though the prints for sale were all absolutely visually appealing, the fact that interaction between the artist and the viewers that was made possible by the art work is truly stunning.
Link to this project:


For this project, I wanted to created an interactive piece where the player is responsible for leading the creature to its final destination on screen. As a result, in my code, a star (something that’s very appealing to the creature that it will follow the star trail)will be drawn at where ever the player clicked. These are going to guid the creature to the goal. Once the creature successfully reaches the goal, a winning text will be shown. Otherwise, the program will tell the player to try again.
Screen Shot 2015-11-12 at 9
Screen Shot 2015-11-12 at 9-0


For this project, I wanted to use turtles to create a abstract portrait. So I made my turtles move linearly across the canvas from where they are drawn. Plus, the locations where new turtles are created are elected based on the brightness/darkness of the original image.
ps:The screenshot shows the full image while the sketch I embedded here only shows a intentionally cropped image so that it runs faster.


My original idea was inspired by Tetris, and I was gonna stack the already revealed part of the photo together just like how a Tetris works. However, I was running into a lot of problems and was unable to achieve it within the given time. As a result, I modified my idea a little and decided to make ever changing. This means, my program is never going to reveal the whole image at once, but in order to see the actual image, one would need to be constantly clicking the screen since even the already revealed part of the image is going to slip out of the canvas.
ps:I used one of my friend’s photo for this project
when mouse clicked multiple times to reveal part of the image:
rects slides down and exists the frame:


The project called Surging Seas created by Stamen looks very intriguing to me since it is trying to visualize information about what’s going to happen in the future rather than what’s already behind us. Like Jen, I also think it is an interesting yet very effective choice to reveal the landscapes in detail only if they are underwater since the intention of this map is to indicate and analyze the aftermath of a possible flood. I also admire how this project had already done so much more beyond just the superficial – the loss of usable lands. Two of the most recent added features also show the population density and level of social vulnerability in the flooded region, which provide the viewers a much more clear idea about the potential damage that will be brought forth by a flood.
link to the project:
link to Jen’s post:


So I started my project with the idea of a candy land in head, and therefore I first created several objects that each represented different types of candies. While making the curvy shapes of the candies, I had some problem using curvevertex, it was just very confusing for me to have to consistently be thinking about the control points. Otherwise, I think most of the project went fine and I pretty much stick to my initial plan without needing to change much. I think this defiantly has a lot to do with the object assignments. I do believe those really helped me to get a much clearer idea on how to use “objects”. I also added a little surprise element to the program, but in order to see it, you really have to wait for a long time and that’s why I’m calling it a “lucky rainbow” :).


Chris Sugrue identifies herself as both an artist and a programmer who devoted her career into the development of highly interactive installations. Sugrue always like to experiment with different technologies in a playful but intentional way, and that is what I really admire about her. Not only because she often push the boundary between the screen and the body but also because she is creative enough to make her pieces to trigger new experiences for the viewers. In her speech, Sugrue first of all presented one of her earlier work called Delicate Boundaries, a seemingly easy piece backed by complex technologies such as 3D racking cameras. This work perfectly presents the playfulness and thoughtfulness that Sugrue is always looking for by allowing human to interact with creatures on screen through projection.
Link to her website: