Xastol – Mocap
FINAL PRODUCT
SKETCHES
SCREENSHOT OF PROGRAM
SUMMARY
For this project, I really wanted to alter some characteristics of previously created narratives, in hopes of changing their concepts. My initial idea consisted of imitating lead roles in films and switching their living forms with inanimate objects. (i.e. – Replace movie characters with the tools/objects they use.)
PROCESS
When coming up with possible movies to imitate, I regarded the key objects (i.e. – staff, gun, etc.) and how they related to their character’s role in the film (i.e. – police guard, wizard, etc.). The film that I thought would convey this the best was Quinton Tarantino’s Pulp Fiction. More specifically, I aimed to re-create Jules, played by Samuel L. Jackson, and a specific dialogue he has with one of his boss’s “business partners”. After reviewing the scene multiple times, I then decided to change up my concept and replace the main characters with a sort of visual pun (Hint: Pulp Fiction and Oranges).
After finalizing details, I recorded multiple BVH files of Jules and the business partner, Brett. This process was a bit difficult since the camera used (Kinect V2) didn’t particularly like the fast movements I was trying to imitate while standing and sitting. As a result, some of the movements came out a little glitchy and some of the previous “aggressive” movements had to be slowed down.
After recording, I inputted the BVH files and adjusted camera angles similar to those in the actual scene. This took quite a while, as timing was key. After the scenes were lined up, I proceeded to create a set that would fit the new concept I was aiming for (i.e. – kitchen counter). I then rendered out the figures and adjusted certain characteristics at certain points of the film. For example, when the Brett Orange is shot, his color begins to change to a greener, more vile color.
REVIEW
I am particularly happy with the results I created. Although the rendering of the characters is not as high of quality as I would like for it to be, I am happy with the results given a rather chaotic week.
I will definitely continue to make this project better in the future (i.e. – work on developing software to automatically rotor-scope an inputted scene, make adjustments to character rendering for smoother movement, etc.). Once I have a better understanding of the bugs I’m facing and also have created more efficient programs to render out these scenes, I may even continue to recreate the entire film!
GitHub Link: https://github.com/xapostol/60-212/tree/master/Deliverables%208
// Renders a BVH file with Processing v3.2.1
// Note: mouseX controls the camera.
import ddf.minim.*;
PBvh1 orngJ;
PBvh2 orngB;
PImage bg1; // background
PImage bg2; // background 2
// Time
int m;
AudioPlayer player;
Minim minim; // audio context
//------------------------------------------------
void setup() {
size( 1280, 720, P3D );
// Load a BVH file recorded with a Kinect v2, made in Brekel Pro Body v2.
orngJ = new PBvh1( loadStrings( "jules_00.bvh" ) );
orngB = new PBvh2( loadStrings( "brett_00.bvh" ) );
// Load the soundfile
minim = new Minim(this);
player = minim.loadFile("Pulp Fiction - Jules and his Bible Verse1_01.mp3", 2048);
player.play();
bg1 = loadImage("background_02.jpg");
bg2 = loadImage("background_01.jpg");
}
//------------------------------------------------
void draw() {
background(bg1);
m = millis();
//println(m); //Purposes of testing/timing for camera angles and effects.
setMyCamera(); // Position the camera. See code below.
//drawMyGround(); // Draw the ground. See code below. (Purposes Of Testing)
updateAndDrawBody(); // Update and render the BVH file. See code below.
}
//------------------------------------------------
void updateAndDrawBody() {
// Stop The Scene
if (m > 118800) {
m = 0;
}
pushMatrix();
translate(width/2+50, height/2, 10); // position the body in space
scale(-1, -1, 1); // correct for the coordinate system orientation
orngJ.update(m); // update the BVH playback
orngJ.drawBones(); // a different way to draw the BVH file
popMatrix();
pushMatrix();
translate(width/2, height/2, -250);
scale(-1, -1, -1);
orngB.update(m);
orngB.drawBones();
popMatrix();
}
//------------------------------------------------
void setMyCamera() {
// INITIAL CONDITIONS FOR CAMERA
// Adjust the position of the camera
float eyeX = width/2; // x-coordinate for the eye
float eyeY = height/3.0f - 500; // y-coordinate for the eye
float eyeZ = 500; // z-coordinate for the eye
float centerX = width/2.0f; // x-coordinate for the center of the scene
float centerY = height/2.0f; // y-coordinate for the center of the scene
float centerZ = -400; // z-coordinate for the center of the scene
float upX = 0; // usually 0.0, 1.0, or -1.0
float upY = 1; // usually 0.0, 1.0, or -1.0
float upZ = 0; // usually 0.0, 1.0, or -1.0
//---------------------------------------------------------------------//
// CAMERA ANGLES //
background(bg1);
// Angle #1 (Over Shoulder - BRETT)
camera(eyeX-70, 0, -eyeZ, centerX, centerY, -1*centerZ, upX, upY, upZ);
// Angle #2 (Over Top - JULES)
if (m > 6600) {
camera(width/2, height/3.0f - 250, 200, centerX, centerY, centerZ, upX, upY, upZ);
}
// Angle #1 (Over Shoulder - BRETT)
if (m > 9500) {
camera(eyeX-70, 0, -eyeZ, centerX, centerY, -1*centerZ, upX, upY, upZ);
}
// Angle #3 (Wide)
if (m > 10300) {
background(bg2);
camera(width/2, eyeY, eyeZ, centerX, centerY, centerZ, upX, upY, upZ);
}
// Angle #1 (Over Shoulder - BRETT)
if (m > 17000) {
background(bg1);
camera(eyeX - 100, 0, -eyeZ + 200, centerX, centerY, -1*centerZ, upX, upY, upZ);
}
// Angle #4 (Close Up - JULES)
if (m > 24600) {
camera(width/2 + 50, height/3.0f - 250, -60, centerX, centerY, centerZ, upX, upY, upZ);
}
// Angle #1 (Over Shoulder - BRETT)
if (m > 31500) {
camera(eyeX - 100, 0, -eyeZ + 200, centerX, centerY, -1*centerZ, upX, upY, upZ);
}
// Angle #4 (Close Up - JULES)
if (m > 36000) {
camera(width/2 + 50, height/3.0f - 250, -60, centerX, centerY, centerZ, upX, upY, upZ);
}
// Angle #1 (Over Shoulder - BRETT)
if (m > 44800) {
camera(eyeX - 100, 0, -eyeZ + 200, centerX, centerY, -1*centerZ, upX, upY, upZ);
}
// Angle #2 (Over Top - JULES)
if (m > 48850) {
camera(width/2, eyeY, 200, centerX, centerY, centerZ, upX, upY, upZ);
}
// Angle #4 (Close Up - JULES)
if (m > 52000) {
camera(width/2 + 50, height/3.0f - 250, -60, centerX, centerY, centerZ, upX, upY, upZ);
}
// Angle #1 (Over Shoulder - BRETT)
if (m > 61000) {
camera(eyeX - 100, 0, -eyeZ + 200, centerX, centerY, -1*centerZ, upX, upY, upZ);
}
// Angle #4 (Close Up - JULES)
if (m > 62000) {
camera(width/2 + 50, height/3.0f - 250, -60, centerX, centerY, centerZ, upX, upY, upZ);
}
// Angle #4 (Close Up - JULES)
if (m > 79000) {
camera(width/2 + 50, height/3.0f - 250, -60, centerX, centerY, centerZ, upX, upY, upZ);
}
// Angle #1 (Over Shoulder - BRETT)
if (m > 93000) {
camera(eyeX - 100, 0, -eyeZ + 200, centerX, centerY, -1*centerZ, upX, upY, upZ);
}
// Angle #5 (Tilt - JULES)
if (m > 97000) {
camera(width/2 + 50, height/3.0f - 300, -80, centerX, centerY, centerZ, -0.5, upY, upZ);
}
// Angle #1 (Over Shoulder - BRETT)
if (m > 110000) {
camera(eyeX - 100, 0, -eyeZ + 200, centerX, centerY, -1*centerZ, upX, upY, upZ);
}
// Angle #3 (Wide)
if (m > 112800) {
background(bg2);
camera(width/2, height/6.0f - 1000, eyeZ, centerX, centerY, centerZ, upX, upY, upZ);
}
//---------------------------------------------------------------------//
}
void drawMyGround() {
// Draw a grid in the center of the ground
pushMatrix();
translate(width/2, height/2, 0); // position the body in space
scale(-1, -1, 1);
stroke(100);
strokeWeight(1);
float gridSize = 400;
int nGridDivisions = 10;
for (int col=0; col<=nGridDivisions; col++) {
float x = map(col, 0, nGridDivisions, -gridSize, gridSize);
line (x, 0, -gridSize, x, 0, gridSize);
}
for (int row=0; row<=nGridDivisions; row++) {
float z = map(row, 0, nGridDivisions, -gridSize, gridSize);
line (-gridSize, 0, z, gridSize, 0, z);
}
popMatrix();
}