Byungju Lee

Volumetric Interactive Experience

 

Copyright © Byungju Lee 2020.

 

VolTech Claw Game, 2020

 

Team VolTech

Byungju Lee, Kevin Lee, Swapnil Mengade, Rebecca Wolfinger, Ayushuman Johri

 

 

This is VolTech Claw Game, an interactive experience with the volumetric display, Voxon VX1 and space mouse.

 

With 360 degree nature of this platform, We utilize that as the mechanic in the claw game itself, because player have to look around to examine the location of the prizes. You'll find that playing this game on VX1 is much easier than playing on a flat screen of emulator.

 

After we tested other XR interfaces, We realized there is the trade-off between precision and intuitiveness. We wanted to keep this one simple, precise and as intuitive as possible. We reverse engineered our experience to find the best way to map 3d Mouse, which was originally included with their unit. We found that the XY axis of the claw game matched joystick style orientation of the space mouse and the drop button as well was perfect for the button on the 3d space mouse.

 

We want it to blur the line between VX1 and reality and expand the space of our experience. Every time you grab a prize and drop it into the prize box, you will see that prize drop onto the side monitor of VX1.

Volumetric Display: Interface Experiment

 

 

Interface Showcase  : Emotive Insight Brainwave Headset, 2020

 

Team VolTech

Byungju Lee, Kevin Lee, Swapnil Mengade, Rebecca Wolfinger, Ayushuman Johri

 

The prototype showcases an interactive meta ball, created for the volumetric display, Voxon VX1. The guest can change various values using an EEG Headset called Emotiv Insight Brainwear, changing its visual characteristics using brain-waves (noise, shapes, size, color to name a few), making it a fun toy or an art piece for the VX1.

 

Video Credit to Ayushuman Johri

 

Interface Showcase  : Smartphone, 2020

 

Team VolTech

Byungju Lee, Kevin Lee, Swapnil Mengade, Rebecca Wolfinger, Ayushuman Johri

 

The prototype showcases an 4 Player fighting game for the volumetric display Voxon VX1. Players control gummy bears, using their Android smartphones, in a free for all brawl as they try to knock each other off the stage. The prototype went through a few iterations, adding more visual fidelity and detail every version.

 

Video Credit to Ayushuman Johri

Interface Showcase  : Leap Motion, 2020

 

Team VolTech

Byungju Lee, Kevin Lee, Swapnil Mengade, Rebecca Wolfinger, Ayushuman Johri

 

This prototype showcases an interactive storytelling experience created for the volumetric display, Voxon VX1. The guest control the narrator's boat using a Leap Motion Controller as they traverse through an environment, following a story based on the poem 'Annabelle Lee' by Edgar Allen Poe.

 

Video Credit to Ayushuman Johri

Volumetric Display: Visual Experiment

 

 

Voxon VX1 + Unity Interactive Shader Experiment: Cube Wave , 2020

 

Voxon VX1, Korg Nano Kontrol2 Midi Controller, Unity

 

Voxon VX1 + Unity Interactive Shader Experiment: Blob , 2020

 

Voxon VX1, Korg Nano Kontrol2 Midi Controller, Unity

Looking Glass

 

 

 

The Looking Glass + Unity Interactive Shader Experiment, 2020

 

 The Looking Glass, Unity, Korg Mini Kontrol 2 Midi Controller

 

The Looking Glass + Ricoh Theta 360 Camera, 2020

 

The Looking Glass,  Ricoh Theta 360 Camera, Unity

 

The Looking Glass + Unity Shader Experiment, 2020

 

 The Looking Glass, Unity

 

Looking Glass Test 01, 2019

 

Intel RealSense D435i,  The Looking Glass, Unity

 

Looking Glass Test 02, 2019

 

Intel RealSense D435i,  The Looking Glass, Unity

OpenGL

 

 

 

OpenGL Demo, 2019

 

OpenGL Demo

Shader

 

 

 

Unity Shader Experiment: Blob, 2019

 

Shader Controlled with Midi Controller, Unity

 

 

Unity Shader Experiment: Lemon, 2019

 

Shader Controlled with Midi Controller, Unity

Other Interactive Experiences

 

Kaleidoscope, 2019

 

Team Project, A semester, Unity, Cave Experience

 

Team Kaleidoscope has made an interactive installation exploring cultural implicit bias for the Askwith Kenner Global Languages and Cultures Room located in the new Tepper Quad at Carnegie Mellon University.

 

Kaleidoscope is chosen for SXSW 2020 Student Innovation Awards finalist

 

Producer: Vicky Lin, Jehan Sandhu

Programmer: Byungju Lee, Weizheng Lee, Ricardo Tucker

UX Designer: Amber Zheng

 

Oddly Satisfying: Building Virtual World 2018 Round 5

 

Team Project, 3 weeks, Unity, Cave Experience

 

Producer: Emily Kovalik

Programmer: Byungju Lee, Hye Lee Kim

Artist: So Young Han, Marissa Doerger

 

The Last ETCer: Building Virtual World 2018 Round 3

 

Team Project, 3 weeks, Unity, Leap Motion

 

Producer: Xiao He

Programmer: Byungju Lee, Xiao He

Artist: Min Pan, Yanyu Tong

Sound Designer: Mong-Yah Hsieh

 

Office: Building Virtual World 2018 Round 2

 

Team Project, 2 weeks, Unity, Meta 2(AR HMD)

 

Producer: Liam Philiben

Programmer: Byungju Lee, Wenyu Mao

Artist: Jinya Chen, Nidhi Ramanathan

 

Colors: Building Virtual World 2018 Round 0

 

Solo Project, 1 week, Unity

3D Modeling

 

 

 

Head Modeling, 2016

 

3D Modeling of Head using Blender

 

Body Modeling, In Progress

 

3D Modeling of Body using Blender

Photogrammetry

 

 

 

 

Photogrammetry Experiment, 2019

 

Photogrammetry Experiment using Agisoft Metashape Pro

Animation

 

 

 

Silly Animation, 2015

 

Modeling, Riging and Animation using Blender

Three.js

 

 

Three.js Experiment, 2016

 

This is an interactive experience in web browser, using three.js and Javascript.

modeling, rigging, and animation using Blender.

 

Motion Grapchics Demo, 2018

 

Motion Graphics with Adobe After Effects

Background Music: Herbie Hancock, Watermelon Man

Motion Graphics

 

Mapping Experience, 2012

 

Adobe After Effects

Background Music: The  Z, Base

Projection Mapping

Digital Fabrications

 

 

 

Winged Victory of Samothrace with Buddha’s head, 2015

3D model collage and 3D printing Experiments

 

 

Face, 2015

3D scanning and Laser Cutting Experiments

 

Light Sculpture

 

 

 

 

Colors, 2013

Projector, PVC

 

 

Paintings and Drawings

 

 

 

 

Self Portrait, 2014

Acrylic Painting

 

 

 

Cello Human, 2013

Colored Pencil Painting

 

 

 

Monster, 2013

Colored Pencil Painting

 

 

 

House, 2013

Watercolor Painting

Typography

Adobe Illustrator

Illustrations

Adobe Photoshop

 

Volumetric Interactive Experience

 

 

VolTech Claw Game, 2020

 

Team VolTech

Byungju Lee, Kevin Lee, Swapnil Mengade, Rebecca Wolfinger, Ayushuman Johri

 

 

This is VolTech Claw Game, an interactive experience with the volumetric display, Voxon VX1 and space mouse.

 

With 360 degree nature of this platform, We utilize that as the mechanic in the claw game itself, because player have to look around to examine the location of the prizes. You'll find that playing this game on VX1 is much easier than playing on a flat screen of emulator.

 

After we tested other XR interfaces, We realized there is the trade-off between precision and intuitiveness. We wanted to keep this one simple, precise and as intuitive as possible. We reverse engineered our experience to find the best way to map 3d Mouse, which was originally included with their unit. We found that the XY axis of the claw game matched joystick style orientation of the space mouse and the drop button as well was perfect for the button on the 3d space mouse.

 

We want it to blur the line between VX1 and reality and expand the space of our experience. Every time you grab a prize and drop it into the prize box, you will see that prize drop onto the side monitor of VX1.

 

 

 

 

 

Volumetric Display: Interface Experiment

 

 

Interface Showcase  : Emotive Insight Brainwave Headset, 2020

 

Team VolTech

Byungju Lee, Kevin Lee, Swapnil Mengade, Rebecca Wolfinger, Ayushuman Johri

 

The prototype showcases an interactive meta ball, created for the volumetric display, Voxon VX1. The guest can change various values using an EEG Headset called Emotiv Insight Brainwear, changing its visual characteristics using brain-waves (noise, shapes, size, color to name a few), making it a fun toy or an art piece for the VX1.

 

Video Credit to Ayushuman Johri

 

 

 

 

 

 

Interface Showcase  : Smartphone, 2020

 

Team VolTech

Byungju Lee, Kevin Lee, Swapnil Mengade, Rebecca Wolfinger, Ayushuman Johri

 

The prototype showcases an 4 Player fighting game for the volumetric display Voxon VX1. Players control gummy bears, using their Android smartphones, in a free for all brawl as they try to knock each other off the stage. The prototype went through a few iterations, adding more visual fidelity and detail every version.

 

Video Credit to Ayushuman Johri

 

 

 

 

 

 

Interface Showcase  : Leap Motion, 2020

 

Team VolTech

Byungju Lee, Kevin Lee, Swapnil Mengade, Rebecca Wolfinger, Ayushuman Johri

 

This prototype showcases an interactive storytelling experience created for the volumetric display, Voxon VX1. The guest control the narrator's boat using a Leap Motion Controller as they traverse through an environment, following a story based on the poem 'Annabelle Lee' by Edgar Allen Poe.

 

Video Credit to Ayushuman Johri

 

 

 

 

 

Volumetric Display: Visual Experiment

 

 

Voxon VX1 + Unity Interactive Shader Experiment: Cube Wave , 2020

 

Voxon VX1, Korg Nano Kontrol2 Midi Controller, Unity

 

 

 

 

 

 

Voxon VX1 + Unity Interactive Shader Experiment: Blob , 2020

 

Voxon VX1, Korg Nano Kontrol2 Midi Controller, Unity

 

 

 

 

 

Looking Glass

 

 

The Looking Glass + Unity Interactive Shader Experiment, 2020

 

 The Looking Glass, Unity, Korg Mini Kontrol 2 Midi Controller

 

 

 

 

 

 

The Looking Glass + Unity Shader Experiment, 2020

 

 The Looking Glass, Unity

 

 

 

 

 

 

The Looking Glass + Ricoh Theta 360 Camera, 2020

 

The Looking Glass,  Ricoh Theta 360 Camera, Unity

 

 

 

 

 

 

Looking Glass Test 01, 2019

 

Intel RealSense D435i,  The Looking Glass, Unity

 

 

 

 

 

 

Looking Glass Test 02, 2019

 

Intel RealSense D435i,  The Looking Glass, Unity

 

 

 

 

 

OpenGL

 

 

 

OpenGL Demo, 2019

 

OpenGL Demo

 

 

 

 

 

Shader

 

 

 

Unity Shader Experiment: Blob, 2019

 

Shader Controlled with Midi Controller, Unity

 

 

 

 

 

 

Unity Shader Experiment: Lemon, 2019

 

Shader Controlled with Midi Controller, Unity

 

 

 

 

 

Other Interactive Experience

 

 

Kaleidoscope, 2019

 

Team Project, A semester, Unity, Cave Experience

 

Team Kaleidoscope has made an interactive installation exploring cultural implicit bias for the Askwith Kenner Global Languages and Cultures Room located in the new Tepper Quad at Carnegie Mellon University.

 

Kaleidoscope is chosen for SXSW 2020 Student Innovation Awards finalist

 

Producer: Vicky Lin, Jehan Sandhu

Programmer: Byungju Lee, Weizheng Lee, Ricardo Tucker

UX Designer: Amber Zheng

 

 

 

 

 

 

Oddly Satisfying: Building Virtual World 2018 Round 5

 

Team Project, 3 weeks, Unity, Cave Experience

 

Producer: Emily Kovalik

Programmer: Byungju Lee, Hye Lee Kim

Artist: So Young Han, Marissa Doerger

 

 

 

 

 

 

The Last ETCer: Building Virtual World 2018 Round 3

 

Team Project, 3 weeks, Unity, Leap Motion

 

Producer: Xiao He

Programmer: Byungju Lee, Xiao He

Artist: Min Pan, Yanyu Tong

Sound Designer: Mong-Yah Hsieh

 

 

 

 

 

 

Office: Building Virtual World 2018 Round 2

 

Team Project, 2 weeks, Unity, Meta 2(AR HMD)

 

Producer: Liam Philiben

Programmer: Byungju Lee, Wenyu Mao

Artist: Jinya Chen, Nidhi Ramanathan

 

 

 

 

 

 

Colors: Building Virtual World 2018 Round 0

 

Solo Project, 1 week, Unity

 

 

 

 

 

3D Modeling

 

 

 

Head Modeling, 2016

 

3D Modeling of Head using Blender

 

 

 

 

 

 

Body Modeling, In Progress

 

3D Modeling of Body using Blender

 

 

 

 

 

Photogrammetry

 

 

 

Photogrammetry Experiment, 2019

 

Photogrammetry Experiment using Agisoft Metashape Pro

 

 

 

 

 

Animation

 

 

 

Silly Animation, 2015

 

Modeling, Riging and Animation using Blender

Three.js

 

 

 

Three.js Experiment, 2016

 

This is an interactive experience in web browser, using three.js and Javascript.

modeling, rigging, and animation using Blender.

 

 

 

 

 

Motion Graphics

 

 

 

Motion Grapchics Demo, 2018

 

Motion Graphics with Adobe After Effects

Background Music: Herbie Hancock, Watermelon Man

 

 

 

 

 

Projection Mapping

 

 

Mapping Experience, 2012

 

Adobe After Effects

Background Music: The  Z, Base  Clef

 

 

 

 

 

Digital Fabrications

 

 

 

Winged Victory of Samothrace with Buddha’s head, 2015

3D model collage and 3D printing Experiments

 

 

 

 

 

 

Face, 2015

3D scanning and Laser Cutting Experiments

 

 

 

 

 

Light Sculpture

 

 

 

 

Colors, 2013

Projector, PVC

 

 

Paintings and Drawings

 

 

 

Self Portrait, 2014

Acrylic Painting

 

 

 

 

 

 

Cello Human, 2013

Colored Pencil Painting

 

 

 

 

 

 

Monster, 2013

Colored Pencil Painting

 

 

 

 

 

 

House, 2013

Watercolor Painting

 

 

 

 

 

Typography

Adobe Illustrator

Illustrations

Adobe Photoshop

 

 

 

 

 

Volumetric Interactive Experience

 

 

VolTech Claw Game, 2020

 

Team VolTech

Byungju Lee, Kevin Lee, Swapnil Mengade, Rebecca Wolfinger, Ayushuman Johri

 

 

This is VolTech Claw Game, an interactive experience with the volumetric display, Voxon VX1 and space mouse.

 

With 360 degree nature of this platform, We utilize that as the mechanic in the claw game itself, because player have to look around to examine the location of the prizes. You'll find that playing this game on VX1 is much easier than playing on a flat screen of emulator.

 

After we tested other XR interfaces, We realized there is the trade-off between precision and intuitiveness. We wanted to keep this one simple, precise and as intuitive as possible. We reverse engineered our experience to find the best way to map 3d Mouse, which was originally included with their unit. We found that the XY axis of the claw game matched joystick style orientation of the space mouse and the drop button as well was perfect for the button on the 3d space mouse.

 

We want it to blur the line between VX1 and reality and expand the space of our experience. Every time you grab a prize and drop it into the prize box, you will see that prize drop onto the side monitor of VX1.

 

 

 

 

 

Volumetric Display: Interface Experiment

 

 

Interface Showcase  : Emotive Insight Brainwave Headset, 2020

 

Team VolTech

Byungju Lee, Kevin Lee, Swapnil Mengade, Rebecca Wolfinger, Ayushuman Johri

 

The prototype showcases an interactive meta ball, created for the volumetric display, Voxon VX1. The guest can change various values using an EEG Headset called Emotiv Insight Brainwear, changing its visual characteristics using brain-waves (noise, shapes, size, color to name a few), making it a fun toy or an art piece for the VX1.

 

Video Credit to Ayushuman Johri

 

 

 

 

 

 

Interface Showcase  : Smartphone, 2020

 

Team VolTech

Byungju Lee, Kevin Lee, Swapnil Mengade, Rebecca Wolfinger, Ayushuman Johri

 

The prototype showcases an 4 Player fighting game for the volumetric display Voxon VX1. Players control gummy bears, using their Android smartphones, in a free for all brawl as they try to knock each other off the stage. The prototype went through a few iterations, adding more visual fidelity and detail every version.

 

Video Credit to Ayushuman Johri

 

 

 

 

 

 

Interface Showcase  : Leap Motion, 2020

 

Team VolTech

Byungju Lee, Kevin Lee, Swapnil Mengade, Rebecca Wolfinger, Ayushuman Johri

 

This prototype showcases an interactive storytelling experience created for the volumetric display, Voxon VX1. The guest control the narrator's boat using a Leap Motion Controller as they traverse through an environment, following a story based on the poem 'Annabelle Lee' by Edgar Allen Poe.

 

Video Credit to Ayushuman Johri

 

 

 

 

 

Volumetric Display: Visual Experiment

 

 

Voxon VX1 + Unity Interactive Shader Experiment: Cube Wave , 2020

 

Voxon VX1, Korg Nano Kontrol2 Midi Controller, Unity

 

 

 

 

 

 

Voxon VX1 + Unity Interactive Shader Experiment: Blob , 2020

 

Voxon VX1, Korg Nano Kontrol2 Midi Controller, Unity

 

 

 

 

 

Looking Glass

 

 

The Looking Glass + Unity Interactive Shader Experiment, 2020

 

 The Looking Glass, Unity, Korg Mini Kontrol 2 Midi Controller

 

 

 

 

 

 

The Looking Glass + Unity Shader Experiment, 2020

 

 The Looking Glass, Unity

 

 

 

 

 

 

The Looking Glass + Ricoh Theta 360 Camera, 2020

 

The Looking Glass,  Ricoh Theta 360 Camera, Unity

 

 

 

 

 

 

Looking Glass Test 01, 2019

 

Intel RealSense D435i,  The Looking Glass, Unity

 

 

 

 

 

 

Looking Glass Test 02, 2019

 

Intel RealSense D435i,  The Looking Glass, Unity

 

 

 

 

 

OpenGL

 

 

 

OpenGL Demo, 2019

 

OpenGL Demo

 

 

 

 

 

Shader

 

 

 

Unity Shader Experiment: Blob, 2019

 

Shader Controlled with Midi Controller, Unity

 

 

 

 

 

 

Unity Shader Experiment: Lemon, 2019

 

Shader Controlled with Midi Controller, Unity

 

 

 

 

 

Other Interactive Experience

 

 

Kaleidoscope, 2019

 

Team Project, A semester, Unity, Cave Experience

 

Team Kaleidoscope has made an interactive installation exploring cultural implicit bias for the Askwith Kenner Global Languages and Cultures Room located in the new Tepper Quad at Carnegie Mellon University.

 

Kaleidoscope is chosen for SXSW 2020 Student Innovation Awards finalist

 

Producer: Vicky Lin, Jehan Sandhu

Programmer: Byungju Lee, Weizheng Lee, Ricardo Tucker

UX Designer: Amber Zheng

 

 

 

 

 

 

Oddly Satisfying: Building Virtual World 2018 Round 5

 

Team Project, 3 weeks, Unity, Cave Experience

 

Producer: Emily Kovalik

Programmer: Byungju Lee, Hye Lee Kim

Artist: So Young Han, Marissa Doerger

 

 

 

 

 

 

The Last ETCer: Building Virtual World 2018 Round 3

 

Team Project, 3 weeks, Unity, Leap Motion

 

Producer: Xiao He

Programmer: Byungju Lee, Xiao He

Artist: Min Pan, Yanyu Tong

Sound Designer: Mong-Yah Hsieh

 

 

 

 

 

 

Office: Building Virtual World 2018 Round 2

 

Team Project, 2 weeks, Unity, Meta 2(AR HMD)

 

Producer: Liam Philiben

Programmer: Byungju Lee, Wenyu Mao

Artist: Jinya Chen, Nidhi Ramanathan

 

 

 

 

 

 

Colors: Building Virtual World 2018 Round 0

 

Solo Project, 1 week, Unity

 

 

 

 

 

3D Modeling

 

 

 

Head Modeling, 2016

 

3D Modeling of Head using Blender

 

 

 

 

 

 

Body Modeling, In Progress

 

3D Modeling of Body using Blender

 

 

 

 

 

Photogrammetry

 

 

 

Photogrammetry Experiment, 2019

 

Photogrammetry Experiment using Agisoft Metashape Pro

 

 

 

 

 

Animation

 

 

 

Silly Animation, 2015

 

Modeling, Riging and Animation using Blender

 

 

 

 

 

Three.js

 

 

 

Three.js Experiment, 2016

 

This is an interactive experience in web browser, using three.js and Javascript.

modeling, rigging, and animation using Blender.

 

 

 

 

 

Motion Graphics

 

 

 

Motion Grapchics Demo, 2018

 

Motion Graphics with Adobe After Effects

Background Music: Herbie Hancock, Watermelon Man

 

 

 

 

 

Projection Mapping

 

 

Mapping Experiment, 2012

 

Adobe After Effects

Background Music: The  Z, Base  Clef

 

 

 

 

 

Digital Fabrications

 

 

 

Winged Victory of Samothrace with Buddha’s head, 2015

3D model collage and 3D printing Experiments

 

 

 

 

 

 

Face, 2015

3D scanning and Laser Cutting Experiments

 

 

 

 

 

Light Sculpture

 

 

 

 

Colors, 2013

Projector, PVC

 

 

Paintings and Drawings

 

 

 

Self Portrait, 2014

Acrylic Painting

 

 

 

 

 

 

Cello Human, 2013

Colored Pencil Painting

 

 

 

 

 

 

Monster, 2013

Colored Pencil Painting

 

 

 

 

 

 

House, 2013

Watercolor Painting

 

 

 

 

 

Typography

Adobe Illustrator

Illustrations

Adobe Photoshop