Recent advances in gaming software and technology have opened up new possibilities for contemporary art. Through a 2016 Martha Reed Coles Fellowship artist/Professor Jackie Brown and I spent the summer developing a build-your-own sculpture application to explore the potential for Google Virtual Reality (VR)—specifically Google Cardboard—to be used in a fine arts context. The build-your-own sculpture application offers viewers a chance to be inventive and imaginative in creating their own sculptures out of parts taken from Professor Brown’s work. With this application, Professor Brown and I aim to communicate core concepts of her sculptural work by offering viewers a dynamic, interactive experience that gives them creative agency and a means to explore concepts of growth and transformation.
We began the project by determining the best VR device to use with our application. Professor Brown and I chose Google Cardboard for its affordability and accessibility to a wide audience. The next step was to begin coding the application in Unity. My first iteration of code set up the basic mechanics of how the application would work. However, I realized part way through the coding process that it would be beneficial to reorganize and restructure the code in order to better optimize its functionality. Reorganizing the code was a substantial undertaking but was well worth the effort to improve this project and to broaden my skill set for future projects. After reorganizing my code, I was then ready to add Google VR capabilities to the project. Upon switching the project over to Google VR, I had to recode the application into a second coding language and completely restructure my user interface (UI) design since Google VR handles UI much differently than on the computer.
Alongside the coding process I used Xbox Kinect and Skanect software to scan in parts of Professor Brown’s sculptures and generate 3D models. These models could then be exported from Skanect into Unity and inserted as creative building blocks in the application. As the Kinect is a medium quality scanner, the scanned models of the sculptures are never exact replicas of the originals. Professor Brown and I deliberately chose to allow for these mutations as another manifestation of growth and transformation concepts.
Having created a solid application framework this summer, I look to further improve this project as part of an independent study this coming academic year (2016 -2017) with Professor Brown. Specifically, I wish to further user functionalities such as changing the scale and rotation of the building parts, viewing the sculpture creation in a guided 360˚ tour and allowing users to save/share their creations.