DEMOS

The following projects showcase my recent explorations in augmented reality, projected interfaces, and electronic sculptures. These demos are the result of the rapid application of new technologies and programs, and were each conceptualized and produced in under three weeks. The documentation of these demos aims to highlight my current fields of artistic inquiry and experimentation.

The objective of this demo was to project an interactive code-generated fluid simulation on actual fluid. This was achieved by creating a water vapour screen, encapsulated in glass, and back-projecting the real-time fluid visualization onto the surface.

When a viewer stands in front of the projection, they are tracked using a Webcam and Posenet, a machine-learning model that facilitates skeleton tracking. The data obtained from Posenet is used to influence the fluid simulation, which is generated in real-time utiizing p5.js, This allows the viewer to manipulate the projected fluid simulation with their movement. 

This project titled, “Tongue and Lotus Morph” was created for the Occupy Earth exhibition, held in Vare Gallery at Aalto University. This exhibition was the product of a collaborative course with Parsons University, which explored various topics of anthropocene, climate disruption and our complex relationship with non-human entities.

The piece features a graphite illustration of tongues arranged in the shape of a lotus flower, with stamens protruding from the center. This illustration acts as a trigger for an animation which can be viewed through an augmented reality application on an Ipad. When visitors position the Ipad in front of the illustration, they witness the image come to life, as the tongues slowly coil and unfurl. This animation mimics the blossoming of the flower, as well as the natural motion of a human tongue.

"It is like becoming accustomed to something strange, yet it is also becoming accustomed to strangeness that doesn’t become less strange through acclimation." -Thomas Morton, "Dark Ecology"

In the early 1900's, professors at the University of Art and Design Helsinki would occasionally travel out of the country to acquire unique and exotic textbooks for their classes. The Dekorativ Vorbilder is one such text. Printed in 1894, the illustration and ornamental design book was published in Berlin, at one of the oldest family-run publishers concerning architecture, art, and design in Germany. The book includes dozens of pages of hand-drawn illustrations, vastly ranging in content and style. 

Due to conservation practices, this book is stored in the basement of the Aalto Archives and is not easily accessible to students. Driven by the desire to illuminate the intricate illustrations, I have created an Augmented Reality animation that facilitates the rediscovery of the pages of the Dekorativ Vorbilder. 

A page from the Dekorativ Vorbilder can be seen on display at the Aalto University Archives. Adjacent to the page is an iPad, which visitors are prompted to pick up and study the page through the front camera lens on the device. The page acts as trigger for an augmented reality animation. The video showcases multiple pages from the Dekorativ Vorbilder, cinematically animated to reflect the mediums and intricate content found in the original artifact. The pages of the once hidden book, are dynamically reinterpreted to engage a new generation of students and visitors.

This motorized creature was fabricated for a course titled “Programming for Sculptors,” which taught the basics of utilising an Arduino Micro-Controller to facilitate the construction of kinetic sculptures.  For my demo I created a shaggy creature, employing an Arduino, a servo motor and upcycling a rug. 

First, I constructed an internal skeleton from small wooden skewers. Second, I cut and attached pieces of the rug onto the various layers of the skeleton. Third, I programmed the motor to move the skeleton at various speeds and increments, resulting in a natural and fluid-like motion that ripples throughout the body of the sculpture. 

This demo is the result of my first experimentations with Kinect and Processing. For this project I hung a large ream of paper from multiple trees situated in a seaside forest on the Otaniemi Campus. This paper acted as a long overhead screen. Underneath the screen, I positioned two projectors and a Kinect, which was used to track the position of viewers.

When a viewer is underneath the projection they can see their position reflected as a small star in space in the overhead projection. The real-time visualization is created in Processing, which obtains the position of the viewer from the Kinect and utilizes that data to create a kinetic network of stars. As the participant moves, the star follows their movement and connects to other stars in the space, triggering atmospheric bell sounds.

This demo features a 3D printed hand, attached to four servo motors and a distance sensor, positioned inside two white boxes with spandex screens. When a participant reaches their hand to touch the right screen, the distance sensor triggers the motors to enable the robotic hand to touch back on the left screen. The motors are attached to each finger with clear fishing line. When the line is pulled by the motors, it causes each finger to move.

“The first language humans had was gestures. There was nothing primitive about this language that flowed from people’s hands, nothing we say now that could not be said in the endless array of movements possible with the fine bones of the fingers and wrists.” -Nicole Krauss, The History of Love

This project utilizes a self-constructed X—Y plotter and webcam to track the face of the viewer as they move in front of the display. The face tracking data is provided by an application called FaceOSC, which communicates with an Arduino, to move the X—Y Plotter in coordination with the viewer’s face.

Another demo, as pictured below, shows a magnet being attached to the X—Y plotter, which enables the plotter to move a magnetised liquid known as ferrofluid. The ferrofluid is suspended above the plotter in a plastic container filled with isopropyl, sugar, soap, and water. The result of this process is a magnetised kinetic liquid that reflects the motion of the viewer.