+The Case Study, “BodySuit” and “RoboticMusic”
+RoboricMusic at AV Festival 06
+"Augmented Body and Virtual Body" at Utopiales 05
+"Augmented Body and Virtual Body" at Le Cube 06 +netBody-"Augumented Body and Virtual Body II"
+"RoboticMusic" at the 53rd Venice Biennale 2009
SuperPolm - VirtualAERI II
The Superpolm, Virtual Violin was built in 1996 . It was
originally intended for use in a piece I composed for IRCAM
in 1995 - 1996, entitled "VirtualAERI".
“BodySuit” (DataSuite), in which there 12 sensors
on each joint of body. The performer doesn't’t hold
anything on his hands, however, he can play as if he dances.
This is used in the composition, "o.m.2-g.i.-p.p.".
RoboticMusic is based upon the idea that the robot plays
the acoustic musical instruments. The robots consist of one
which plays a snare drum, one which kicks a base drum, one
which strikes cymbal, one which strikes a gong with the head,
and one which passes the air with pipes adapting the mechanism
of a woodwind instrument. FortissimoMechano is composed for
RoboticMusic in 2003.
used in this work are coming from Mille Plateaux of Deleuze
and Guattari and the radio piece of Antonin Artaud :
Pour en finir avec le jugement de Dieu. It's a visual and
sound montage that eliminates the notion of sense and history
and where the language is treated as an icon. The video image
shows real and 3D virtual bodies but the body of the performer
is present and can transform its images in real time. One
composes a body without organs, a CsO.
An Application of The System, “BodySuit” and “RoboticMusic”
The system contains both a gesture controller and automated mechanical instruments at the same time. In this system, the Data Suit, “BodySuit” controls the Percussion Robots, “RoboticMusic” in real time. “BodySuit” doesn’t contain a hand-held controller. A performer, for example a dancer wears a suit. Gestures are transformed into electronic signals by sensors. “RoboticMusic” contains 5 robots that play different sorts of percussion instruments. The movement of the robots is based upon the gestures of the percussionist.
Working together with “BodySuit” and “RoboticMusic,” the idea behind the system is that a human body is augmented by electronic signals in order to be able to perform musical instruments interactively. This system was originally conceived in an art project to realize a performance / musical theater composition.
RoboticMusic at AV Festival
RoboticMusic was presented at AV Festival 06, which was the UK’s newest, and largest, international festival of digital arts, music, and new media, on 3-4 March 2006, at The Sage Gateshead, in Newcastle. During 2 days, approximately 3000 people visited to RoboticMusic. This was enthusiastically received by the large public, as well as the mass medias. RoboticMusic was always shown as Interactive Installation during the days and the concerts for 4 times at the fixed time in each day. RoboticMusic was commissioned by AV Festival and was given the first performance and the exhibition in England.
"Augmented Body and Virtual Body" at Utopiales 05
In this Music Theater the robots and BodySuit are the main protagonists with live players, computer sound, video images, and text in the secondary roles. This is not a multimedia super-sensorium. On the contrary: the whole project concentrates on a single-minded reinforcement of the central theme: Augmented Body and Virtual Body. All structured by a richly-textured musical composition.
"Augmented Body and Virtual Body" at Le Cube
"Augmented Body and Virtual Body" is conceived as a music theater piece, that the elements cross and hybridize themselves in continual links/ratios of exchanges and flow without fixing itself towards any directions. The idea would be that what is real, which is artificial, what is virtual, on the verge of themselves, and to create relations of pure intensities, which degrees zero of expression without its value of positive or negative.
In this performance, we link the real world to the online reality of Second Life. We do this at the physical level: the bodily movements of a person in the real world control an avatar in Second Life, while an avatar’s movements guide a human being’s.
A movement-registering mechanism built into the BodySuit allows a person’s movements to directly control the behavior of an avatar in Second Life. Conversely, the Powered Suit contains motors that control the human body like a marionette. It is a sort of robot you can wear, controlled by an avatar.
Transhumanism is philosophy that talks about evolution of human's body and cognitive ability by using a new science and technology. Transhumanism is also research of expansion of human’s function with development of technology in future. The Transhumanist thinks that one should use these science and technologies so that man may become human that goes beyond the actual capabilities.
"RoboticMusic" at the 53rd Venice Biennale 2009 in Italy
The 5 robots play the musical instruments. These consist of Snare Drum, Bass Drum, Cymbal, Gong, and Pipe. These robots perform the percussion instruments, instead of human players. These robots are connected with a computer and are controlled by the program in a computer. These can play very complex music, which can’t be done by a human performer. These can play much faster or can play forever without any rest. This may allow creating music, which has never been able to listen in the past.
Cymatics is a kinetic sculpture and sound installation that expresses the artist's vision of nature through a series of symbolic elements that are used harmoniously in a technological context.
The idea of work is based upon the idea of performance on the context of new media, dance, music, and images, however it doesn't really belong to any style, in fact. The controllers of gestures and other continuations, such as Wifi and programming are originally developed. Utilizing this, the work explors the extension of the potentialities in the relationship of man and machine. This performance specially exploits the interaction between the the body of the performers and the video images and the body of the performers, and the image and architetual/lightning-like image on stage, which can transform in real-time, thanks to his BodySuit.
A movement of dancer is captured by Kinect as Motion Captured System, and it is transformed to be an avatar in virtual space. The avatar moves depending on the movement of dancer’s body, and at the same time, sounds and images are produced in real time. The dancer and the avatar together perform on a stage, thus the dancer in real space and the dancer in virtual space, who do the same movement, coexist simultaneously.