First achievement based on the “Smart Hand Computer” concept. (State commission made to Vincent Raphaël CARINOLA, creation of the piece during the 2018 Music Biennial in Lyon with the GRAME, performed by Jean GEOFFROY). Development: Christophe LEBRETON

Virtual Rhizome is for a performer holding in each hand a SHC containing the same “VRhizome” application. (available on AppleStore – compatible iOS version 10 or higher with iPhone 5s or newer models)

The algorithm consists of 23 states (situations) linked together to form a circle (see diagram below)

the content of each state is described in the spreadsheet supplied with the score.

As a general rule, we find most of the time:

• a fixed looping sound without interaction chosen at random from a predefined list
• a short sound when changing state randomly chosen from a predefined list
• controllable sound:
  • in volume via the Y touchscreen interface.
  • If you do not touch the screen the sound is off.
  • variation of the sound in real time via XY and Gyrospeed projection depending on the case.

Note by the composer Vincent Raphaël CARINOLA :

Virtual Rhizome is akin to an open work, i.e. a work whose score would be closer to a navigation map than to the fixed time unfolding specific to the traditional musical scope.

The interpreter goes through all situations and explores the possibilities of combinations offered by the use of the two smartphones. While the choice of sound material, types of processing and their succession respond to a clear concern for writing, an important part of the result depends on the acuity of the performer and his ability to reveal a world that he must explore.

The graphic score describes a driving pattern, among other possible ones, going through the 23 situations, indicating their succession for each smartphone. It comes from the interpretation of Jean GEOFFROY, dedicatee and creator of the work. These are suggestions for situational arrangements, from which the interpreter can depart depending on the choices of expression derived from the personal exploration of the architecture of the work.

Several other readings remain open to exploration and it is these readings that constitute an essential part of Virtual Rhizome‘s interpretation. It is thus quite possible to play several cycles (a cycle is a course of 1 to 23) by favouring, in each cycle, the exploration of certain situations (such as a round form). Or, to go through the situations start with the 23 and finish at the 1. Or combine a reading from 1 to 23 with one hand and a 23-1 reading with the other, exploring situations far apart, in a path that produces a symmetrical shape (like a “crayfish” cannon).

Score “Virtual Rhizome” : Download

Technical Rider ” Virtual Rhizome” : Download

Composer’s website Vincent Raphaël Carinola : Link

iOS app o play “Virtual Rhizome” : “VRhizome”

Note: In the score, the vocabulary used to describe the movements to be performed depend on an initialization position

The smartphone contains a program that generates sounds from the gesture of the interpreter. This program consists of different sound states, interconnected to form a global algorithm.

The interpreter can change state from a predefined particular gesture.

Algorithmic structures and sound content are infinitely available. The smartphone must be able to withstand the computing power required for one state at a time. It must also integrate 9 sensor axes: 3 accelerometers, 3 gyroscopes, 3 magnetometers.

The amplification of the smartphone in concert must be done via a standard or wired UHF system, in order to transmit the integrity of the audio bandwidth to the broadcast system, without any discernible latency.

Combination of a tactile and gestural interface :

-Tactile -> the smartphone screen is made up of 2 zones:

• The first allows you to modulate finger position settings on the screen in x and y.
• the second allows you to edit state volume settings to adapt to new broadcast contexts. This access must be hidden during the game.

An SHC shell is recommended to limit access to the interface during the game and secure the connection of the mini-jack. A 3D printing model is available below in the “Download” section. It was designed for iPhone type 5s or SE with a 4-point mini-jack connector from HICON.

-Gestural -> the 9 axes of the sensors built into the smartphone allow to discriminate the following gestures:

• shock: rapid acceleration on a particular axis of the smartphone
• gyrospeed: smartphone rotation speed
• XY projection: two-dimensional projection of the smartphone’s orientation in relation to its 3D orientation

• The smartphone is connected via its stereo output to 2 UHF transmitters. This allows the sound to be broadcast without latency to any type of sound broadcast device. Wireless systems can be replaced with a wired connection.
• It is necessary to make a specific cable to connect to THE UHF transmitters according to the brand of the systems used.
• It is advisable to make a shell for the smartphone in order to secure the mini-jack connection during the game and reduce the access of the touch screen to the bare minimum.
• In rehearsal just plug in a headset. If using 2 Smartphones simultaneously the use of a small mixer will be necessary (DJ type for smartphone)

iOS compatible application :

• An SHC app once downloaded and installed on the smartphone does not require any wifi connection to work. it is completely autonomous.
• For some achievements, an OSC (Open Sound Control) message transmission can be used to control video or any other device.

• a sound state or situation is a program made from the open source FAUST (GRAME) language. This one contains sounds and descriptionof interactions. Sounds can be synthesis or audio files on which real-time processing can be applied.
• Changes in settings can be either related to the gesture interface and/or pre-programmed.
• A change of sound state, goes through a very short fade-out of the current state, its mute, then the activation of the next state and its fade-in. This helps to limit the CPU overload between two states.

LiSiLoG uses the FAUST language in a specific Xcode project and adapts it according to the projects in order to assemble all the necessary components.

This technology is used in order to create a stable instrument for the performer. Currently these applications are only developed for iOS because of the unmatched performance of this operating system for real-time embedded applications.

Communication between the sensors and audio processing is optimal due to their integration into the same unit (no wireless transmission with risks of loss of information and latencies).

This last point is very important for a musician who must be able to develop his playing with a reactive and stable instrument.

For example to play “Virtual Rhizome” by Vincent Carinola two SE iPhones or 5s are sufficient and easy to find used.

Why is the application paid for ?
The “VRhizome” application is paid to partially support the blows of its publication on the Apple Store which takes a very large percentage of commission, and requires paying each year a developer license.

In principle, this application is a material linked to the musical work, and as any publisher practices this material at once.

Here, it is not a question of a rental but of an acquisition, and the advantage of going through the AppleStore means that the application is directly downloadable and usable, without going through a request from its publisher.

Christophe Lebreton

iPhone SE or 5+ case .STL file with 4 pts HICON mini-jack: 3D printer iPhone SE SHC VR04

Cable schematics iPhone to UHF: Cable iPhone to UHF