NewAgain

​

Marc-André Weibezahnn; Affine Tuning, programming

Nava Waxman: Sound composition, creative vision, performative research

 

NewAgain is an audio-focused research project about embodied interaction between humans and machines. Users (body) interact

with the computer in an ongoing feedback loop of movement and sound. The audio feedback is organised into dynamic compositions

that react instantly to the movement and posture of the body. The technology runs on a modern smartphone (iPhone) and is completely mobile. 

 

​

Rules of sound layers Ambient

A static loop.

Voice

• Raise hands over head: Voice gets stretched, delay effect

• Move any hand: Voice gets clearer (lowpass and reverb effect toned down)

• Distortion (bitcrusher effect) when the primary* hand is near the face (from a front view)

• Voice is muted when the back of the player faces the camera, except when the hands are

  stretched over the head

  String plucking

• Played on motion impulse of the secondary* hand.

• Delay effect activated by rotational movement.

  Percussion

• Activated by rotational movement. Distortion (guitar amp) effect applied when 2d distance of head and secondary* hand increases.

• Slowed down when distance of knee and head decreases.

  Glass

  Activated by the motion of the primary* hand

  * „Primary“ hand: Hand which was raised to give the start signal; the other hand is regarded the „secondary“

  Sounds chain

  Final mix ^
  |

| <- reverb <- bitcrusher <- delay <- timepitch <-lowpass <- voice |
| <- delay <- string pluck
|

| <- guitar effect <- timepitch <- percussion | | <- glass |

| <- ambient

I WANT TO BE NEW

AGAIN

​

The ambient layer was created using the EXA VR Infinite Instrument, as well as the sounding jars, which are experimental percussion instruments that I've been using in my performances (and they are painting on their right)

The final two dynamic layers were created using the darbuka, a Middle Eastern drum.

The flag is really intriguing. When the flag moves and sound is produced, there is a beautiful contradiction or contrast between the flag's substance and the sound. It also reminds me that raising a flag can have physical consequences, which might be accompanied by all kinds of wounds.

I also feel that the sound stretching is e-affective (in the middle). It can take a while for it to announce itself. This is because of a "gap" at the end of the loop. I'll edit that and create a new version that works better. However, in general, I think the sound fits well with the stretching of the body.

I'm experimenting with screen recording on the third iteration. Cinzia and Mahsa are being followed by the camera in Mobius (2019).

The vocal gesture has been elevated to a whole new level.

The machine is clearly unable to recognize the physical element, converting the abstracted form into a fluid, open-horizon gesture.

The tracking is significant despite the imprecise translation.

Second composition, without stretching effect.

The camera is sensing my movement despite being outside the frame. The drum slows when falling down.