Arbora

Sphere2: Arbora
Sculpture
3D printing, custom-made electronics, custom-made software, sound
3D modelling: Tanja Vujinovic
Programming and custom-made electronics for Arbora object: Dr. Vid Podpečan, Department of Knowledge Technologies, Institute Jozef Stefan
Custom-made electronics for Arbora Protectors objects: Gregor Krpič
3D printing: RogLab
Consulting: Jan Kušej, Tomo Per
Project is supported by The Department of Culture of Municipality of Ljubljana
Production: Ultramono and SciArtLab, Department of Knowledge Technologies, 2019
Project is supported by Department of Culture of the City of Ljubljana and The Ministry of Culture of the Republic of Slovenia

Arbora is infused with a neural network that understands and responds to human emotions. Arbora and three protector objects are inspired by the plants of the Carboniferous era. Outer surfaces of objects are covered with bark that resembles scales, much like the Lepidodendron tree that existed approximately 300 million years ago. Fossils of this plant sparked the imagination of our ancestors and might even be responsible for the imaginary conception of dragons. Emerging from the cloud of mythology, three protector objects are synthetic young trees grown in software. They resemble sprouts and like three ancient Greek gods of medicine, Telosphoros, Hygieia and Asclepius, monitor and reflect the overall environment of the AvantGarden.

Arbora senses the emotions expressed in the voice. Our voices can give clues about both the physiological and emotional state we are in. A specially developed and trained deep neural network deciphers the emotional components encoded in the captured voice in order to model a soothing binaural sound.

Custom-made electronics placed inside the object are Raspberry-Pi, a module with four microphones, and with headphones placed on the stand and connected to the Raspberry-Pi. Arbora should react to the voices of people in their vicinity who wish to interact with them.
 For this purpose, we developed a deep neural network model that analyses sound captured from space. Software is written in Python programming language using several libraries like num.py and others. A neural network is constructed based on the Tensor Flow open code library that enables the development of models for machine learning. Tensor Flow previously trained on the Ravdess database was implemented for this purpose. This database is made of voices of actors pronouncing the same sentences with different emotional input. The mechanism of this action is that the sound is captured and stored temporarily in the sound buffer. After this, the sound properties pre-assigned to each detected emotion are generated and played through the headphones. Since we wanted to create the situation within which the object would subtly react to a human voice, binaural beats were chosen as one possible type of sound interaction. By doing so in synergy with its environment, Arbora, together with its helpers, works towards improving our well-being.

Arbora

Sphere2: Arbora
Sculpture
3D printing, custom-made electronics, custom-made software, sound
3D modelling: Tanja Vujinovic
Programming and custom-made electronics for Arbora object: Dr. Vid Podpečan, Department of Knowledge Technologies, Institute Jozef Stefan
Custom-made electronics for Arbora Protectors objects: Gregor Krpič
3D printing: RogLab
Consulting: Jan Kušej, Tomo Per
Project is supported by The Department of Culture of Municipality of Ljubljana
Production: Ultramono and SciArtLab, Department of Knowledge Technologies, 2019
Project is supported by Department of Culture of the City of Ljubljana and The Ministry of Culture of the Republic of Slovenia

Arbora is infused with a neural network that understands and responds to human emotions. Arbora and three protector objects are inspired by the plants of the Carboniferous era. Outer surfaces of objects are covered with bark that resembles scales, much like the Lepidodendron tree that existed approximately 300 million years ago. Fossils of this plant sparked the imagination of our ancestors and might even be responsible for the imaginary conception of dragons. Emerging from the cloud of mythology, three protector objects are synthetic young trees grown in software. They resemble sprouts and like three ancient Greek gods of medicine, Telosphoros, Hygieia and Asclepius, monitor and reflect the overall environment of the AvantGarden.

Arbora senses the emotions expressed in the voice. Our voices can give clues about both the physiological and emotional state we are in. A specially developed and trained deep neural network deciphers the emotional components encoded in the captured voice in order to model a soothing binaural sound.

Custom-made electronics placed inside the object are Raspberry-Pi, a module with four microphones, and with headphones placed on the stand and connected to the Raspberry-Pi. Arbora should react to the voices of people in their vicinity who wish to interact with them.
 For this purpose, we developed a deep neural network model that analyses sound captured from space. Software is written in Python programming language using several libraries like num.py and others. A neural network is constructed based on the Tensor Flow open code library that enables the development of models for machine learning. Tensor Flow previously trained on the Ravdess database was implemented for this purpose. This database is made of voices of actors pronouncing the same sentences with different emotional input. The mechanism of this action is that the sound is captured and stored temporarily in the sound buffer. After this, the sound properties pre-assigned to each detected emotion are generated and played through the headphones. Since we wanted to create the situation within which the object would subtly react to a human voice, binaural beats were chosen as one possible type of sound interaction. By doing so in synergy with its environment, Arbora, together with its helpers, works towards improving our well-being.

References.

References.

Leila Chaieb, Elke Caroline Wilpert, Thomas P. Reber and Juergen Fell, Auditory beat stimulation and its effects on cognition and mood states, Frontiers in Psychiatry, Volume 6, Article 70, May 2015.

Shotaro Karino, Masato Yumoto, Kenji Itoh, Akira Uno, Keiko Yamakawa, Sotaro Sekimoto, and Kimitaka Kaga, Neuromagnetic Responses to Binaural Beat in Human Cerebral Cortex, Journal of Neurophysiology, 96: 1927–1938, 2006.
Stoneman, Lisa, and Dorothy Belle Poli. Drawing New Boundaries: Finding the Origins of Dragons in Carboniferous Plant Fossils. Leonardo, Nov. 2017.

Previous
Previous

Fontana

Next
Next

Genera