“dissonant imaginary” focuses on the relationship of visuals and sound, using the cross modal attention phenomenon to create the audio-visual installation. The relationship between brain activity, sensibility, sensation, and input image and sound has been a inexhaustible interest with a long history.
The detection and analysis of electroencephalogram or EEG has been attempted in the past for its inexpensive and manageable nature, but as it can only acquire the sum total of the various brain activity happening at a single moment, vague descriptions such as “whether the subject is awake or not” could only be used. Therefore, the use of brain activity analysis alongside art has been conceptualized without any large result for a longtime.
Daito Manabe, who has been creating works through the relation of mathematics and bodily expression, has been previously experimenting with the usage of deep neural networks (DNN) alongside advanced science research such as neural activity.
On the other hand, Kamitani Yukiyasu laboratory at Kyoto University / ATR has been developing technology ahead of the world that analyzes the state of mind through technology called “brain decoding” which utilizes human brain activity pattern measured by functional magnetic resonance imaging (fMRI) alongside pattern recognition by machine learning. In recent years, the usage of large scale databases alongside DNN and “brain decoding” to analyze arbitrary objects perceived from the brain activity pattern has attracted much attention around the world.