Investigating how research in 3D sound and signal processing technology can change the way that people experience artistic performances.
This project looks at how the technology of perceptual sound field recording, reconstruction and synthesis, created by the Centre for Telecommunications Research (CTR) at King's, has the ability to change the soundscape contours of physical environment. It explores how this technology enables artists to control the soundscape in a way that fundamentally changes not only the nature of artistic performance, but also how performance is experienced.
In collaboration with industry leaders 59 Productions, Fidelio Arts and artist Dr Ali Hossaini, King's Department of Informatics is seeking to create a groundbreaking 'experience' that puts the audience at the heart of a performance while also showcasing cutting edge recording, broadcasting and signal processing technologies.
Soundscape uses new technology to reproduce a concert performance by pianist Yuja Wang as a 3D digital art installation, featuring bespoke filmed and animated elements that ‘come to life’ and offer audiences a visual perspective on the music. By using 360 degree sound, the piece will feel truly immersive, enhancing the performance and drawing a new audience into this type of music.
The new 3D sound technology will be implemented within a gaming platform, which will be used to reach out to a range of companies that deal with 3D sound production (virtual/augmented reality, home theatre, music recording, and art installation).
A workshop sharing performance by Yuja Wang was held at King's on 24 August 2016 and recorded using Soundscapes technology in a custom-built ‘black box’ space that was projected into an adjoining space.
You can read a report of the event in King's Spotlight here.
A further workshop was held on 29-30 October 2016 in conjunction with another King's project, Connected culture, for which the project team provided the soundscapes.
The team are also providing the soundscapes for the next Connected Culture workshop on 26 January 2017, which will use an array of cameras, monitors and projectors to experiment with ways of creating a live and visually dynamic stage that crosses several spaces.
Professor Zoran Cvetkovic
Zoran Cvetkovic is Professor of Digital Signal Processing in the Centre for Telecommunications Research, Department of Informatics, King's College London. His research focuses on with an emphasis on time-frequency analysis, wavelets, filter banks, A/D conversion, quantization, source coding, compressed sensing, and applications in audio and speech technologies, telecommunications and biomedical engineering.
Richard Slaney is Creative Director at 59 Productions Ltd. He specialises in interaction and digital design, as well as consultancy on digital strategy for arts organisations. Recent projects include Digital Revolution, a new exhibition of digital creativity opening at the Barbican Centre and 'Lighting the Sails' of Sydney Opera House as part of Vivid Live 2014. Before joining 59 Productions, Richard was the Head of Digital for the Philharmonia Orchestra (London) and Managing and Creative Director of Rite Digital, a digital production company owned by the Philharmonia.
Fidelio Arts is a boutique artist management company built around the premise of developing projects and artist careers beyond the standard concert performance business. From digital initiatives, to residencies, educational initiatives and tours, they work to create broader acceptance of classical music at all levels in society.
Dr Ali Hossaini
Ali Hossaini is an artist, philosopher and writer. He is CEO of Cinema Arts Network, an Associate of Lord Cultural Resources and Research Fellow in Department of Informatics, King’s College London. In 2013 he completed construction of Britain’s Network for the Arts, a national broadband project that supports culture and creative enterprise in cities across the United Kingdom. He is widely sought as a speaker on culture tech – the intersection of creativity and technology – and he is completing a volume on digital museum planning for Rowman & Littlefield in 2016.
Dr Enzo De Sena
Enzo de Sena is Lecturer (Assistant Professor) in Audio at the Institute of Sound Recording, University of Surrey. A former Marie Curie Fellow, his current research interests include room acoustics modelling, surround sound, microphone beam forming and binaural modelling. His focuses on perceptually-motivated methods, and aims at bridging the gap with physically-motivated ones.
Dr Huseyin Hacihabiboglu
Huseyin Hacihabiboglu is Associate Professor at the Midde East Techincal University (METU), Graduate School of Informatics, Ankara, Turkey. His research interests include 3D and spatial audio systems, room acoustics, audio and acoustical signal processing, game technologies, virtual environments, acoustical measurements, microphone arrays, procedural sound, theory of signal processing, UX in games.
Soundscapes is a collaboration between King’s Department of Informatics, 59 Productions, Fidelio Arts, and Dr Ali Hossaini, brokered and supported by the Cultural Institute at King’s.