Titles
Schedule

Society. Spaces. Screens

Part of the Mediated Cities Conference Series
Redefining Spaces: Immersive Storytelling through Multi-Screen Media and Spatial Sound
R. Meirelles(2) et al.
1:30 pm - 3:00 pm

Abstract

Lamentation at the Liesbeek is a collaborative, interdisciplinary project developed by a multidisciplinary group of faculty and students at Arizona State University’s Media and Immersive eXperience (MIX) Center. It reimagines historical and cultural narratives through the convergence of spatial sound and immersive visuals. The installation draws on the contested history of South Africa’s Liesbeek River to create a multi-sensory exploration of memory, displacement, and cultural resilience for live audiences. At its core, the project explores the interplay between sonic and visual storytelling. The installation integrates a 3-layered, 55-speaker object-based audio system with custom-designed spatial maps, enabling dynamic trajectories of sound. This system complements five projection screens that envelop the audience in a responsive and immersive environment. Spatial soundscapes dynamically interact with a visual landscape that occupies the same physical space via intentionally designed projection surfaces. The cohesion between audio and visual information exists irrespective of the viewer or listener’s location, mimicking real-world spatial dynamics. Field recordings of local environments, Khoisan oral traditions, ritualistic chants, and original sounds are interwoven with abstract visual narratives, bridging traditional storytelling practices with contemporary digital techniques. This presentation delves into the creative and technical processes behind the project, reflecting on interdisciplinary collaboration and how immersive storytelling transforms contested spaces into arenas for reflection and collective engagement. It celebrates the aesthetic possibilities of immersive technologies while positioning Lamentation at the Liesbeek’s installation as a case study in leveraging these technologies for cultural storytelling and social critique, offering insights for future cross-disciplinary and global projects.

Biography

Rodrigo Meirelles, Sonic Artist and Assistant Professor at ASU’s Sidney Poitier Film School, directs the Sonora Immersive Audio Lab at the MIX Center. With over 20 years in the audio industry, his expertise spans music, film, television, and immersive media. As Globo’s Sound Executive Supervisor, he oversaw award-winning productions and led innovations, including Brazil’s first Dolby Atmos live broadcasts. Rodrigo’s work focuses on immersive storytelling, cultural memory, and diversity, using collaborative approaches to explore sound’s transformative potential across disciplines and media.

Sven Ortel designs projections and imagery for immersive storytelling events in theatre, opera, dance, musicals, and beyond. Recent works include Thoughts of a Colored Man (Broadway), Parade (Broadway), and Once Upon A One More Time (Broadway), as well as creative direction for NHWK4220 at New York’s Artechouse. His work for Disney’s Newsies won him a TONY nomination. He is a professor of practice in immersive and entertainment design at ASU and a faculty member at Mesa’s innovative multidisciplinary MIX center, where he educates the next generation of designers, artists, and thought leaders.

Celia Yang is a Tonmeister, sound artist, and researcher working to enhance the practical and artistic aspects of multimedia technologies through expanded engagement in an interdisciplinary environment. She is currently pursuing her Ph.D. in Media Art and Sciences at Arizona State University. Her interests focus on acoustic ecology and emerging fields of immersive ambisonic technologies to encourage community engagement, increase sonic awareness, and create a connection to the ecosystem. She is currently working on the environmental listening project to quantify environmental psychoacoustics metrics to design and manage acoustic ecosystems that contribute to the well-being of society, social impact and ecosystem balance.

Masaran Keita is a senior at Arizona State University, pursuing a Bachelor of Fine Arts in Film and Media Production. Since specializing in audio in 2023, she has gained extensive experience in post-production roles, including editing, recording, mixing, and sound design. In 2024, Keita deepened her focus on immersive audio and its applications in extended reality technologies, further honing her expertise in theatrical workflows and Dolby Atmos mixing. Her contributions were instrumental in the development of Lamentation at the Liesbeek. Post-graduation, Keita aims to broaden her expertise in audio across film and live sound mediums.