AR Audio Design: Transforming Quebec Rap into an Immersive Experience

Quebec rap has taken centre stage at the Musée de la civilisation in Quebec City. This ground-breaking project invites visitors to immerse themselves in the heart of Quebec hip-hop culture through a 3D audio experience and interactive soundscapes that blur the boundaries between physical and virtual realities.

At the Museum XR Summit, Dominique Boileau and Isa Mailloux from Musée de la civilisation share the story behind the project.

Cutting-Edge AR Audio Technology

At the heart of the initiative is the Audio Augmented Reality Device (AARD), or “DESA” in French. This advanced headset captures the real-time position and orientation of visitors, transforming their movements into a dynamic auditory journey. By combining cutting-edge technology with rich cultural storytelling, the project offers a deep dive into the history, culture, and evolution of Quebec rap.

Exploring Quebec Hip-Hop Culture

Collaborating with renowned artist and historian Webster, Boileau and her team explored Quebec hip-hop’s journey from the late 1970s to today. Beyond music, the exhibition delves into key aspects of hip-hop culture, such as breakdancing, and sheds light on the challenges faced by the community over the decades. Central to the initiative is a commitment to amplifying the voices of Quebec’s hip-hop artists, bringing their stories to mainstream audiences.

Overcoming Challenges in AR Audio Design

One of the project’s main challenges was creating a soundscape that captured the energy of live performances and beatboxing without overwhelming visitors. To achieve this, the museum partnered with technology experts and sound specialists to develop a proprietary system. This system integrates real-time positional tracking, a Unity-based application, and the Wwise sound engine, creating a seamless and immersive experience.

A Personalised Audio Journey

The exhibition reimagines the museum space as a dynamic audio environment. Visitors’ movements shape their personalised sound experiences, with carefully crafted transitions maintaining engagement throughout. Spanning over 400 square metres, the exhibition features a rich variety of audio content, including music, interviews, and personal narratives—much of it created specifically for the project by members of the Quebec hip-hop community. Visitors are encouraged to spend over an hour exploring the content in detail.

Collaboration and Innovation in Sound Design

The audio identity of the project was developed in collaboration with Montreal’s Saga Stratégie Sonore. By blending elements of video games, documentaries, podcasts, and mixtapes, the team created a new form of narrative storytelling. Through workshops and testing, they established the foundational principles of sound design for this extended reality framework, ensuring each audio layer complemented the spatial design and enhanced the sensory experience.

Pioneering the Future of AR Audio Exhibitions

The creation of the exhibition was not without its obstacles. Developing the technological infrastructure alongside the exhibition content posed significant challenges. Synchronising audio with visual and spatial elements required extensive prototyping and testing. Despite these hurdles, the team successfully delivered a pioneering exhibition that sets a new benchmark for audio-augmented reality experiences.

What’s Next for AR Audio Design?

The Musée de la civilisation is already looking to the future, applying the insights gained from this project to upcoming exhibitions. One such initiative will focus on the experiences of refugees, further exploring the potential of audio-augmented storytelling. The museum also aims to integrate virtual reality and other emerging technologies, pushing the boundaries of immersive visitor experiences.

A New Era of Cultural Engagement

This innovative project not only showcases the cultural richness of Quebec hip-hop but also highlights the transformative power of sound and music in museum storytelling. It stands as a testament to creative collaboration and technological innovation, paving the way for a new era of cultural engagement.