Sound for 3D Cinema and the Sense of Presence

in Nees, Michael A.; Walker, Bruce N.; Freeman, Jason (Eds.) Proceedings of the 18th International Conference on Auditory Display (2012, June 18)

While 3D cinema is becoming more and more established, little effort has focused on the general problem of producing a 3D sound scene spatially coherent with the visual content of a stereoscopic-3D (s-3D ... [more ▼]

While 3D cinema is becoming more and more established, little effort has focused on the general problem of producing a 3D sound scene spatially coherent with the visual content of a stereoscopic-3D (s-3D) movie. As 3D cinema aims at providing the spectator with a strong im- pression of being part of the movie (sense of presence), the perceptual relevance of such spatial audiovisual coherence is of significant interest. Previous research has shown that the addition of stereoscopic informa- tion to a movie increases the sense of presence reported by the spectator. In this paper, a coherent spatial sound rendering is added to an s-3D movie and its impact on the reported sense of presence is investigated. A short clip of an existing movie is presented with three different sound- tracks. These soundtracks differ by their spatial rendering quality, from stereo (low spatial coherence) to Wave Field Synthesis (WFS, high spatial coherence). The original stereo version serves as a reference. Results show that the sound condition does not impact on the sense of presence of all participants. However, participants can be classified according to three different levels of presence sensitivity with the sound condition impacting only on the highest level (12 out of 33 participants). Within this group, the spatially coherent soundtrack provides a lower reported sense of presence than the other custom soundtrack. The analysis of the participants’ heart rate variability (HRV) shows that the frequency-domain parameters correlate to the reported presence scores. [less ▲]

3D Audio Acquisition and Reproduction Systems

Scientific conference (2011, February 23)

This presentation introduces two different research projects dealing with 3D audio for 3D-stereoscopic movies. The first project “3D audio acquisition for real time applications” studies the best method ... [more ▼]

This presentation introduces two different research projects dealing with 3D audio for 3D-stereoscopic movies. The first project “3D audio acquisition for real time applications” studies the best method for acquiring a full 3D audio soundscape on location and for processing it in real-time for further reproduction. The second project “Adding 3D sound to 3D cinema” is aimed towards the study of reproducing a 3D soundscape consistent with the visual content of a 3D-stereoscopic movie. These projects are linked together since they present both ends of the 3D audio chain. They are conducted as part of the “MEDIATIC – 3D MEDIA” project, which concerns the production, the processing, and the exploitation of rich audiovisual content, with a specific focus on 3D video imagery. [less ▲]

Adding 3D sound to 3D cinema: new challenges and perspectives

Poster (2010, May 18)

Adding sound to movies: Historical trends and new challenges of 3D cinema

Conference (2009, December 03)

Very little research has been done so far in producing 3D sound and audio that are consistent with the 3D stereo video being viewed by the spectator. After a review of the currently used techniques for ... [more ▼]

Very little research has been done so far in producing 3D sound and audio that are consistent with the 3D stereo video being viewed by the spectator. After a review of the currently used techniques for theater sound reproduction, this talk presents new challenges of 3D cinema in terms of sound reproduction and analyse which known 3D audio techniques are able to tackle those challenges. [less ▲]