27 April 2022

Watching a film by ear: An acousmatic approach to cinema

Sound film is commonly expressed as the interplay between the audio and the visual. Since the 1920s, audiences’ cinematic experience has been dramatically transformed owing to the synchronization of sounds and motion pictures. The silent film era highlights its narration performance mainly by the continuous alternation between moving images and intertitles (title cards) while its score is accompanied by a pianist or an orchestra. With more diverse sound elements (dialogue, music, ambient sound, sound effects, etc.) being synchronized to motion pictures, sound film delivers an immersive experience and strengthens its storytelling. Cinematic audiences are required to engage more intensively in the cross-modal perception of hearing and seeing. This progression appears as a breakthrough for filmmakers and, simultaneously, new advanced perceptual challenges for the audiences’ eyes and ears.