Vienna Talking Faces (ViTaFa): A multimodal person database with synchronized videos, images, and voices
- Author(s)
- Christina Krumpholz, Cliodhna Quigley, Leonida Fusani, Helmut Leder
- Abstract
Social perception relies on different sensory channels, including vision and audition, which are specifically important for judgements of appearance. Therefore, to understand multimodal integration in person perception, it is important to study both face and voice in a synchronized form. We introduce the Vienna Talking Faces (ViTaFa) database, a high-quality audiovisual database focused on multimodal research of social perception. ViTaFa includes different stimulus modalities: audiovisual dynamic, visual dynamic, visual static, and auditory dynamic. Stimuli were recorded and edited under highly standardized conditions and were collected from 40 real individuals, and the sample matches typical student samples in psychological research (young individuals aged 18 to 45). Stimuli include sequences of various types of spoken content from each person, including German sentences, words, reading passages, vowels, and language-unrelated pseudo-words. Recordings were made with different emotional expressions (neutral, happy, angry, sad, and flirtatious). ViTaFa is freely accessible for academic non-profit research after signing a confidentiality agreement form via osf.io/9jtzx/ and stands out from other databases due to its multimodal format, high quality, and comprehensive quantification of stimulus features and human judgements related to attractiveness. Additionally, over 200 human raters validated emotion expression of the stimuli. In summary, ViTaFa provides a valuable resource for investigating audiovisual signals of social perception.
- Organisation(s)
- Department of Cognition, Emotion, and Methods in Psychology, Department of Behavioral and Cognitive Biology, Vienna Cognitive Science Hub
- External organisation(s)
- Konrad-Lorenz-Institut für Vergleichende Verhaltensforschung
- Journal
- Behavior Research Methods
- No. of pages
- 18
- ISSN
- 1554-351X
- DOI
- https://doi.org/10.3758/s13428-023-02264-5
- Publication date
- 11-2023
- Peer reviewed
- Yes
- Austrian Fields of Science 2012
- 501011 Cognitive psychology, 501006 Experimental psychology, 501026 Psychology of perception
- Keywords
- ASJC Scopus subject areas
- Experimental and Cognitive Psychology, Psychology(all), Developmental and Educational Psychology, Arts and Humanities (miscellaneous), Psychology (miscellaneous)
- Portal url
- https://ucris.univie.ac.at/portal/en/publications/vienna-talking-faces-vitafa-a-multimodal-person-database-with-synchronized-videos-images-and-voices(f3f301fe-3812-4247-913f-25fbe5d72e10).html