Research

Current Research Projects at our Department
  • JenTower Seminar Room
    Image: Simone Dahmen
    Our Research Seminars

    Our Research Seminars are regular talks featuring current research from investigators of our department, research units or partners.

Perception

  • Audiovisual Integration in Speech and Speaker Perception

    Abstract

    We are able to understand speech more efficiently if we are able to see the speaker´s lips moving, in addition to the acoustic signal. The so-called McGurk illusion demonstrates that the visual signal has an involuntary influence on the perception of the spoken sound. Brain imaging methods have shown that attending to a speaking face activates areas in the auditory cortex even when acoustic stimulation is absent. It seems therefore, that in speech perception, the visual signal is able to directly modulate acoustic processing. In addition to speech perception, voices and faces are also naturally important sources of information for the recognition of people. As the result of a successful pilot study in our laboratory, this project investigated, for the first time,  the integration processes involved in person recognition. The main aims were: (1) to explore the required conditions and the mechanisms of this phenomenon, (2) to investigate the neuronal correlates of the integration processes for person recognition, (3) to compare the audiovisual integration processes involved in person recognition and speech recognition. The intention of this project is to attain a better understanding of person recognition in everyday conditions, where dynamic audiovisual processing regularly occurs. The results of this project so far have indicated that audiovisual face-voice integration is an important factor in the recognition of people, depends on familiarity with a speaker, shows sensitivity to temporal synchronization of the facial and vocal articulation, and can occur in a bidirectional manner. Moreover, event-related brain recordings suggested multiple loci of audiovisual integration. Specifically, perceiving time-synchronized speaking faces triggers early (~50-80 ms) audiovisual processing, although audiovisual speaker identity is only computed ~200 ms later.

    People

    • Jürgen M. Kaufmann, Jena, Germany
    • Nadine Kloth, Münster, Germany. WebsiteExternal link
    • David Robertson, Peebles, UK
    • Stefan R. Schweinberger, Jena, Germany
    • Verena G. Skuk, Jena, Germany
    • Romi Zäske, Jena, Germany
    • Celina von Eiff, Jena, Germany

    Funding

    • DFG-Projekt Schw 511/6-1
    • DFG SPP2392 Visual Communication,
    • DFG Projekte Schw 511/25-1,
    • Schw 511/25-1,
    • EI 1357/1-1

    Selected Relevant Publications

    • Estudillo, A.J., Kaufmann, J.M, Bindemann, M., & Schweinberger, S.R. (2018). Multisensory Stimulation modulates Perceptual and Post-perceptual Face Representations: Evidence from Event-Related Potentials. European Journal of Neuroscience, 48(5), 2259-2271. (Link to PDF)External link
    • Robertson, D.M.C., & Schweinberger, S.R. (2010). The role of audiovisual asynchrony in person recognition. Quarterly Journal of Experimental Psychology, 63, 23-30.
    • Schweinberger, S.R. (2013). Audiovisual integration in speaker identification. In: P. Belin, S. Campanella, & T. Ethofer (Eds.) Integrating Face and Voice in Person Perception (pp. 119 - 134). New York, Heidelberg: Springer.
    • Schweinberger, S.R., Casper, C., Hauthal, N., Kaufmann, J.M., Kawahara, H., Kloth, N., Robertson, D.M.C., Simpson, A.P., & Zäske, R. (2008). Auditory adaptation in voice perception. Current Biology, 18, 684-688.
    • Schweinberger, S.R., Kawahara, H., Simpson, A.P., Skuk, V.G., & Zäske, R. (2014). Speaker Perception. Wiley Interdisciplinary Reviews: Cognitive Science, 5, 15-25. (Link to PDF)External link
    • Schweinberger, S.R., Kloth, N., & Robertson, D.M.C. (2011). Hearing facial identities: Brain correlates of face-voice integration in person identification. Cortex, 47, 1026-1037. (Link to PDF)External link
    • Schweinberger, S.R., & Robertson, D.M.C. (2017). Audiovisual integration in familiar person recognition. Visual Cognition, 25(4-6), 589-610. doi.org/10.1080/13506285.2016.1276110 (Link to PDFExternal link)
    • Schweinberger, S.R., Robertson, D. & Kaufmann, J.M. (2007). Hearing facial identities. The Quarterly Journal of Experimental Psychology, 60, 1446-1456.
    • Von Eiff, C.I., Frühholz, S., Korth, D., Guntinas-Lichius, O., & Schweinberger, S.R. (2022). Crossmodal benefits to vocal emotion perception in cochlear implant users. iScience, 25, 105711. doi: 10.1016/j.isci.2022.105711. (Link to PDF)External link
    • Von Eiff, C.I., Kauk, J., & Schweinberger, S.R. (2024). The Jena Audiovisual Stimuli of Morphed Emotional Pseudospeech (JAVMEPS): A database for emotional auditory-only, visual-only, and congruent and incongruent audiovisual voice and dynamic face stimuli with varying voice intensities. Behavior Research Methods, 56, 5103-5115. https://doi.org/10.3758/s13428-023-02249-4External link
    • Zäske, R., Kaufmann, J.M., & Schweinberger, S.R. (2023). Neural correlates of voice learning with distinctive and non-distinctive faces. Brain Sciences, 134), 637. doi: 10.3390/brainsci13040637 (Link to PDF)External link
  • High-Level Adaptation Effects

    Abstract

    Neuronal adaptation can be regarded as a mechanism by which perceptual processing is constantly re-calibrated as a result of specific characteristics of incoming stimuli. Adaptation has been demonstrated in the form of perceptual illusions or aftereffects. The first written record of this is ascribed to Aristotle, who observed that, following prolonged fixation of the downward motion of a waterfall, a static visual scene appears to move upward. In this "waterfall illusion" or, more generally, the "motion aftereffect", a stationary stimulus appears to move in opposite direction to that of a previously fixated continuous visual motion. Perceptual adaptation is thought to result from the selective habituation after prolonged firing of neuronal populations that code specific stimulus attributes, a phenomenon sometimes referred to as the "psychologist´s microelectrode", as it can provide valuable insight into the neural fine tuning to special stimulus attributes in visual perception. However, while adaptation to simple stimulus attributes such as motion or colour has been known for literally hundreds of years, a striking novel discovery within the last couple of years is that adaptation is also of central importance for how humans perceive complex visual stimuli. Adaptation to male faces, for example, has been found to bias the subsequent perception of androgynous faces towards female gender. Similar adaptation effects have been observed for one of the most important visual social signals: Human eye gaze. Jenkins et al. (2006) found that adaptation to gaze into one direction virtually eliminated participants' ability to perceive smaller gaze deviations into the same direction. With our project, we aim at a deeper understanding of high-level adaptation effects. We are interested into several aspects of high-level adaptation effects such as the interrelationship of similarity of adaptation and test stimulus, the longevity of adaptation effects, as well as the neural correlates of adaptation as investigated with EEG.

    People

    • A. Mike Burton, York, UK
    • Rob Jenkins, York, UK
    • Nadine Kloth, Perth, Australia
    • Gyula Kovács, Jena, Germany
    • Christine Nussbaum, Jena, Germany
    • Stefan R. Schweinberger, Jena, Germany
    • Christian Walther, Jena, Germany

    Selected Relevant Publications

    • Ficco, L., Ramon, M., Schroeger, A., Kaufmann, J.M., & Schweinberger, S.R.(2025). The role of expansion and adaptability of face-space for individual differences in face identity processing. Royal Society Open Science, 12: 240879. https://doi.org/10.1098/rsos.240879External link
    • Hayn-Leichsenring, G.U., Kloth, N., Schweinberger, S.R., & Redies, C. (2013). Adaptation effects to attractiveness of face photographs and art portraits are domain-specific. iPerception, 4, 303-316.
    • Kloth, N. & Schweinberger, S.R. (2010). Electrophysiological correlates of eye gaze adaptation. Journal of Vision, 10(12):17, 1-13, doi:10.1167/10.12.17. (Link to PDF)External link
    • Kloth, N. & Schweinberger, S.R. (2008). The temporal decay of eye gaze adaptation effects. Journal of Vision, 8(11), 1-11.
    • Kloth, N., Schweinberger, S.R., & Kovács, G. (2010). Neural correlates of generic versus gender-specific face adaptation. Journal of Cognitive Neuroscience, 22(10), 2345-2356.
    • Kloth, N., Schweinberger, S.R., & Rhodes, G. (2017). Watching the brain recalibrate: Neural correlates of renormalization during face adaptation.NeuroImage, 155, 1-9. 10.1016/j.neuroimage.2017.04.049
    • Kovács, G., Cziráki, C, Vidnyánszky, Z., Schweinberger, S.R., Greenlee, M.W. (2008). Position-specific and position invariant face aftereffects reflect the adaptation of different cortical areas. NeuroImage,43, 156-164.
    • Nussbaum, C., von Eiff, C.I., Skuk, V.G., & Schweinberger, S.R. (2022). Vocal emotion adaptation aftereffects within and across speaker genders: Role of timbre and fundamental frequency. Cognition, 219, 104967. https://doi.org/10.1016/j.cognition.2021.104967External link
    • Schweinberger, S.R., Casper, C., Hauthal, N., Kaufmann, J.M., Kawahara, H., Kloth, N., Robertson, D.M.C., Simpson, A.P., & Zäske, R. (2008). Auditory adaptation in voice perception. Current Biology, 18, 684-688.
    • Schweinberger, S.R., Kloth, N., & Jenkins, R. (2007). Are you looking at me? Neural correlates of gaze adaptation. NeuroReport, 18, 693-696.
    • Schweinberger, S.R., Walther, C., Zäske, R., & Kovács, G. (2011). Neural correlates of adaptation to voice identity. British Journal of Psychology, 102(4), 748-764.
    • Schweinberger, S.R., Zäske, R., Walther, C., Golle, J., Kovács, G., & Wiese, H. (2010). Young without Plastic Surgery: Perceptual adaptation to the age of female and male faces. Vision Research, 50, 2570-2576.
    • Skuk, V.G., Dammann, L.M., & Schweinberger, S.R. (2015). Role of timbre and fundamental frequency in voice gender adaptation. Journal of the Acoustical Society of America, 138(2), 1180-1193.
    • Walther, C., Schweinberger, S.R., Kaiser, D., Kovács, G. (2013). Neural correlates of priming and adaptation in familiar face perception. Cortex. doi: https://doi.org/10.1016/j.cortex.2012.08.012
    • Zäske, R., Fritz, C., & Schweinberger, S.R. (2013). Spatial inattention abolishes voice adaptation. Attention, Perception & Psychophysics. (Link to PDF)External link
    • Zaske, R., Schweinberger, S. R., Kaufmann, J. M., & Kawahara, H. (2009). In the ear of the beholder: neural correlates of adaptation to voice gender. European Journal of Neuroscience, 30, 527-534.
    • Zäske, R., Schweinberger, S.R., & Kawahara, H. (2010). Voice Aftereffects of Adaptation to Speaker Identity. Hearing Research, 268, 38-45.
  • Perceptual Priming

    Abstract

    Research on perceptual priming has furthered our understanding of the nature of representations mediating the recognition and categorisation of everyday stimuli such as words, objects, or faces. Despite intensive research however, the neural correlates underlying perceptual priming are poorly understood. The fundamental question we ask here is how perceptual representation systems identify information at both abstract (e.g., "a pen") and stimulus-specific (e.g., "a particular image of a pen") levels. We aim to combine priming - a well established experimental paradigm - with state-of-the art cognitive neuroscience methods in order to investigate the following current questions:

    • What (if any) is the influence of the cognitive task at hand on the operation of these representation systems?
    • What is the brain lateralization of abstract and image-specific representation systems?
    • How do image-specific and abstract representations contribute to the recognition of everyday stimuli?
    • What are the brain systems mediating image-specific and abstractive priming, and what is the time course of their operation?
    • How exactly is priming related to other repetition-related phenomena, such as perceptual adaptation?

    To pursue these questions we use a novel cross disciplinary approach, combining our expertise in event-related potentials (ERPs) and face and names processing, transcranial magnetic stimulation (TMS) and word processing, and hemispheric differences and priming paradigms. Overall, we aim at a more complete understanding of the neurocognitive mechanisms that drive abstract and specific representation systems which mediate the recognition and categorization of everyday stimuli.

    People

    • Tracy Cooper, Glasgow, UK
    • Stella J. Faerber, Jena, Germany
    • Jürgen M. Kaufmann, Jena, Germany
    • Michal Lavidor, York, UK and Bar-Ilan, Israel
    • Amy Lisa Ramsay, Forfar, UK
    • Gyula Kovács, Jena, Germany
    • Stefan R. Schweinberger, Jena, Germany
    • Christian Walther, Jena, Germany

    Selected Relevant Publications

    • Bindemann, M., Burton, A.M., Leuthold, H., & Schweinberger, S.R. (2008). Brain potential correlates of face recognition: Geometric distortions and the N250r brain response to stimulus repetitions. Psychophysiology, 45, 535-544.
    • Cooper, T.J., Harvey, M., Lavidor, M., & Schweinberger, S.R. (2007). Hemispheric asymmetries in image-specific and abstractive priming of famous faces: Evidence from reaction times and event-related brain potentials. Neuropsychologia, 45, 2910-2921.
    • Faerber, S. J., Kaufmann, J. M., & Schweinberger, S. R. (2015). Early temporal negativity is sensitive to perceived (rather than physical) facial identity. Neuropsychologia, 75(C), 132-142. doi:10.1016/j.neuropsychologia.2015.05.023. (Link to PDF)External link
    • Itz, M.L., Schweinberger, S.R., & Kaufmann, J.M. (2018). Familiar face priming: The role of second-order configuration and individual face recognition abilities. Perception, 47(2), 185-196. doi: 10.1177/0301006617742069 (Link to PDF)External link
    • Pobric, G., Schweinberger, S.R., & Lavidor, M. (2007). Magnetic stimulation of the right visual cortex impairs form specific priming. Journal of Cognitive Neuroscience, 19, 1013-1020.
    • Lavidor, M. & Ellis, A. W. (2003b). Orthographic and phonological priming in the two cerebral hemispheres. Laterality, 8, 201-223.
    • Kaiser, D., Walther, C., Schweinberger, S.R., & Kovács, G. (2013). Dissociating the neural bases of repetition-priming and adaptation in the human brain for faces. Journal of Neurophysiology, 110, 2727-2738. (Link to PDF)External link
    • Neumann, M.F., Schweinberger, S.R., Wiese, H., & Burton, A.M. (2007). ERP correlates of repetition priming for ignored faces. NeuroReport, 18, 1305-1309
    • Ramsay, A.L., Kaufmann, J.M., & Schweinberger, S.R. (2004). An ERP study of featural and abstractive repetition priming of written names in the cerebral hemispheres. ECVP 2004 European Conference of Visual Perception, Budapest, August 22-26, 2004. Perception, 33.
    • Schweinberger, S.R., Kaufmann, J.M., Moratti, S., Keil, A. & Burton A.M. (2007). Brain Responses to Repetitions of Human and Animal Faces, Inverted Faces, and Objects – An MEG study. Brain Research, 1184, 226-233.
    • Schweinberger, S.R., & Neumann, M.F. (2016). Repetition effects in human ERPs to faces. Cortex, 80, 141-153. (Link to PDF)External link
    • Schweinberger, S.R., Ramsay, A.L., & Kaufmann, J.M. (2006). Hemispheric asymmetries in font-specific and abstractive priming of written personal names: Evidence from event-related brain potentials. Brain Research, 1117, 195-205.
    • Walther, C., Schweinberger, S.R., Kaiser, D., Kovács, G. (2013). Neural correlates of priming and adaptation in familiar face perception. Cortex, 49(7), 1963-1977
    • Walther, C., Schweinberger, S.R., Kovács, G. (2013). Adaptor identity modulates adaptation effects in familiar face identification and their neural correlates. PLoS One; 8(8): e70525
    • Wiese, H., Komes, J., Tüttenberg, S., Atzmüller, J., & Schweinberger, S.R.(2017). Age-related changes in face recognition: Neural correlates of repetition and semantic priming in young and older adults. Journal of Experimental Psychology: Learning, Memory, and Cognition, 43(8), 1254-1273. http://dx.doi.org/10.1037/xlm0000380External link
    • Wiese, H., Schweinberger, S.R., & Kovács, G. (2024). The neural dynamics of familiar face recognition. Neuroscience and Biobehavioral Reviews, 167, 105943. https://doi.org/10.1016/j.neubiorev.2024.105943External link
  • Voice Perception

    Abstract

    While the perception of faces from static portraits has been investigated in many studies, little research has been devoted to processes mediating auditory recognition of people via their voices. This is despite the fact that the voice is by far the most important auditory stimulus that supports person identification, and that it carries a wealth of further social information including emotion, gender, or age. This project is intended to fill a major gap in the research on auditory person perception, by addressing three key aspects of voice perception. First, using a design that incorporates both recognition memory and priming approaches, we explore the role of attention for explicit and implicit voice memory. Second, using novel voice morphing technology, we recently presented the first behavioural evidence that adaptation to non-linguistic information in voices elicits systematic auditory aftereffects in the perception of gender (Schweinberger et al., 2008). Here we will build on this new line of research, and will study behavioural and neurocognitive correlates of auditory adaptation to two other important social signals conveyed by voices: person identity and age. The studies on voice identity adaptation can be expected to have far-reaching theoretical implications with respect to the question of whether individual voices are represented in a prototype-referenced manner, similar to what has been suggested for the representation of facial identity. Building on findings from the visual modality that different visual adaptation effects depend on attention and conscious perception to very different degrees, we  study the combined effects of attention and voice adaptation.

    With increasing progress in developing basic research paradigms, we have now also begun a number of more applied projects. In one, we look at individual differences in voice recognition abilities and their potential links with autistic behavioral tendencies. In another, we target voice recognition in prosopagnosic individuals. In a clinical project, we have begun to use parameter-specific voice morphing technology to investigate the perception of social signals in the voice by cochlear implant users.

    People

    • Orlando Guntinas-Lichius, Jena, Germany
    • Denise Humble, Jena, Germany
    • Hideki Kawahara, Wakayama, Japan
    • Romina Palermo, Perth, Australien
    • Stefan R. Schweinberger, Jena
    • Adrian Simpson, Jena
    • Verena G. Skuk, Jena
    • Romi Zäske, Jena
    • Ayaka Tsuchiya, Jena
    • Christine Nussbaum, Jena

    Funding

    DFG Grant Schw 511/10-1 and 10-2

    DFG Grant ZA 745/1-1 and 1-2

    Selected Relevant Publications

    • Dogdu, C., Kessler, T., Schneider, D., Shadaydeh, M., & Schweinberger, S.R. (2022). A Comparison of Machine Learning Algorithms and Feature Sets for Automatic Vocal Emotion Recognition in Speech. Sensors, 22, 7561. (Link to PDF)External link
    • Frühholz, S., & Schweinberger, S.R. (2021). Nonverbal auditory communication - Evidence for Integrated Neural Systems for Voice Signal Production and Perception. Progress in Neurobiology, 1999, 101948. (Link to PDFExternal link)
    • Farrido, L., Eisner, F., McGettigan, C., Stewart, L., Sauter, D., Hanley, J.R., Schweinberger, S.R., Warren, J., & Duchaine, B. (2009). Developmental phonagnosia: a selective deficit to vocal identity recognition. Neuropsychologia, 47, 123-131.
    • Humble, D., Schweinberger, S.R., Mayer, A., Jesgarzewsky, T.L., Dobel, C., & Zäske, R. (2023). The Jena Voice Learning and Memory Test (JVLMT): A standardized tool for assessing the ability to learn and recognize voices. Behavior Research Methods, 55(3), 1352-1371. (Link to PDF)External link
    • Humble, D., Schweinberger, S.R., Mayer, A., Jesgarzewsky, T.L., Dobel, C., & Zäske, R. (2022). The Jena Voice Learning and Memory Test (JVLMT): A standardized tool for assessing the ability to learn and recognize voices. Behavior Research Methods, Advance Online. (Link to PDF)External link
    • Humble, D., Schweinberger, S.R., Dobel, C., & Zäske, R. (2019). Voices to remember: Comparing neural signatures of intentional and non-intentional voice learning and recognition. Brain Research, 1711, 214-225. (Link to PDF)External link
    • Kawahara, H., & Skuk, V.G. (2019). Voice Morphing. In: S. Frühholz and P. Belin (Eds.): The Oxford Handbook of Voice Perception (Chapter 31, pp. 685-706).
    • Latinus, M. & Zäske, R. (2019). Perceptual Correlates and Cerebral Representation of Voices - Identity, Gender and Age. In: S. Frühholz and P. Belin (Eds.): The Oxford Handbook of Voice Perception (Chapter 25, pp. 561-583).
    • Neuner, F., & Schweinberger, S.R. (2000). Neuropsychological impairments in the recognition of faces, names, and voices. Brain and Cognition, 44, 342-366.
    • Nussbaum, C., & Schweinberger, S.R. (2021). Links between musicality and vocal emotion perception. Emotion Review. (Link to PDF)External link
    • Nussbaum, C., Pöhlmann, M., Kreysa, H., & Schweinberger, S.R. (2023). Perceived Naturalness of Emotional Voice Morphs. Cognition and Emotion. (Link to PDF)External link
    • Nussbaum, C., Schirmer, A., & Schweinberger, S.R. (2022). Contributions of Fundamental Frequency and Timbre to Vocal Emotion Perception and their Electrophysiological Correlates. Social, Cognitive and Affective Neuroscience. Advance Online. (Link to PDF)External link
    • Nussbaum, C., von Eiff, C.I., Skuk, V.G., & Schweinberger, S.R. (2022). Vocal emotion adaptation aftereffects within and across speaker genders: Role of timbre and fundamental frequency. Cognition, 219, 104967. (Link to PDF)External link
    • Nussbaum, C., Schirmer, A., & Schweinberger, S.R. (2024). Musicality – Tuned to the Melody of Vocal Emotions. British Journal of Psychology, 115(2), 206-225. (Link to PDF)External link
    • Nussbaum, C., & Schweinberger, S.R. (in press). Links between musicality and vocal emotion perception. Emotion Review. (Link to PDF)External link
    • Schweinberger, S.R. (2001). Human brain potential correlates of voice priming and voice recognition. Neuropsychologia, 39, 921-936.
    • Schweinberger, S.R., Casper, C., Hauthal, N., Kaufmann, J.M., Kawahara, H., Kloth, N., Robertson, D.M.C., Simpson, A.P., & Zäske, R. (2008). Auditory adaptation in voice perception of voice gender. Current Biology, 18, 684-688. (Link to PDF)External link
    • Schweinberger, S.R., & von Eiff, C.I. (2022). Enhancing Socio-emotional Communication and QoL in Young CI Recipients: Perspectives from Parameter-specific Morphing and Caricaturing. Frontiers in Neuroscience, 16: 956917. (Link to PDF)External link. Note: Article is part of the Special Topic Quality of Life in Young Cochlear Implant Recipients: Are there Controlling Factors and Regional Differences?(Guest Editors: M. Huber, H.-J. Lee, M. Langereis, A. Vermeulen).
    • Schweinberger, S.R., Herholz, A., & Sommer, W. (1997). Recognizing famous voices: Influence of stimulus duration and different types of retrieval cues. Journal of Speech, Language, and Hearing Research, 40, 453-463. (Link to PDF)External link
    • Schweinberger, S.R., Herholz. A., & Stief, V. (1997). Auditory long-term memory: Repetition priming of voice recognition. The Quarterly Journal of Experimental Psychology, 50A, 498-517.
    • Schweinberger, S.R., Kawahara, H., Simpson, A.P., Skuk, V.G., & Zaeske, R. (2014). Speaker Perception. Wiley Interdisciplinary Reviews: Cognitive Science, 5, 15-25. (Link to PDF)External link
      (Link to Supplementary Material)External link
    • Schweinberger, S.R., von Eiff, C.I., Kirchen, L., Oberhoffner, T., Guntinas-Lichius, O., Dobel, C., Nussbaum, C., Zäske, R., & Skuk, V.G. (2020). The Role of Stimulus Type and Social Signal for Voice Perception in Cochlear Implant Users: Response to the Letter by Meister H et al. Journal of Speech, Language, and Hearing Research, 63(12), 4327-4328. (Link to PDF)External link
    • Schweinberger, S.R., Walther, C., Zäske, R., & Kovács, G. (2011). Neural correlates of adaptation to voice identity. British Journal of Psychology, 102(4), 748-764.
    • Schweinberger, S.R. & Zäske, R. (2019). Perceiving Speaker Identity from the Voice. In: S. Frühholz and P. Belin (Eds.): The Oxford Handbook of Voice Perception (Chapter 24, pp. 539-560).
    • Skuk, V.G., Dammann, L.M., & Schweinberger, S.R. (2015). Role of timbre and fundamental frequency in voice gender adaptation. Journal of the Acoustical Society of America, 138(2), 1180-1193. doi: 10.1121/1.4927696. (Link to PDF)External link
    • Skuk, V.G., Kirchen, L., Oberhoffner, T., Guntinas-Lichius, O., Dobel, C., & Schweinberger, S.R. (2020). Parameter-specific morphing reveals contributions of timbre and F0 cues to the perception of voice gender and age in cochlear implant users. Journal of Speech, Language, and Hearing Research, 63(9), 3155-3175
    • Skuk, V.G., Palermo, R., Broemer, L., & Schweinberger, S.R.  (2019) Autistic Traits are Linked to Individual Differences in Familiar Voice Identification. Journal of Autism and Developmental Disorders, 49(7), 2747-2767. (Link to PDF)External link
    • Skuk, V.G., & Schweinberger, S.R. (2014). Influences of fundamental frequency, formant frequencies, aperiodicity and spectral level information on the perception of voice gender. Journal of Speech, Language, and Hearing Research, 57(1), 285-296. (Link to PDF)External link
    • Skuk, V.G., & Schweinberger, S.R. (2013). Gender differences in familiar voice identification. Hearing Research, 296, 131-140. (Link to PDF)External link
    • Tsuchiya, A., & Schweinberger, S.R. (2022). Erkennen von Verwandtschaft zu sich Selbst und bei Anderen. In-Mind Themenausgabe: Wie verstehen wir andere besser? Teil 2 Heft 1/2022. Gasteditoren: P. Burgmer, K. Mushold, D.Schneider. (Link to PDF)External link
    • Von Eiff, C.I., Skuk, V.G., Zäske, R., Nussbaum, C., Frühholz, S., Feuer, U., Guntinas-Lichius, O., & Schweinberger, S.R. (2022). Parameter-specific morphing reveals contributions of timbre to the perception of vocal emotions in cochlear implant users. Ear and Hearing, Advance Online. (Link to PDF)External link
    • Young, A. W., Frühholz, S. & Schweinberger, S. R. (2020). Face and Voice Perception: Understanding Commonalities and Differences. Trends in Cognitive Sciences, 24(5), 398–410. (Link to PDF)External link
    • Zäske, R., Frisius, N., Ivansic, D., Schweinberger, S.R., Guntinas-Lichius, O., & Dobel, C. (2021). Phonetic perception but not perception of speaker gender is impaired in chronic tinnitus. Progress in Brain Research, 260, 397-422.
    • Zäske, R., Fritz, C., & Schweinberger, S.R. (2013). Spatial inattention abolishes voice adaptation. Attention, Perception & Psychophysics, 75(3), 603-613.
    • Zäske, R., Muehl, C., & Schweinberger, S.R. (2015). Benefits for voice learning caused by concurrent faces develop over time. PloS One, 10(11): e0143151. doi:10.1371/journal.pone.0143151. (Link to PDF)External link
    • Zäske, R., Perlich, M.-C., & Schweinberger, S.R. (2016). To hear or not to hear: Voice processing under visual load. Attention, Perception, & Psychophysics, 78, 1488-1495. (Link to PDF)External link
    • Zäske, R., & Schweinberger, S.R.  (2011). You are only as old as you sound: Auditory aftereffects in vocal age perception. Hearing Research, 282(1-2), 283-288.
    • Zäske, R., Schweinberger, S.R., Kaufmann, J.M., & Kawahara, H. (2009). In the ear of the beholder: neural correlates of adaptation to voice gender. European Journal of Neuroscience, 30, 527-534.
    • Zäske, R., Schweinberger, S.R., & Kawahara, H. (2010). Voice Aftereffects of Adaptation to Speaker Identity. Hearing Research, 268, 38-45.
    • Zäske, R., Skuk, V.G., Golle, J., & Schweinberger, S.R.  (2020). The Jena Speaker Set (JESS) – A database of voice stimuli from unfamiliar young and old adult speakers. Behavior Research Methods, 52, 990-1007. (Link to PDFExternal link)
    • Zäske, R., Skuk, V.G., Kaufmann, J.M., & Schweinberger, S.R. (2013). Perceiving vocal age and gender: An adaptation approach. Acta Psychologica, 144(3), 583-593.
    • Zäske, R., Skuk, V.G., & Schweinberger, S.R. (2020). Attractiveness and distinctiveness between speakers ́ voices in naturalistic speech and their faces are uncorrelated. Royal Society Open Science, 7, 201244. (Link to PDF)External link
    • Zäske, R., Volberg, G., Kovács, G., & Schweinberger, S.R. (2014). Electrophysiological correlates of voice learning and recognition. Journal of Neuroscience, 34(33), 10821-10831. (Link to PDF)External link
    • Zäske, R., Hasan, B.A.S., & Belin, P. (2017). It doesn’t matter what you say: FMRI correlates of voice learning and recognition independent of speech content. Cortex, 94, 100-112. (Link to PDF)External link
    • Zäske, R., Kaufmann, J.M., & Schweinberger, S.R. (2023). Neural correlates of voice learning with distinctive and non-distinctive faces. Brain Sciences, 13(4), 637. (Link to PDFExternal link).
    • Zäske, R., Limbach, K., Schneider, D., Skuk, V.G., Dobel, C., Guntinas-Lichius, O., & Schweinberger, S.R. (2018). Electrophysiological correlates of voice memory for young and old speakers in young and old listeners. Neuropsychologia, 116, 215-227.

Memory, Categorization, and Semantic Processing

  • Accessing Semantic Information and Names

    Abstract

    Failures to retrieve familiar personal names are among the frequently reported everyday memory errors. Failures to correctly retrieve semantic information (e.g. occupation, place of living, etc.) for familiar people are relatively less frequent. In particular, situations in which a familiar face can be successfully named even though no semantic information can be accessed appear to be extremely rare or nonexistent. In the model of face recognition by Bruce and Young (1986), it was proposed that the access to semantic information and names of familiar people occurs in a sequential manner, such that the access of semantic information is mandatory before a name can be retrieved. In the context of this topic, we collected experimental data as well as electrophysiological evidence which have been challenging this view to some extent, and which has been interpreted to suggest that the access to semantic information and names occurs in a parallel fashion, involving different brain systems. Another controversy has been about whether semantic information for people is organized in a categorical (i.e., driven by semantic category membership) or purely associative (i.e., driven by co-occurrence) manner. Recent data from the lab have provided evidence that both category membership and co-occurrence of people contribute independently to semantic person memory.

    People

    • A. Mike Burton, York, UK
    • Stefan R. Schweinberger, Jena, Germany
    • Holger Wiese, Durham, UK

    Selected Relevant Publications

    • Abdel Rahman, R., Sommer, W., & Schweinberger, S.R. (2002). Brain potential evidence for the time course of access to biographical facts and names of familiar persons: Brain potential evidence. Journal of Experimental Psychology: Learning, Memory, and Cognition, 28, 366-373.
    • Huddy, V., Schweinberger, S.R., Jentzsch, I., & Burton, A.M. (2003). Matching Faces for Semantic Information and Names: An Event-related Brain Potentials Study. Cognitive Brain Research, 17, 314-326.
    • Schweinberger, S.R., Burton, A.M., & Kelly, S.W. (2001). Priming the access to names of famous faces. British Journal of Psychology, 92, 303-317.
    • Wiese, H. (2011). The structure of semantic person memory: Evidence from semantic priming in person recognition. British Journal of Psychology, 102(4), 899-914.
    • Wiese, H., & Schweinberger, S.R. (2011). The Structure of Semantic Person Knowledge: ERP Correlates of Non-Strategic Categorical and Associative Priming. Journal of Cognitive Neuroscience, 23(2), 447-459.
    • Wiese, H., & Schweinberger, S.R. (2008). Event-related brain potentials indicate different processes to mediate categorical and associative priming in person recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 1246-1263.
    • Wiese, H., & Schweinberger, S.R. (2015). Getting connected: Both associative and semantic links structure semantic memory for newly learned persons. Quarterly Journal of Experimental Psychology, 68(11). 2131-2148. doi: 10.1080/17470218.2015.1008526. (Link to PDF)External link
    • Wiese, H., Komes, J., Tüttenberg, S., Atzmüller, J., & Schweinberger, S.R. (2017). Age-related changes in face recognition: Neural correlates of repetition and semantic priming in young and older adults. Journal of Experimental Psychology: Learning, Memory, and Cognition, 43(8), 1254-1273. (Link to PDF)External link
  • Face Learning / Expertise

    Familiar faces can be easily recognized even from poor quality images and across a large range of viewing conditions. By contrast, it is surprisingly difficult to recognize or even to match unfamiliar faces across different images.

    Abstract

    Familiar faces can be easily recognized even from poor quality images and across a large range of viewing conditions. By contrast, it is surprisingly difficult to recognize or even to match unfamiliar faces across different images. While this suggests qualitative differences between the processing of familiar and unfamiliar faces, little is known about how new representations of faces are formed during learning. However, recent research suggests that mental representations of faces essentially may code an average across the perceptual instances perceived during familiarization. At the same time, natural variability in visual encounters of familiar faces also appears to play an important role for the acquisition of robust representations of well-known faces, in a way that remains to be precisely understood. Building on previous work from our group that identified event-related brain potential (ERP) correlates of face recognition, we use behavioural and ERP experiments to improve our understanding of face learning. The project aims at understanding how non-visual cues such as voices and semantic information contribute to face recognition and investigates how these links develop during face learning. Importantly, the project also utilises sophisticated methods of image manipulation (such as selective photorealistic caricaturing in either shape or reflectance information) to determine the relative role of different kinds of visual information for face learning and recognition. We also currently use these techniques in order to devise and explore training programmes for individuals with poor face recognition skills.

    People

    Funding

    BBSRC, British Academy

    DFG Grant: KA 2997/ 2-1

    Selected Relevant Publications

    • Ficco, L., Müller, V.I., Kaufmann, J.M.,  Schweinberger, S.R. (2023). Socio-cognitive, expertise-based and appearance-based accounts of the other -“race” effect in face perception: A label-based systematic review of neuroimaging results. British Journal of Psychology, Advance Online. (Link to PDF)External link.
    • Stelter, M., & Schweinberger, S.R. (2023). Understanding the mechanisms underlying the other-“race” effect: An attempt at integrating different perspectives (Guest Editorial to Special Issue). British Journal of Psychology, Advance Online. (Link to PDFExternal link).
    • Zhou, X., Itz, M.L., Kaufmann, J.M., Schweinberger, S.R., & Mondloch, C.J. (2021). The other-race effect is not modulated by differential use of shape and texture cues during face learning and recognition. Vision Research(Link to PDF)External link
    • Andrews, S., Burton, A.M., Schweinberger, S.R., and Wiese, H. (2017). Event-related potentials reveal the development of stable face representations from natural variability. The Quarterly Journal of Experimental Psychology. (Link to PDF)External link
    • Blickhan, M., Kaufmann, J.M., Denzler, J., Schweinberger, S.R., & Redies, C. (2011). 1/f p Characteristics of the Fourier Power Spectrum Affects ERP Correlates of Face Learning and Recognition. Biological Psychology, 88(2-3), 204-214.
    • Dobel, C., & Schweinberger, S.R. (2006). Plasticity of face perception: Psychophysiological correlates of familiarity and expertise. Symposium at the Annual meeting of the Society for Psychophysiological Research, Vancouver, October 26-29, 2006. Psychophysiology, 43, S13.
    • Faerber, S.J., Kaufmann, J.M., Leder, H., Martin, E.-M., & Schweinberger, S.R. (2016). The role of familiarity for representations in norm-based face space. PloS One11(5): e0155380. doi:10.1371/ journal.pone.0155380. (Link to PDF)External link
    • Itz, M.L., Schweinberger, S.R., Schulz, C., & Kaufmann, J.M. (2014) Neural correlates of facilitations in face learning by selective caricaturing of facial shape or reflectance. NeuroImage, 102, 736-747. (Link to PDF)External link
    • Itz, M.L., Schweinberger, S.R., & Kaufmann, J.M. (2017). Caricature generalization benefits for faces learned with enhanced idiosyncratic shape or texture. Cognitive, Affective, and Behavioral Neuroscience, 17, 185-197. doi:10.3758/s13415-016-0471-y. (Link to PDF)External link
    • Kaufmann, J. M., Burton, A. M., & Schweinberger, S. R. (2004). Neural correlates of face learning and long-term repetition priming. Perception, 33, 107.
    • Kaufmann, J.M., Schulz, C., & Schweinberger, S.R. (2013). High and low performers differ  in the use of shape information for face recognition. Neuropsychologia, 51(7),1310-1319. (Link to PDF)External link
    • Kaufmann, J.M., & Schweinberger, S.R. (2012). The faces you remember: Caricaturing shape facilitates brain processes reflecting the acquisition of new face representations. Biological Psychology, 89(1), 21-33.
    • Kaufmann, J.M., Schweinberger, S.R., & Burton, A.M. (2009). N250 ERP correlates of the acquisition of face representations across different images. Journal of Cognitive Neuroscience, 21, 625-641.
    • Kaufmann, J.M., & Schweinberger, S.R. (2008). Distortions in the brain? ERP effects of caricaturing familiar and unfamiliar faces. Brain Research, 1228, 177-188.
    • Kaufmann, J.M., & Schweinberger, S.R. (2004). Expression influences the recognition of familiar faces. Perception, 33, 399-408.
    • Limbach, K., Kaufmann, J.M., Wiese, H., Witte, O.W., & Schweinberger, S.R. (2018). Enhancement of face-sensitive ERPs in older adults induced by face recognition training. Neuropsychologia, 119, 197-213. (Link to PDF)External link
    • Schulz, C., Kaufmann, J.M., Walther, L., & Schweinberger, S.R. (2012). Effects of anticaricaturing vs. caricaturing elucidate a role of shape for face learning. Neuropsychologia, 50, 2426-2434.
    • Schulz, C., Kaufmann, J.M., Kurt, A., & Schweinberger, S.R. (2012). Faces forming traces: Neurophysiological correlates of learning naturally distinctive and caricatured faces. NeuroImage, 63, 491-500.
    • Wiese, H., & Schweinberger, S.R. (2018). Inequalities between biases in face memory: Event-related potentials reveal dissociable neural correlates of own-race and own-gender biases. Cortex, 101, 119-135. (Link to PDF)External link
    • Wiese, H., Wolff, N., Steffens, M.C., & Schweinberger, S.R. (2013). How experience shapes memory for faces: An event-related potential study on the own-age bias. Biological Psychology, 94(2), 369-379.
    • Wuttke, S.J., & Schweinberger, S.R. (2019). The P200 predominantly reflects distance-to-norm in face space whereas the N250 reflects activation of identity-specific representations of known faces. Biological Psychology, 140, 86-95. doi: 10.1016/j.biopsycho.2018.11.011. (Link to PDF)External link
    • Zhou, X., Itz, M.L., Kaufmann, J.M., Schweinberger, S.R., & Mondloch, C.J. (in press). The other-race effect is not modulated by differential use of shape and texture cues during face learning and recognition. Vision Research.
  • Person Categorization

    Abstract

    The efficient analysis and representation of person-related information is one of the most challenging and important tasks of human social perception. In particular, efficient processing is achieved by person categorisation (e.g. old vs. young, male vs. female, own vs. other eth-nic group etc.). However, it remains controversial whether relevant categories (and if necessary the associated stereotypical behaviour) are activated automatically during perception. Alternatively, category activation may be determined by controlling factors, such as attention, processing strategies or goals. The current project investigates this prominent question by means of priming, while event-related potentials (ERP) are recorded. Various ERP components (e.g. N170, N250r, N400) are analysed to examine perceptual and semantic categorisation processes for faces. In particular, we will examine the extent to which these priming effects are modulated by selective attention as well as by the categorisation task at hand. Further neuroscientific studies investigate the recently reported 'own age bias', or 'other age effect' - the observation that faces belonging to other age groups than the viewer´s group are recognized less effectively. Finally, the role of face familiarisation for categorisation will be examined. The project aims at an enhanced understanding of the cognitive and neural bases of person perception and categorisation.

    People

    • Nadine Kloth, Perth, Australia
    • Markus F. Neumann, Perth, Australia
    • Stefan R. Schweinberger, Jena, Germany
    • Johanna Stahl, Salzburg, Austria
    • Holger Wiese, Jena, Germany

    Funding

    DFG-Projekt Schw 511/8-1

    Selected Relevant Publications

    • Kloth, N., Damm, M., Schweinberger, S.R., & Wiese, H. (2015). Aging affects sex categorization of male and female faces in opposite ways. Acta Psychologica, 158, 78-86. doi: 10.1016/j.actapsy.2015.04.005. (Link to PDF)External link
    • Schweinberger, S.R., Zäske, R., Walther, C., Golle, J., Kovács, G., & Wiese, H. (2010). Young without Plastic Surgery: Perceptual adaptation to the age of female and male faces. Vision Research, 50, 2570-2576.
    • Stahl, J., Wiese, H., & Schweinberger, S.R. (2010). Learning task affects ERP-correlates of the Own-Race Bias,  but not Recognition Memory Performance. Neuropsychologia, 48,2027-2040.
    • Stahl, J., Wiese, H., & Schweinberger, S.R. (2008). Expertise and own-race bias in face processing: An Event-related potential study. NeuroReport, 19, 583-587.
    • Wiese, H., Kloth, N., Güllmar, D., Reichenbach, J.R., & Schweinberger, S.R. (2012). Perceiving age and gender in unfamiliar faces: An fMRI study on face categorization. Brain and Cognition, 78, 163-168.
    • Wiese H, Schweinberger SR, Hansen K (2008). The age of the beholder: ERP evidence of an own-age bias in face memory. Neuropsychologia, 46, 2973-2985.
    • Wiese, H., Schweinberger, S.R., & Neumann, M.F. (2008). Perceiving age and gender in unfamiliar faces: Brain potential evidence for implicit and explicit person categorization. Psychophysiology, 45, 603-615.
    • Wiese, H., Stahl, J. & Schweinberger, S.R. (2009). Configural processing of other-race faces is delayed but not decreased. Biological Psychology, 81, 103-109.
    • Wolff, N., Kempter, K., Schweinberger, S.R., & Wiese, H. (in press). What drives social in-group biases in face recognition memory? ERP evidence from the own-gender bias. Social Cognitive and Affective Neuroscience.

Technology and Social Interaction in the Real and Digital Space

  • Human-Machine-Interaction

    Abstract

    Although research in our department has a clear focus on interpersonal perception and interactions between humans, technological progress has already changed the reality of social interactions for many people. Accordingly, the importance of interactions between humans and machines (e.g., in the form of smartphones, computers, or robots) not only is increasing quickly – there are also many potential applications to psychology which come with both chances and challenges. For instance, the extent to which service robots can make a positive contribution to care services for the elderly – already a partial reality in countries such as Japan – is discussed controversially. Another example are virtual reality applications, which are beginning to play a role in clinical interventions, such as in cases of specific affective disorders. Such applications can also be used for training purposes to enhance cognitive and social abilities, and may be complemented by techniques of bio- or neurofeedback that are currently becoming validated as effective treatments for disorders such as ADHD or autism. Moreover, there is currently intense research to understand the conditions for the so-called sense of agency (the subjective impression that one´s own action has been the cause of an external response), which may be a crucial factor for smooth and pleasant interactions between humans and machines. In one project, we investigate the role of several variables (latency, (multi-)sensory nature, and affective valence of machine-generated responses to human actions) for the sense of agency. In a second related project, we specifically target human-robot interactions, and investigate the degree to which both human (e.g., age, personality, anxiety levels) and robot (e.g., degree of humanoid appearance, size, motion parameters) variables can reduce anxiety and promote smooth interactions between humans and robots.

    People

    • Stefan R. Schweinberger, Jena, Germany
    • Philipp Stiens, Jena, Germany
    • Paul Winkler, Jena, Germany
    • Maike Pohl, Jena, Germany

    Funding

    BMBF-Network 3D-LivingLab; Project Response Latencies and Multisensory Feedback, FKZ: 03ZZ0439E (2017-2019)

    BMBF-Network 3D-IMiR; Project PAMRI, FKZ: 03ZZ0459B (2017-2019)

    Selected Relevant Publications

    • Kowallik, A.E., & Schweinberger, S.R. (2019). Sensor-based Technology for Social Information Processing in Autism: A Review. Sensors, 19, 4787. (Link to PDF)External link
    • Schweinberger, S.R., Pohl, M., & Winkler, P.(2020).Autistic traits, personality, and evaluation of humanoid robots by young and older adults. Computers in Human Behavior, 106, 106256. (Link to PDF)External link
  • Misinformation in Human Memory and Social Networks

    Abstract

    Misinformation in social networks is considered to have manifold adverse effects on the individuals using them, such as erosion of trust in politicians and traditional media, or reduced adherence to pro-environmental behavior and public health measures in a pandemic situation. Acquiring a better understanding of how misinformation diffuses through a social network and what can be effective countermeasures therefore seems necessary. However, relatively little is known about the effects which specific countermeasures social media platforms can implement (e.g., fact-checking or post-deletion) can have on the spread of misinformation. In a recently published work, our group has yielded first but preliminary evidence about the effectiveness and sufficiency of such countermeasures in containing the spread of misinformation in social networks. Future work on this subject will uncover the role of memory in misinformation consolidation and will reveal how effective specific countermeasures can contain the spread of misinformation in social networks.

    People

    • Helene Kreysa
    • Stefan R. Schweinberger
    • Julian Kauk (FSU Jena)
    • Franka Ambsdorff, Kiel, Germany
    • Edda Humprecht, Jena, Germany
    • André Scherag, Jena, Germany

    Selected Relevant Publications

    Kauk, J., Kreysa, H., Voigt, A., & Schweinberger, S.R. (2022). #flattenthecurve: Wie begrenzen wir die Welle von Falschinformationen und Verschwörungs­erzählungen in digitalen sozialen Netzwerken? In: F. Hessel, P. Chakkarath, and M. Luy (Eds.): Verschwörungsdenken.Zwischen Populärkultur und politischer Mobilisierung.(pp. 259-279).  ießen: Psychosozial-Verlag.

    Kauk, J., Kreysa, H., & Schweinberger, S.R. (2021). Understanding and countering the spread of conspiracy theories in social networks: Evidence from epidemiological models of Twitter data. PLoS One, 16(8), e0256179. (Link to PDF)External link

  • Comparative Psychology – Dog Studies (funded by DFG) (Bender 2025)

    Logo of the DogStudies Lab

    Graphic: Nora Tippmann

    Animal minds can inform us about the factors driving the evolution of cognition. For a number of reasons, the domestic dog (Canis familiaris) is a very interesting model for investigating different questions regarding the evolution of cognitive abilities. The fact that dogs have been living with humans for at least 15.000 years may have led to the selection of certain social cognitive skills by humans or even the co-evolution of dogs’ abilities with those of humans.

    DogStudies addresses domestication and dog-human interactions. In this project, we investigate social cognitive skills of family and working dogs and their relationship with humans. For example, we are interested in communicative and cooperative skills of dogs, and how odor perception and cognition are linked together. We also investigate the relationship between dogs and humans and the way dogs are kept, used, and perceived in different cultures all over the world. The results of this project contribute to a better understanding not only of dog cognition and the dog-human relationship, but also of the relationship between cultural evolution and domestication, i.e. how cultural and evolutionary processes mutually influence each other.

    People

    • Juliane Bräuer, Jena, Germany
    • Blanca Vidal Orga, Jena, Germany
    • Yana Bender, Jena, Germany
    • Stefan Schweinberger, Jena, Germany
    Learn more

Individual Differences and Special Groups

  • Age and Ageing in Person Perception

    Abstract

    Human ageing is typically accompanied by some degree of cognitive slowing. In addition, problems in person memory are among the frequent complaints of older adults. At the same time, age does not invariably affect all aspects of performance, and older adults can even outperform younger people in specific tasks. Neurophysiological research demonstrates that high performing older adults show compensatory activity in brain areas that are not activated in younger or low performing older participants, possibly via bilateral hemispheric activation. Thus, increased bilateral hemispheric activation may contribute to 'successful ageing'. Event-related brain potentials (ERPs) are a most sensitive means to investigate age-related changes in neurocognitive processing. In the early phase of this project, we studied face and word processing in older adults. We focussed on bilateral vs unilateral hemispheric activation differences, and on explicit and implicit person-related memory. In more recent work, we also investigated older adult's interaction with technology and robots, and age-related aspects of hearing and voice perception. 

    People

    • Jürgen M. Kaufmann, Jena, Germany
    • Stefan R. Schweinberger, Jena, Germany
    • Romi Zäske, Jena, Germany

    Previous Team Members:

    • Tracy J. Cooper, Glasgow, UK
    • Monika Harvey, Glasgow, UK
    • Jessica Komes, Jena, Germany
    • Nadine Kloth, Münster, Germany / Perth, Australia
    • Katharina Limbach, Berlin, Germany
    • Markus F. Neumann, Hamburg, Germany / Perth, Australia
    • Eva-Maria Pfütze, Bochum, Germany
    • Holger Wiese, Durham, UK
    • Nicole Wolff, Dresden, Germany

    Funding

    •  
    •  

    DFG Grant: WI 3219/ 4-1

    Selected Relevant Publications

    Selected Relevant Publications

    • Kloth, N., Damm, M., Schweinberger, S.R., & Wiese, H. (2015). Aging affects sex categorization of male and female faces in opposite ways. Acta Psychologica, 158, 78-86. (Link to PDF)External link
    • Komes, J., Schweinberger, S.R., & Wiese, H. (2014). Fluency affects source memory for familiar names in younger and older adults: Evidence from event-related brain potentials. NeuroImage, 92, 90-105. (Link to PDF)External link
    • Komes, J., Schweinberger, S.R., &; Wiese, H. (2014). Preserved fine-tuning of face perception and memory: Evidence from the own-race bias in high- and low-performing older adults. Frontiers in Aging Neuroscience, 6, Article 60, 1-10.  (Link to PDF)External link
    • Limbach, K., Kaufmann, J.M., Wiese, H., Witte, O.W., & Schweinberger, S.R. (2018). Enhancement of face-sensitive ERPs in older adults induced by face recognition training. Neuropsychologia, 119, 197-213. (Link to PDF)External link
    • Neumann, M.F., End, A., Luttmann, S., Schweinberger, S.R., & Wiese, H. (2015). The own-age bias in face memory is unrelated to differences in attention – evidence from event-related potentials. Cognitive, Affective, and Behavioral Neuroscience, 15, 180-192. (Link to PDF)External link
    • Pfütze, E.-M., Sommer, W., & Schweinberger, S.R. (2002). Age-Related Slowing in Face and Name Recognition: Evidence from Event-Related Brain Potentials. Psychology and Aging, 17, 140-160. (Link to PDF)External link
    • Schweinberger, S.R. , Pohl, M., & Winkler, P. (2020). Autistic traits, personality, and evaluation of humanoid robots by young and older adults. Computers in Human Behavior, 106, 106256. (Link to PDF)External link
    • Schweinberger, S.R., & Wiese, H. (2011). Why some faces will not be remembered: Current ERP evidence on memory encoding for other-race and other-age faces. Frontiers in Neuroscience, 5: 104.
    • Schweinberger, S.R., Zäske, R., Walther, C., Golle, J., Kovács, G., & Wiese, H. (2010). Young without Plastic Surgery: Perceptual adaptation to the age of female and male faces. Vision Research, 50, 2570-2576. (Link to PDF)External link
    • Wiese, H. (2012). The role of age and ethnic group in face recognition memory: ERP evi-dence from a combined own-age and own-race bias study. Biological Psychology, 89,137-147.
    • Wiese, H., Kachel, U., & Schweinberger, S.R. (2013). Holistic face processing of own- and other-age faces in young and older adults: ERP evidence from the composite face task. NeuroImage, 74, 306-317.
    • Wiese, H., Kloth, N., Güllmar, D., Reichenbach, J.R., & Schweinberger, S.R. (2012). Perceiving age and gender in unfamiliar faces: An fMRI study on face categorization. Brain and Cognition, 78, 163-168.
    • Wiese, H., Komes, J., & Schweinberger, S.R. (2012). Daily-life contact affects the own-age bias and neural correlates of face memory in elderly participants. Neuropsychologia, 50, 3496-3508.
    • Wiese, H., Komes, J., & Schweinberger, S.R. (2013). Aging faces in aging minds: A review on the own-age bias in face recognition. Visual Cognition, 21(9-10), 1337-1363. (Link to PDF)External link
    • Wiese, H., Komes, J., Tüttenberg, S., Atzmüller, J., & Schweinberger, S.R. (2017). Age-related changes in face recognition: Neural correlates of repetition and semantic priming in young and older adults. Journal of Experimental Psychology: Learning, Memory, and Cognition, 43(8), 1254-1273. (Link to PDF)External link
    • Wiese, H., Schweinberger S.R., & Hansen, K. (2008). The age of the beholder: ERP evidence of an own-age bias in face memory. Neuropsychologia, 46, 2973-2985. (Link to PDF)External link
    • Wiese, H., Schweinberger, S.R., & Neumann, M.F. (2008). Perceiving age and gender in unfamiliar faces: Brain potential evidence for implicit and explicit person categorization. Psychophysiology, 45, 603-615.
    • Wolff, N., Wiese, H., & Schweinberger, S.R. (2012). Face recognition memory across the adult lifespan: ERP evidence from the own-age bias. Psychology and Aging, 27(4),1066-1081. (Link to PDF)External link
    • Zäske, R., Limbach, K., Schneider, D., Skuk, V.G., Dobel, C., Guntinas-Lichius, O., & Schweinberger, S.R. (2018). Electrophysiological correlates of voice memory for young and old speakers in young and old listeners. Neuropsychologia, 116, 215-227. (Link to PDF)External link
    • Zäske R, Skuk VG, Golle J, Schweinberger SR. The Jena Speaker Set (JESS)-A database of voice stimuli from unfamiliar young and old adult speakers. Behav Res Methods. 2020 Jun;52(3):990-1007. doi: 10.3758/s13428-019-01296-0. PMID: 31637667.
  • Assessing and Training Socio-Emotional Skills

    Abstract

    Based on long-standing experience of the group in research on cognitive aging and its neuronal correlates, as well as with individuals experiencing handicaps of social communication, this project develops and evaluates assessment tools, perceptual and cognitive training programs, and tailor-made interventions to improve various aspects of social interaction. Our approach is based on current neurocognitive models of social perception and interaction. Selected sub-projects use current technology to synthesize naturalistic facial and vocal stimuli with paremeter-specific morphing methods. This technology allows us to create stimuli with augmented („caricatured“) social signals which have been demonstrated to be efficient in improving social perception. Individual aspects of this research programme include (1) an assessment of emotion perception abilities in hearing-impaired individuals with a cochlear implant, (2) the development and evaluation of a training program for improving nonverbal vocal communication in older adults, (3) a systematic assessment of the potential of mu-rhythm neurofeedback training to improve socio-emotional communication and its related cortical correlates in adolescents and young adults with autism, (4) the development of improved methods for assessing central auditory processing disorders (CAPD; dt: AVWS) - a frequent but incompletely understood cause of learning problems for school children, and (5) the development of new diagnostic tools. The subprojects are all characterized by use of state-of-the-art digital technology to assess and improve social interaction abilities.

    People

    • Samaneh S. Dastgheib, Jena, Germany
    • Christian Dobel, Jena, Germany
    • Jürgen Kaufmann, Jena, Germany
    • Andrea Kowallik, Jena, Germany
    • Christine Nussbaum, Jena, Germany
    • Manuel Pöhlmann, Jena, Germany
    • Stefan R. Schweinberger, Jena, Germany
    • Verena Skuk, Jena, Germany
    • Celina von Eiff, Jena, Germany
    • Romi Zäske, Jena, Germany

    Selected Relevant Publications

    • Dastgheib, S.S., Wang, W., Kaufmann, J.M., Moratti, S., & Schweinberger, S.R. (2024). Mu-Suppression Neurofeedback Training Targeting the Mirror Neuron System: A Pilot Study. Applied Psychophysiology and Biofeedback. Advance Online. (Link to PDFExternal link).
    • Limbach, K., Itz, M.L., Schweinberger, S.R., Jentsch, A.D., Romanova, L., & Kaufmann, J.M. (2022). Neurocognitive effects of a training program for poor face recognizers using shape and texture caricatures: A pilot investigation. Neuropsychologia, 165, 108133. (Link to PDF)External link
    • Schweinberger, S.R., & von Eiff, C.I. (2022). Enhancing Socio-emotional Communication and QoL in Young CI Recipients: Perspectives from Parameter-specific Morphing and Caricaturing. Frontiers in Neuroscience, 16:956917. (Link to PDF)External link
    • Humble, D., Schweinberger, S.R., Mayer, A., Jesgarzewsky, T.L., Dobel, C., & Zäske, R. (2022). The Jena Voice Learning and Memory Test (JVLMT): A standardized tool for assessing the ability to learn and recognize voices. Behavior Research Methods, Advance Online. (Link to PDF)External link.
    • Kowallik, A., Pohl, M., & Schweinberger, S.R. (2021). Facial imitation improves emotion recognition in adults with and without sub-clinical autistic traits. Journal of Intelligence, 9(1), 4. (Special Issue: Advances in Socio-Emotional Ability Research; Guest editors: K. Schlegel and S. Olderbak). (Link to PDF)External link
    • Kowallik, A.E., & Schweinberger, S.R. (2019). Sensor-based Technology for Social Information Processing in Autism: A Review. Sensors, 19, 4787. (Link to PDF)External link
    • Nussbaum, C., & Schweinberger, S.R. (2021). Links between musicality and vocal emotion perception. Emotion Review. (Link to PDF)External link
    • Schweinberger, S.R., von Eiff, C.I., Kirchen, L., Oberhoffner, T., Guntinas-Lichius, O., Dobel, C., Nussbaum, C., Zäske, R., & Skuk, V.G. (2020). The Role of Stimulus Type and Social Signal for Voice Perception in Cochlear Implant Users: Response to the Letter by Meister H et al. Journal of Speech, Language, and Hearing Research, 63(12), 4327-4328. (Link to PDFExternal link)
    • Skuk, V.G., Kirchen, L., Oberhoffner, T., Guntinas-Lichius, O., Dobel, C., & Schweinberger, S.R. (2020). Parameter-specific Morphing Reveals Contributions of Timbre and F0 Cues to the Perception of Voice Gender and Age in Cochlear Implant Users. Journal of Speech, Language, and Hearing Research, 63(9), 3155-3175. (Link to PDF)External link
    • Zäske, R., Skuk, V.G., Golle, J., & Schweinberger, S.R.  (2020). The Jena Speaker Set (JESS) – A database of voice stimuli from unfamiliar young and old adult speakers. Behavior Research Methods, 52, 990-1007. (Link to PDF)External link
  • Autism, Person Perception and Social Interaction

    For more information on the interdiciplinary research and participatory on autism spectum disorder (ASD) in Jena, please see the Social Potential in Autism research unit (link), which is also coordinated by this department.

    People:

    • Clara Breier, Dresden, Germany
    • Isabel Dziobek, Berlin, Germany
    • Samaneh S. Dastgheib, Jena, Germany
    • Andrea Kowallik, Jena, Germany
    • Helene Kreysa, Jena, Germany
    • Gabriele Kühn, Schleiz, Germany
    • Silke Lipinski, Berlin, Germany
    • Manuel Pöhlmann, Jena, Germany
    • Dana Schneider, Madgeburg, Germany
    • Daniela Schulze-Henning, Potsdam, Germany
    • Stefan R. Schweinberger, Jena, Germany
    • Vivian Werner, Jena, Germany

    Funding

    • Herbert-Feuchte-Stiftungsverbund
    • Kompetenzzentrum für Interdisziplinäre Prävention

    Publications

    • Dastgheib, S.S., Kaufmann, J.M., Kowallik, A.E. & Schweinberger, S.R. (2025). Attention to Social and Non-social Stimuli in a Continuous Performance Test in Autistic and Typically Developed Participants: an ERP Study. Journal of Autism and Developmental Disorders. https://doi.org/10.1007/s10803-025-06825-9External link.
    • Hennig, J., Doose, A., Soutschek, A., Breier, C.M., Beyer, N., Schweinberger, S., Kamp-Becker, I., Poustka, L., Albertowski, K., Roessner, V., Ehrlich, S. (2025). Disentangling the Perceptual Underpinnings of Autism: Evidence from a Face Aftereffects Experiment. Autism Research, 18, 349-361. https://doi.org/10.1002/aur.3283External link
    • Kowallik, A.E., & Schweinberger, S.R. (2019). Sensor-based Technology for Social Information Processing in Autism: A Review. Sensors, 19, 4787. doi:10.3390/s19214787
    • Kowallik, A., Pohl, M., & Schweinberger, S.R. (2021). Facial imitation improves emotion recognition in adults with and without sub-clinical autistic traits. Journal of Intelligence, 9(1), 4. doi: 10.3390/jintelligence9010004(Special Issue: Advances in Socio-Emotional Ability Research; Guest editors: K. Schlegel and S. Olderbak).
    • Kreysa, H., Schneider, D., Kowallik, A.E., Dastgheib, S.S., Doğdu, C., Kühn, G., Ruttloff, J.M., & Schweinberger, S.R. (2022). Psychosocial and behavioural effects of the COVID-19 pandemic on children and adolescents with autism and their families: Overview of the literature and initial data from a multinational online survey. Healthcare, 10, 714. https://doi.org/10.3390/healthcare10040714External link.
    • Schneider, D., Glaser, M., & Senju, A. (2017). Autism Spectrum Disorder. In V. Zeigler-Hill & T. K. Shackelford (Eds.), Encyclopedia of Personality and Individual Differences. Springer International Publishing AG.
    • Schneider, D., Slaughter, V.P., Bayliss, A.P., & Dux, P. E. (2013). A temporally sustained implicit theory of mind deficit in autism spectrum disorders. Cognition, 129, 410-417.
    • Skuk, V.G., Palermo, R., Broemer, L., & Schweinberger, S.R. (2019). Autistic Traits are Linked to Individual Differences in Familiar Voice Identification. Journal of Autism and Developmental Disorders, 49(7), 2747-2767.doi: 10.1007/s10803-017-3039-y.
    • Schweinberger, S.R., Pohl, M., & Winkler, P. (2020). Autistic traits, personality, and evaluation of humanoid robots by young and older adults. Computers in Human Behavior, 106, 106256. doi:10.1016/j.chb.2020.1062561.
    Learn more
  • Individual Differences in Person Perception and Interaction

    Abstract

    To date, cognitive and neuronal correlates of person perception and human interaction are surprisingly poorly understood. One example is face recognition and face learning skills: Individual differences in these skills have only recently become a focus of  research. In this project, we (1) study face learning in people with good and poor face recognition skills, and specifically address the question whether poor performers might benefit disproportionately from an enhancement of a face 's idiosyncratic shape or texture (by means of selective spatial caricaturing). We also (2) study neural correlates of individual differences in face recognition skills. In specific experiments, we (3) investigate individual differences in processing the second-order spatial configuration of facial features, by using a metric manipulation of feature placement.  In broader studies with larger groups of participants, we (4) assess relationships between face and voice perception skills and more general skills relevant to social cognition and interaction (such as perspective-taking or theory of mind), as well as with personality characteristics (such as the BIG FIVE, or autistic traits).

    People

    • Marlena L. Itz, Jena, Germany
    • Linda Ficco, Berne, Switzerland
    • Jürgen M. Kaufmann, Jena, Germany
    • Katharina Limbach, Berlin, Germany
    • Romina Palermo, Perth, Australia
    • Anna Schröger, Giessen, Germany
    • Stefan R. Schweinberger, Jena, Germany
    • Verena G. Skuk, Jena, Germany

    Funding

    DFG-grant KA2997/3-1

    Selected Relevant Publications

    • Ficco, L., Ramon, M., Schroeger, A., Kaufmann, J.M., & Schweinberger, S.R. (2025). The role of expansion and adaptability of face-space for individual differences in face identity processing. Royal Society Open Science, 12: 240879. https://doi.org/10.1098/rsos.240879External link.
    • Schröger A., Ficco, L., Wuttke, S.J., Kaufmann, J.M., & Schweinberger, S.R. (2023). Differences between high and low performers in face recognition in electrophysiological correlates of face familiarity and distance-to-norm. Biological Psychology, 182, 108654. https://doi.org/10.1016/j.biopsycho.2023.108654External link.
    • Sperl, L., Breier, C.M., Grießbach, E., & Schweinberger, S.R. (2024).  Do Typing Skills Matter? Investigating University Students´ Typing Speed and Performance in Online Exams. Higher Education Research & Development, 43(4), 918-995. (Link to PDF).
    • Humble, D., Schweinberger, S.R., Mayer, A., Jesgarzewsky, T.L., Dobel, C., & Zäske, R. (2023). The Jena Voice Learning and Memory Test (JVLMT): A standardized tool for assessing the ability to learn and recognize voices. Behavior Research Methods, 55(3), 1352-1371. (Link to PDF)External link
    • Itz, M.L., Golle, J., Luttmann, S., Schweinberger, S.R. & Kaufmann, J.M. (2017). Dominance of texture over shape in facial identity processing is modulated by individual abilities. British Journal of Psychology, 108(2), 369-396. (Link to PDF)External link
    • Kaufmann, J.M., Schulz, C., & Schweinberger, S.R. (2013). High and low performers differ in the use of shape information for face recognition. Neuropsychologia, 51(7), 1310-131. (Link to PDF)External link
    • Skuk, V.G., Palermo, R., Broemer, L., & Schweinberger, S.R. (2019). Autistic Traits are Linked to Individual Differences in Familiar Voice Identification. Journal of Autism and Developmental Disorders. (Link to pdf)External link
  • Prosopagnosia, Phonagnosia and other Disorders of Person Perception

    Abstract

    Our "social brain" and its machinery may be severely compromised by brain lesions following stroke or traumatic injury, but disorders of person perception may also arise as a consequence of interindividual variability. standard neuropsychological tests typically do not include tests on face perception, and human intraspection about one's own ability to recognize faces or voices is known to be very unreliable, such that many patients may not spontaneously report such difficulties. Our work in this area includes the study of patients with brain lesions. Prosopagnosia is not a unitary condition, but can result from breakdown at various functional and neuroanatomical levels of face processing. Several detailed case studies with dense prosopagnosia show how such impairments can exist even when other aspects of visual object recognition are surprisingly well-preserved. Moreover, "covert recognition" of unrecognized faces can be demonstrated in many of these patients. Systematic studies with larger groups of unselected patients from a neurological rehabilitation clinic also demonstrate that clinically relevant disorders in the perception of faces, voices, or names are more frequent than previously assumed. More recently, "developmental" or "congenital" prosopagnosia has drawn strong interest, in which face recognition is very poor in the abscence of known neurological disorders. We emphasize that all these cases require careful functional diagnosis similar to what has become state-of-the-art in acquired prosopagnosia, but that these should also be complemented by appropiate and standardized self-report-instruments. In parallel, an analogous case can be made for developmental phonagnosia, which has been documented more recently. Together, systematic research on developmental disorders in person recognition will further increase our understanding of the human system for face and person perception.

    People

    • Christian Dobel, Jena, Germany
    • Lucia Garrido, London, UK
    • Katharina Henke, Berne, Switzerland
    • Thomas Klos, Erlangen, Germany
    • Frank Neuner, Bielefeld, Germany
    • Anna Schröger, Jena, Germany
    • Stefan R. Schweinberger, Jena, Germany
    • Romi Zäske, Jena, Germany

    Funding

    DFG-Projekt Schw 511/6-1

    Selected Relevant Publications

    • Schweinberger, S.R. (1992). Funktionelle und neuroanatomische Aspekte der Prosopagnosie. Zeitschrift für Neuropsychologie, 3, 106-119.
    • Schweinberger, S.R., Buse, C., Freeman, R.B., Jr., Schönle, P.W., & Sommer, W. (1992). Memory search for faces and digits in patients with unilateral brain lesions. Journal of Clinical and Experimental Neuropsychology, 14, 839-856.
    • Schweinberger, S.R. (1995). Personal name recognition and associative priming in patients with unilateral brain damage. Brain and Cognition, 28, 23-35.
    • Schweinberger, S.R., Klos, T., & Sommer, W. (1995). Covert face recognition in prosopagnosia: A dissociable function? Cortex, 31, 521-536.
    • Henke, K., Schweinberger, S.R., Grigo, A., Klos, T., & Sommer, W. (1998). Specificity of face recognition: Recognition of exemplars of non-face objects in prosopagnosia. Cortex, 34, 289-296.
    • Neuner, F., & Schweinberger, S.R. (2000). Neuropsychological impairments in the recognition of faces, names, and voices. Brain and Cognition, 44, 342-366.
    • Schweinberger, S.R., Klos, T., & Sommer, W. (2002). Face and Word Recognition in Patients with Left and Right Hemispheric Lesions: Evidence from Reaction Times and ERPs. Zeitschrift für Neuropsychologie, 13, 67-81.
    • Schweinberger, S.R., Landgrebe, A., Mohr, B., & Kaufmann, J.M. (2002). Personal names and the human right hemisphere: An illusory link? Brain & Language, 80, 111-120.
    • Schweinberger, S.R., & Burton, A.M. (2003). Covert recognition and the neural system for face processing. Cortex, 39, 9-30.
    • Schweinberger, S.R. (2007). Agnosien. In: S. Gauggel & T. Herrmann (Hrsg.):Handbuch der Psychologie. Band 8: Handbuch der Neuro- und Biopsychologie. Göttingen: Hogrefe.
    • Dobel, C., Bölte, J., Aicher, M., & Schweinberger, S.R. (2007). Prosopagnosia without apparent cause: Overview and diagnosis of six cases. Cortex, 43, 718-733.
    • Garrido, L., Eisner, F., McGettigan, C., Stewart, L., Sauter, D., Hanley, J.R., Schweinberger, S.R., Warren, J., & Duchaine, B. (2009). Developmental phonagnosia: a selective deficit to vocal identity recognition. Neuropsychologia, 47, 123-131.
    • Della Sala, S., & Schweinberger, S.R. (2013). Face blindness and person misidentification in non-scientific parlance. Cortex, 49(8), 2276-2280.
    • Németh, K., Zimmer, M., Schweinberger, S.R., Vakli, P., & Kovács, G. (2014). The Background of Reduced Face Specificity of N170 in Congenital Prosopagnosia. PLoS One, 9(7), e101393.
    • Schröger, A., Kaufmann, J.M., Zäske, R., Kovács, G., Klos, T., & Schweinberger, S.R. (2022). Atypical Prosopagnosia following Right Hemispheric Stroke: A 23 - year follow-up study with M.T. Cognitive Neuropsychology 39(3-4), 196-207. (Link to PDF)External link

Past Research Projects

  • Interhemispheric Cooperation

    Abstract

    While functional hemispheric asymmetries in information processing have been known for some time, more recent research has focussed on the specific ways in which the two cerebral hemispheres collaborate in the processing of complex stimuli. Interhemispheric cooperation may be indicated by enhanced performance when stimuli are presented tachistoscopically to both visual fields/hemispheres relative to one visual field alone. Such a "bilateral gain" has been reported for words but not pseudowords in lexical decision tasks, and has been attributed to the operation of interhemispheric cell assemblies that exist only for meaningful words with acquired cortical representations. Similarly, a bilateral gain has been reported for famous but not unfamiliar faces in face recognition tasks. In this line of research we further investigate prerequisites of interhemispheric cooperation in face perception. Particular interest is given to the role of face learning. Of further interest is the question whether interhemispheric cooperation is equally important for other person related information such as emotional expressions and personal names. Behavioural and ERP methods are used to study interhemispheric cooperation and its underlying neural correlates.

    People

    • Lyndsay Baird, Glasgow, UK
    • A. Mike Burton, York, UK
    • Stefan Frässle, Zurich, Switzerland
    • Andreas Jansen, Marburg, Germany
    • Jürgen M. Kaufmann, Jena, Germany
    • Bettina Mohr-Pulermüller, Berlin, Germany
    • Stefan R. Schweinberger, Jena, Germany

    Selected Relevant Publications

    • Cooper, T.J., Harvey, M., Lavidor, M., & Schweinberger, S.R. (2007). Hemispheric asymmetries in image-specific and abstractive priming of famous faces: Evidence from reaction times and event-related brain potentials. Neuropsychologia, 45, 2910-2921
    • Frässle, S., Paulus, F.M., Krach, S., Schweinberger, S.R., Stephan, K.E., & Jansen, A. (2016). Mechanisms of hemispheric lateralization: Asymmetric interhemispheric recruitment in the face perception network. NeuroImage, 124, 977-988. doi: 10.1016/j.neuroimage.2015.09.055. (Link to PDF)External link
    • Mohr, B., Landgrebe, A., & Schweinberger, S.R. (2002). Interhemispheric cooperation for familiar but not unfamiliar face processing. Neuropsychologia, 40, 1841-1848.
    • Schweinberger, S.R., Baird, L., Blümler, M., Kaufmann, J.M., & Mohr, B. (2003). Interhemispheric cooperation for familiar face recognition but not for affective facial expressions. Neuropsychologia, 41, 407-414.
    • Schweinberger, S.R., Landgrebe, A., Mohr, B., & Kaufmann, J.M. (2002). Personal names and the human right hemisphere: An illusory link? Brain & Language, 80, 111-120.
    • Schweinberger, S.R., Kaufmann, J.M., & McColl, A. (2002). Famous personal names and the right hemisphere: The link keeps missing. Brain & Language, 82, 95-110.
    • Schweinberger, S.R., Ramsay, A.L., & Kaufmann, J.M. (2006). Hemispheric asymmetries in font-specific and abstractive priming of written personal names: Evidence from event-related brain potentials. Brain Research, 1117, 195-205.
  • Timing in Face Perception

    Abstract

    Current models of face perception propose independent brain systems allowing for parallel analysis of identity and expression. Our aim is to examine whether or not there is some cross-talk between mechanisms by which we perceive different facial signals. Specifically, we will investigate both the timing and possible processing hierarchies in perception of identity and expression, and for this we combine approaches from face perception research with new electrophysiological techniques to reveal the timing of mental events. By studying how the brain processes identity and expression from faces, this project motivates a strong conceptual linkage between two areas of social cognition which as yet have been largely treated as separate.

    People

    • Hartmut Leuthold, Tübingen, Germany
    • Ulla Martens, Osnabrück, Germany
    • Markus F. Neumann, Hamburg, Germany
    • Stefan R. Schweinberger, Jena, Germany

    Funding

    BBSRC (UK)

    Selected Relevant Publications

    • Martens, U., Leuthold, H., & Schweinberger, S.R. (2010). On the temporal organisation of facial identity and expression analysis: Inferences from event-related brain potentials. Cognitive, Affective, & Behavioral Neuroscience, 10(4), 505-522.
    • Martens, U., Leuthold, H., & Schweinberger, S.R. (2010). Parallel processing in face perception. Journal of Experimental Psychology: Human Perception and Performance, 36, 103-121.
    • Schweinberger SR, Neumann MF. Repetition effects in human ERPs to faces. Cortex. 2016 Jul;80:141-53. doi: 10.1016/j.cortex.2015.11.001. Epub 2015 Nov 18. PMID: 26672902.(Link to PDFExternal link)

Open Resources for the Scientific Community

  • JAVMEPS (2024)

    The JAVMEPS (Jena Audiovisual Stimuli of Morphed Emotional Pseudospeech). JAVMEPS is an audiovisual database for emotional voice and face stimuli. In includes 2256 stimulus files with recordings from 12 speakers, 4 bisillabic pseudowords and 6 naturalistic induced basic emotions in auditory-only, visual-only and congruent AV conditions. It further comprises caricatures, original voices and anticaricatures and time-synchronised congruent and incongruent AV emotions. JAVMEPS is a useful open resource for research into auditory emotion perception especially when adaptivtive testing or calibration of task difficoulty.

    Go to Publication: https://doi.org/10.3758/s13428-023-02249-4External link 

    Learn more
  • JERS (2023)

    Jena Eyewitness Research Stimuli (JERS, Kruse et Schweinberger, 2023). A database of mock crime videos in 2D and Virtual Reality formats, with corresponding 2D and 3D lineup images. This validated stimulus database is freely accessible for the scientific community interested in eyewitness memory, and is compatible with enhanced ecological validity in eyewitness research as provided by virtual reality.

    Go to Publication: https://doi.org/10.1371/journal.pone.0295033External link 

  • JVLMT (2023)

    The JVLMT: Jena voice learning and memory test. A standardized test for assesssing the ability to learn and recognize voices. The test is based on item-response theory and applicable accross languages. The format is similar to the cambridge face memory test (CFMT), and takes appropriately 22 minutes to complete.

    Go to Publication: https://doi.org/10.3758/s13428-022-01818-3External link 

    Learn more
  • COS-7 (2021)

    The compassion of others scale COS-7 (2023). A psychometrically tested 7-Item scale for measuring compassion in time-contrained research settings. (Schlosser, Klimecki et al. 2023)

    Go to Publication: https://doi.org/10.1007/s12144-020-01344-5External link 

    Learn moreExternal link
  • JESS (2020)

    The Jena Speaker Set (JESS, 2020): Database of voice Stimuli from unfamiliar young and old adult speakers. A free database for unfamiliar adult voice stimuli, with 61 young and 58 old female and male speakers uttering various sentences, syllables, read text, semi-spontaneous speech and vowels. Ample annotated information per speaker is available, making this database a valuable resource for secondary research by the scientific community.

    Go to Publication: https://doi.org/10.3758/s13428-019-01296-0External link 

    Learn more

We are founding members of these Jena-based Research Units