The perception of emotional bodies Arieta Chouchourelou, Toshihiko Matsuka, Catherine Hanson, Mischa Kozhevnikov, & Maggie Shiffrar Rutgers University - Newark Campus

Visual sensitivity to human motion is impressive

This sensitivity has been attributed to:

1)

Visual Experience Greater visual sensitivity to frequently observed actions (e.g., Jacobs & Shiffrar, 2005).

2)

Motor Experience Greater visual sensitivity to actions that an observer has performed (e.g., Loula et al., 2005).

Question of Interest

Do emotional processes contribute to the visual analysis of human motion?

Do emotional processes contribute to the visual analysis of human motion?

Superior Temporal Sulcus (STS) Strongly associated with the visual analysis of human action.

From Grossman et al (2000) Journal of Cognitive Neuroscience

Superior Temporal Sulcus (STS)

STS projects to and receives input from the amygdala If the amygdala contribute to processing in the STS, then action perception should be modulated by emotion. From Grossman et al (2000) Journal of Cognitive Neuroscience

Is action perception emotion dependent? Experiment 1: Create set of emotional action stimuli. Experiment 2: Is the detection of human action influenced by the emotional content of the action?

Experiment 1 - Stimulus Construction

Professional actors expressing a variety of emotions walked naturally within a motion capture system.

ReActor Motion Capture by Ascension

Experiment 1 - Stimulus Construction

5 Emotional States Neutral Sad Happy Afraid Angry

Experiment 1 - Procedure • 8 naïve observers viewed 312 three second movies • Observers categorized the emotion portrayed in each movie • 5 alternative forced choice (neutral, happy, sad, angry, afraid) • No feedback

Experiment 1 - Pilot Study 1 0.9 0.8 0.7

Probability 0.6 correct 0.5 emotion categorization 0.4 0.3 0.2 0.1 0

afraid

angry

happy

neutral

sad

Emotions are recognizable from bodily motion alone (confirms Dittrich et al., 1996; Atkinson et al., 2004).

Stimulus Selection for Experiment 2

Movies Disgarded

0.85 0.75 0.65 0.55 0.45 0.35 0.25 0.15 0.05 7 1 3 1 9 2 5 3 1 3 7 4 3 4 9 5 5 6 1 6 7 7 3 7 9 8 5 9 1 9 7 1 0 1 3 0 1 9 1 1 5 6 1 5 7 1 1 7 1 7 8 1 3 8 1 9 9 2 5 5 2 3 5 2 9 6 2 5 7 2 1 7 2 7 8 2 3 8 2 9 9 3 5 0 3 1 0 7

Probability correct emotion categorization

1

1

Movies Kept

Individual Movies from Experiment 1

Experiment 2

Does the emotional content of an action influence the detection of that action?

Experiment 2 Is action perception modulated by emotion?

Walker Alone

Experiment 2 Is action perception modulated by emotion?

Walker Alone

Walker + Mask

Each stimulus had its own unique mask.

Walker Present: Angry

Walker Present in Mask: Angry (Color Difference for Demo Only)

Walker Present in Mask: Angry (What Subjects saw)

Two types of trials Walker Present in Mask 50% of trials

Walker Absent from Mask 50% of trials

Walker Absent/Scrambled: Angry

Walker Absent + Mask: Angry (Color Difference for Demo Only)

Walker Absent + Mask: Angry (What Subjects saw)

Experiment 2 Is action perception modulated by emotion? Methods • 13 naïve observers watched 120 movies • Task: Report whether walker is present or absent • No feedback

Experiment 2 Is action perception modulated by emotion? 3.5 Main effect of emotion (p<.01)

3 2.5 2 D-prime measure of discrimination performance

1.5 1 .5 0 -.5 -1 -1.5 -2 afraid angry

happy

neutral

sad

Walker detection is modulated by emotional content.

Experiment 2 Is action perception modulated by emotion? .5 .4 .3 .2 Reaction Time (z-scores)

.1

Slower than average

0 -.1

Faster than average

-.2 -.3 -.4 -.5 afraid

angry

happy

neutral

sad

Detection differences do not reflect speed-accuracy trade-offs.

Experiment 2 Is action perception modulated by emotion? .5 .4 .3 .2 Reaction Time (z-scores)

.1

Slower than average

0 -.1

Faster than average

-.2 -.3 -.4 -.5 afraid

angry

happy

neutral

Angry walkers were detected quickly.

sad

Experiment 2 Is action perception modulated by emotion? 3.5 Main effect of emotion (p<.01)

3 2.5 2 D-prime measure of 1.5 discrimination 1 performance .5 0 -.5 -1 -1.5 -2

afraid angry

happy

neutral

Angry walkers were detected accurately.

sad

Conclusions • Emotional processes contribute to the visual analysis of other people’s actions. • This effect may depend upon interactions between the visual and limbic systems. • Human action perception depends upon a complex network of systems including visual, motor, and emotional processes.

Reaction time by Trial Type & Emotion Target-Absent Target-Present

p<.005 for interaction of trial type & emotion

RT z-scores

0.8 0.6 0.4 0.2 0

afraid

happy

sad

-0.2 neutral -0.4 -0.6 -0.8

angry

Rapid responses to the presence of angry walkers

False Alarms Rates by Emotion

0.7

% of False Alarms

0.6

0.5

0.4

0.3

0.2

0.1

0

afraid

angry

happy

neutral

sad

Detection of Life Sized Walkers Emotion X Direction Left/Right Interaction, p=.002

3.5 3

Towards/Away

D-primes

2.5 2 1.5 1 0.5 0

afraid

angry

happy

neutral

sad

Criterion data for computer shown Walkers 1.5

Decision boundary

1 0.5 Mean of noise

0 -0.5

afraid

neutral angry happy

-1

sad

Criterion Data for Life Sized Walkers Decision boundary

1.6 1.4 1.2 1 0.8 0.6 0.4 0.2 Mean of noise

0

afraid

angry

happy

neutral

sad

The perception of emotional bodies

portrayed in each movie ... 0.75. 0.85. Individual Movies from Experiment 1. Movies. Disgarded. Movies. Kept ... complex network of systems including visual,.

3MB Sizes 0 Downloads 237 Views

Recommend Documents

The perception of emotional bodies
visual analysis of human motion? Superior Temporal Sulcus (STS). Strongly associated with the visual analysis of human action. From Grossman et al (2000).

Spatial frequencies and emotional perception
Nov 21, 2012 - app y faces w as related to. LSF, while identification of sad faces w as related ...... Holmes, A., Winston, J.S., and Eimer, M. (2005b). The role of.

Emotional perception and neuroendocrine changes
drawal), and a second dimension of arousal, which dictates the intensity or amount ... Address reprint requests to: Maurizio Codispoti, Department of. Psychology ...

Warm-Bodies-The-Warm-Bodies-Series.pdf
... like google together with the keywords download Isaac Marion PDF eBooks in ... Lifehacker The best Fonts for E-book Readers, As outlined by Reserve and ...

Rhythms of Gaming Bodies
material concerns: access to platform/hardware, software, power, adequate .... café he was refused permission to take part in the raid because he had not ...

Magnetic levitation of metamaterial bodies enhanced with ...
Mar 26, 2012 - tions including superlens-based imaging26,28,33 and wireless power32 ..... advantage of the cylindrical symmetry of the problem and use the ...

Mixed Motives and the Optimal Size of Voting Bodies - CiteSeerX
In large vot- ing bodies, the chance of a single vote being decisive is negligible, and ex- pressive motives come to the fore. Finally, for bodies of intermediate size, ... as long as passion and reason are correlated, we show that “passionate” v

the effects of turbidity on perception of risk
Aug 17, 2011 - http://rsbl.royalsocietypublishing.org/content/early/2011/08/03/rsbl.2011.0645.full.html. This article cites 16 articles, 2 of which can be accessed ...

On the existence of mixed fiber bodies.
polytope to convex bodies by continuity. We present a direct proof of the ..... of this plan occupies the rest of Section 3. □. For a convex body В С M, let С (В) be ...

Perception of the Impact of Day Lighting on ...
Students are less willing to work in an office where there is no daylight. It is believed that our circadian rhythms are affected by the exposure and intensity of light ...

Orthography shapes the perception of speech: The ... - Semantic Scholar
a sampling rate of 48 kHz with 16-bit analog-to-digital conversion using a Macintosh IIfx computer ..... Jakimik, J., Cole, R. A., & Rudnicky, A. I. (1985). Sound and ...

Visual perception of the relative phasing of human ... - Semantic Scholar
phase variability were used to generate computer displays of spheres oscillating either side to side in .... IIci and shown on an Apple 13-in. color display.

Categorical Perception Beyond the Basic Level: The Case of Warm ...
ISSN: 0364-0213 print / 1551-6709 online ... bDepartment of Linguistics and Cognitive Science Program, University of California, Berkeley. Received 31 August 2015; .... that the center of the computer screen was at eye level. On each trial, a ...

Categorical Perception Beyond the Basic Level: The Case of Warm ...
Yellow-green 402.7 48.6 393.6 41.6 384.3 39.2 383.8 38.2. 94.4. 1.4 9 10. А4. 57.3. Yellow-blue. 392.9 42.0 389.6 40.0 384.8 41.8 379.5 34.5. 259.3. 6.3 9 10.

on the electrodynamics of moving bodies
Aug 18, 2003 - Let us take a system of co-ordinates in which the equations of. Newtonian .... (b) By means of stationary clocks set up in the stationary system and synchronizing in ...... You can download a ready-to-print PostScript file.

Mixed Motives and the Optimal Size of Voting Bodies - CiteSeerX
The University of Chicago Press is collaborating with JSTOR to digitize, preserve and extend access to Journal of Political .... long history in political economy. ...... Pittsburgh. Brennan, Geoffrey, and James Buchanan. 1984. “Voter Choice: Evalu