Download as pdf or txt
Download as pdf or txt
You are on page 1of 84

Media Aesthetics for Fulldome

Filmmaking∗

Ka Chun Yu
Denver Museum of Nature & Science
2001 Colorado Blvd.
Denver, CO 80205

Immersive Cinema Workshop: March 26, 2008


With thanks to Isabella Buczek (Hamburg Planetarium)
(DMNS) 1/1
Perceptual Processes

We react in predictable ways to how a message is perceived; useful for


directing viewer attention.

(DMNS) 2/1
Perceptual Processes
We react in predictable ways to how a message is perceived; useful for
directing viewer attention.
Popular optical illusions

(DMNS) 2/1
Perceptual Processes
We react in predictable ways to how a message is perceived; useful for
directing viewer attention.
Popular optical illusions
Simultaneous contrast

(DMNS) 2/1
Perceptual Processes
We react in predictable ways to how a message is perceived; useful for
directing viewer attention.
Popular optical illusions
Simultaneous contrast

(DMNS) 2/1
Perceptual Processes
We react in predictable ways to how a message is perceived; useful for
directing viewer attention.
Popular optical illusions
Simultaneous contrast

(DMNS) 2/1
Perceptual Processes
We react in predictable ways to how a message is perceived; useful for
directing viewer attention.
Popular optical illusions
Simultaneous contrast

(DMNS) 2/1
Perceptual Processes
We react in predictable ways to how a message is perceived; useful for
directing viewer attention.
Popular optical illusions
Simultaneous contrast
Horizons

(DMNS) 2/1
Perceptual Processes
We react in predictable ways to how a message is perceived; useful for
directing viewer attention.
Popular optical illusions
Simultaneous contrast
Horizons

(DMNS) 2/1
Perceptual Problems

More Perceptual Examples

Attached shadows

(DMNS) 3/1
Perceptual Problems

More Perceptual Examples

Attached shadows

(DMNS) 3/1
Perceptual Problems

More Perceptual Examples

Attached shadows

(DMNS) 3/1
Perceptual Problems

More Perceptual Examples

Attached shadows

(DMNS) 3/1
Perceptual Problems

More Perceptual Examples


Brightness perception

(DMNS) 4/1
Perceptual Problems

Stable Mass at the Bottom of the Frame

(DMNS) 5/1
Perceptual Problems

Unstable Mass at the Top of the Frame

(DMNS) 6/1
Perceptual Problems

(DMNS) 7/1
Perceptual Problems

(DMNS) 7/1
Perceptual Problems

Asymmetry of the Frame

(DMNS) 8/1
Perceptual Problems

Asymmetry of the Frame

(DMNS) 8/1
Perceptual Problems

Asymmetry of the Frame

(DMNS) 8/1
Perceptual Problems

Asymmetry of the Frame

(DMNS) 8/1
Perceptual Problems

Screen Left/Right Asymmetry

(DMNS) 9/1
Perceptual Problems

Screen Left/Right Asymmetry

(DMNS) 9/1
Filmmaking Tips

Focusing Attention with Vanishing Points

(DMNS) 10 / 1
Filmmaking Tips

Focusing Attention with Vanishing Points

(DMNS) 10 / 1
Filmmaking Tips

Focusing Attention with Vanishing Points

(DMNS) 10 / 1
Filmmaking Tips

Focusing Attention with Vanishing Points

(DMNS) 11 / 1
Filmmaking Tips

Focusing Attention with Vanishing Points

(DMNS) 11 / 1
Filmmaking Tips

Focusing Attention with Framing

(DMNS) 12 / 1
Filmmaking Tips

Focusing Attention with Framing

(DMNS) 13 / 1
Filmmaking Tips

Focusing Attention with Mise en Scène

Also see Bordwell 2005, Figures Traced in Light: On Cinematic Staging.

(DMNS) 14 / 1
Focusing Attention in a Dome

How Do You Direct Attention in a Dome?

... assuming a 25◦ tilted theater


(DMNS) 15 / 1
Focusing Attention in a Dome

(DMNS) 16 / 1
Focusing Attention in a Dome

How Do You Direct Attention in an Immersive Display?

Use “natural” viewing directions for default.


Do audiences look to the side? (Pausch et al. 1996: No!!!)

(DMNS) 17 / 1
Focusing Attention in a Dome

How Do You Direct Attention in an Immersive Display?

Use “natural” viewing directions for default.


Do audiences look to the side? (Pausch et al. 1996: No!!!)
“Frame-less” medium framed by limits of binocular field-of-view (Kalawsky
1993).

(DMNS) 17 / 1
Focusing Attention in a Dome

How Do You Direct Attention in an Immersive Display?

Use “natural” viewing directions for default.


Do audiences look to the side? (Pausch et al. 1996: No!!!)
“Frame-less” medium framed by limits of binocular field-of-view (Kalawsky
1993).

(DMNS) 17 / 1
Focusing Attention in a Dome

How Do You Direct Attention in an Immersive Display?

Use “natural” viewing directions for default.


Do audiences look to the side? (Pausch et al. 1996: No!!!)
“Frame-less” medium framed by limits of binocular field-of-view (Kalawsky
1993).

(DMNS) 17 / 1
Focusing Attention in a Dome

How Do You Direct Attention in an Immersive Display?

Use “natural” viewing directions for default.


Do audiences look to the side? (Pausch et al. 1996: No!!!)
“Frame-less” medium framed by limits of binocular field-of-view (Kalawsky
1993).
Shot duration limited by need to convey information from frame to audience.

(DMNS) 17 / 1
Focusing Attention in a Dome

How Do You Direct Attention in an Immersive Display?

Use “natural” viewing directions for default.


Do audiences look to the side? (Pausch et al. 1996: No!!!)
“Frame-less” medium framed by limits of binocular field-of-view (Kalawsky
1993).
Shot duration limited by need to convey information from frame to audience.

(DMNS) 17 / 1
Focusing Attention in a Dome

How Do You Direct Attention in an Immersive Display?

Use “natural” viewing directions for default.


Do audiences look to the side? (Pausch et al. 1996: No!!!)
“Frame-less” medium framed by limits of binocular field-of-view (Kalawsky
1993).
Shot duration limited by need to convey information from frame to audience.
More traditional montage possible!

(DMNS) 17 / 1
Focusing Attention in a Dome

Directing the Viewer’s Attention: Black Holes

(DMNS) 18 / 1
Focusing Attention in a Dome

Directing the Viewer’s Attention: Black Holes

(DMNS) 18 / 1
Focusing Attention in a Dome

Directing the Viewer’s Attention: Black Holes

(DMNS) 18 / 1
Focusing Attention in a Dome

Directing the Viewer’s Attention: Black Holes

(DMNS) 18 / 1
Contrast & Affinity and Story Intensity

Contrasts

Use contrasting elements to increase visual intensity, interest

(DMNS) 19 / 1
Contrast & Affinity and Story Intensity

Affinity

Similar visual elements to decrease visual intensity/dynamic

(DMNS) 20 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


Similar ...

(DMNS) 21 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


Similar ...

(DMNS) 21 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


Similar ...

(DMNS) 21 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


Similar ...

(DMNS) 21 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


Similar ...

(DMNS) 21 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


Similar ...

(DMNS) 21 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


Similar ...

(DMNS) 21 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


Similar ...

(DMNS) 21 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


Similar ...

(DMNS) 21 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


Similar ...

(DMNS) 21 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements

(DMNS) 21 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


... Different

(DMNS) 22 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


... Different

(DMNS) 22 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


... Different

(DMNS) 22 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


... Different

(DMNS) 22 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


... Different

(DMNS) 22 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


... Different

(DMNS) 22 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


... Different

(DMNS) 22 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


... Different

(DMNS) 22 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


... Different

(DMNS) 22 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements


... Different

(DMNS) 22 / 1
Contrast & Affinity and Story Intensity

Affinity and Contrast in Movements

(DMNS) 22 / 1
Contrast & Affinity and Story Intensity

Story Intensity

Can build up with contrasts in:


Actors: dialogue
Forms: mise en scène, composition
Color, luminance: production design, cinematography
Editing: shot lengths, pace of cutting
Motion: camera movement, montage

(DMNS) 23 / 1
Contrast & Affinity and Story Intensity

Story Intensity

(DMNS) 24 / 1
Contrast & Affinity and Story Intensity

Raiders of the Lost Ark (from Block 2001)

(DMNS) 25 / 1
Contrast & Affinity and Story Intensity

Black Holes: The Other Side of Infinity

(DMNS) 26 / 1
Future Research

Affective Response in Video

Some previous work:

Motion (Detenber, Simons, & Bennett 1998; Simons et al. 2000,


2003; Ravaja 2004)
Editing (Hanjalic 2003; Hanjalic & Xu 2005)
Color (Detenber, Simons, & Reiss 2000)
Audio (Neuman, Crigier, & Bove 1991; Västfjäll 2002, 2003)
Image quality (Duh et al. 2002, Bracken 2005)

(DMNS) 27 / 1
Future Research

Three Dimensions of Emotions


Valence: positive vs. negative feelings
Arousal: calm vs. excited
Control: dominance, in-control vs. out-of-control

(DMNS) 28 / 1
Future Research

Three Dimensions of Emotions


Valence: positive vs. negative feelings
Arousal: calm vs. excited

(DMNS) 28 / 1
Future Research

Previous affective response studies

Lang, Dhillon, & Dong 1995


Arousing messages remembered better than calm messages
Positive messages remembered better than negative messages
Lang, Newhagen, & Reeves 1996
Negative messages:
increases attention
increases capacity to process
facilitates recognition of info presented in video
inhibits info presented before video
increases negative impact of story

(DMNS) 29 / 1
Future Research

Hanjalic & Xu 2001: (computational response)

(DMNS) 30 / 1
Future Research

Hanjalic & Xu 2001: (computational response)

(DMNS) 30 / 1
Future Research

Hanjalic & Xu 2001: (computational response)

(DMNS) 30 / 1
Future Research

Hanjalic & Xu 2001: (computational response)

(DMNS) 30 / 1
Future Research

Fulldome Research

Studies on cognitive effects done or in progress:


Hatada et al. 1980
Sumners & Reiff 2002
Sahami et al. 2008 (in prep.)
First affective study:
Maya Skies show at Chabot Space & Science Center

(DMNS) 31 / 1
Future Research

Fulldome Research

Studies on cognitive effects done or in progress:


Hatada et al. 1980
Sumners & Reiff 2002
Sahami et al. 2008 (in prep.)
First affective study:
Maya Skies show at Chabot Space & Science Center
Future affective work:
What is most effective for learning, retention, viewer interest and
engagement?
How does the immersive display environment help/hinder?
What are the specific media aesthetics that apply to this medium?

(DMNS) 31 / 1
Future Research

Further Reading

Rudolf Arnheim, 1974, Art and Visual Perception


Bruce Block, 2001, The Visual Story: Seeing the Structure of Film,
TV, and New Media
David Bordwell, 2005, Figures Traced in Light: On Cinematic Staging
David Bordwell & Kristin Thompson, 2001, Film Art: An
Introduction, 6th edition
Louis Giannetti, 2005, Understanding Movies, 10th edition
Alan Hanjalic, March 2006, “Extracting Moods from Pictures and
Sounds”, IEEE Signal Processing Magazine, pp. 90–100.
Margaret Livingstone, 2002, Vision and Art: The Biology of Seeing
Robert Solso, 1994, Cognition and the Visual Arts
Herbert Zettl, 1999, Sight, Sound, Motion: Applied Media Aesthetics,
3rd edition
(DMNS) 32 / 1

You might also like