[ 6 ]
MUSIC AND
FILM PERCEPTION AND INTERPRETATION
6.1
Aim of experiment
First we measured
the effect of different underscoring on pleasure and arousal ratings for each
visual stimulus. Then we considered a deeper effect of music when used to
accompany a film: soundtrack may also affect the viewer/listener's perception
of an ambiguous stimulus, such as an open-ended film excerpt.
6.2
Participants and experimental design
Sad/Happy
(-4; +4)
Calm/Exciting
(-4; +4)
Playful/Solemn
(-4; +4)
Interesting/Boring
(-4; +4)
Tragic/Joyful
(-4; +4)
Relaxing/Stimulating
(-4; +4)
A multiple-choice question was added to the questionnaire. Participants were presented two possible interpretations of the film excerpts, and had to choose the one they considered the most likely.
Our hypothesis was that a change of underscoring for the same visual material could possibly trigger a different description of the scene as most appropriate.
Combination 01Film: WALKING - Music: LYDIOM (group A), SUNSHINE (group B)Interpretation: The young woman is(1) Wandering on her own (2) Seeking companyCombination 02Film: COUPLE - Music: DUNCAN (group A), CHILI (group B)Interpretation: The people in the car are leaving for:(1) A long journey (2) A day tripCombination 03Film: CHEERS - Music: CHILI (group A), GRACE (group B)Interpretation: The young man does not accept the wine because(1) He doesn't usually drink (2) He is not in the right moodCombination 04Film: PHONE Music: THROW (group A), DUNCAN (group B)Interpretation: The phone call is about:(1) Sentimental matters (2) Some illicit activityCombination 05Film: CARS - Music: GRACE (group A), THROW (group B)Interpretation: The people in the first car are:(1) Racing with the other car (2) Worried they are being followedCombination 06Film: FLOWERS - Music: SUNSHINE (group A), LYDIOM (group B)Interpretation: The young woman is asking(1) About a missing person (2) For advice on flowers to buy
6.3
Results
|
Group
(A) |
Pleasure |
Arousal |
|
combination
#1 |
P=2.47
(.84) |
A=4.02
(1.73) |
|
combination
#2 |
P=4.23
(1.67) |
A=3.79
(1.71) |
|
combination
#3 |
P=4.93
(1.55) |
A=4.61
(1.04) |
|
combination
#4 |
P=3.05
(.93) |
A=4.78
(1.86) |
|
combination
#5 |
P=2.72
(1.25) |
A=4.91
(1.07) |
|
combination
#6 |
P=3.65
(1.73) |
A=4.35
(1.58) |
Table
6.3.1 - Ratings of audiovisual combinations for group A (n=51).
|
Group
(B) |
Pleasure |
Arousal |
|
Combination
#1 |
P=2.80
(1.38) |
A=3.93
(1.21) |
|
Combination
#2 |
P=5.47
(1.26) |
A=4.20
(1.56) |
|
Combination
#3 |
P=3.02
(1.29) |
A=3.63
(1.60) |
|
Combination
#4 |
P=1.92
(.98) |
A=4.69
(1.66) |
|
Combination
#5 |
P=3.91
(1.60) |
A=6.00
(1.09) |
|
Combination
#6 |
P=3.15
(.87) |
A=3.55
(1.13) |
Also within group B male and female ratings were compared with independent-samples t-tests. All differences in Pleasure and Arousal were non-significant.
6.4
Effects of underscoring
|
PLEASURE |
Film
alone |
Film
+ Music A |
Film
+ Music B |
|
01 |
P=4.07 |
P=2.47 |
P=2.80 |
|
02 |
P=5.00 |
P=4.23 |
P=5.47 |
|
03 |
P=4.70 |
P=4.93 |
P=3.02 |
|
04 |
P=2.63 |
P=3.05 |
P=1.92 |
|
05 |
P=3.46 |
P=2.72 |
P=3.91 |
|
06 |
P=4.15 |
P=3.65 |
P=3.15 |
Table
6.4.1 - Pleasure scores for film alone and film with soundtrack.
|
AROUSAL |
Film
alone |
Film
+ Music A |
Film
+ Music B |
|
01 |
A=4.13 |
A=4.02 |
A=3.93 |
|
02 |
A=3.42 |
A=3.79 |
A=4.20 |
|
03 |
A=5.63 |
A=4.61 |
A=3.63 |
|
04 |
A=3.10 |
A=4.78 |
A=4.69 |
|
05 |
A=5.63 |
A=4.91 |
A=6.00 |
|
06 |
A=2.98 |
A=4.35 |
A=3.55 |
Table 6.4.2 - Arousal scores for film alone and film with soundtrack.
Chart 6.4.1 - Pleasure scores for film alone, film + music A, film + music B.
Chart 6.4.2 - Arousal scores for film alone, film + music A, film + music B.
We ran t-tests for independent samples to check whether the effect of underscoring on film appraisal was significant or not.Arousal and Pleasure means obtained in all different conditions have been compared as follows:
a) Film only vs. Film + Music A
b) Film only vs. Film + Music B
|
|
Film
only vs. Film
+ Music A (df=156) |
Film
only vs. Film
+ Music B (df=146) |
Film
+ Music A vs. Film
+ Music B (df=90) |
|
1 |
t=10.6461** |
t=7.1582** |
t=1.4906,
n.s. |
|
2 |
t=3.7535** |
t=2.2238* |
t=4.8037** |
|
3 |
t=1.2155,
n.s. |
t=8.5326** |
t=7.5668** |
|
4 |
t=2.2588* |
t=3.4933** |
t=5.4428** |
|
5 |
t=4.4097** |
t=2.3945* |
t=4.7375** |
|
6 |
t=2.4539* |
t=5.0300** |
t=2.0219* |
|
|
Film
only vs. Film
+ Music A (df=156) |
Film
only vs. Film
+ Music B (df=146) |
Film
+ Music A vs. Film
+ Music B (df=90) |
|
1 |
t=.6012,
n.s. |
t=.8933,
n.s. |
t=.3045,
n.s. |
|
2 |
t=1.9315,
n.s. |
t=3.8872** |
t=1.5061,
n.s. |
|
3 |
t=5.8774** |
t=9.9674** |
t=4.0776** |
|
4 |
t=8.0166** |
t=7.2090** |
t=0.3203,
n.s. |
|
5 |
t=3.1833** |
t=1.6597,
n.s. |
t=4.0124** |
|
6 |
t=6.7299** |
t=2.4432** |
t=2.7885** |
From these results we can gather that music very often (75% of the cases) happens to affect overall semantic differential ratings of a film excerpt.
We can also see that when different pieces of music are used to underscore the same film, they have a different impact on the ratings.Such differences are probably due to singular characteristics of a particular piece of music.
However the
effect of underscoring on semantic differential ratings seems to occur more
frequently in the Pleasure dimension (89% of the cases) than in the Arousal
dimension (61% of the cases).
6.5
Soundtrack and interpretation

Chart 6.5.1 - Percentage of participants for each group who choose interpretation X vs. interpretation Y as the most likely.
|
SCENE
01 |
Interpretation
X |
interpretation
Y |
|
group
A |
42
(82.4%) |
9
(17.6%) |
|
group
B |
26
(63.4%) |
15
(36.6%) |
chi-square
= 4.228, df=1, p<.05
|
SCENE
02 |
Interpretation
X |
interpretation
Y |
|
group
A |
24
(47.1%) |
27
(52.9%) |
|
group
B |
1
(2.4%) |
40
(97.6%) |
chi-square
= 22.866, df=1, p<.01
(Yates'
correction for continuity applied)
|
SCENE
03 |
interpretation
X |
interpretation
Y |
|
group
A |
15
(29.4%) |
36
(70.6%) |
|
group
B |
4
(9.8%) |
37
(90.2%) |
chi-square
= 5.358, df=1, p<.05
(Yates'
correction for continuity applied)
|
SCENE
04 |
interpretation
X |
interpretation
Y |
|
group
A |
28
(54.9%) |
23
(45.1%) |
|
group
B |
29
(70.7%) |
12
(29.3%) |
chi-square
= 2.416, df=1, n.s.
|
SCENE
05 |
interpretation
X |
interpretation
Y |
|
group
A |
2
(3.9%) |
49
(96.1%) |
|
group
B |
16
(39.0%) |
25
(61.0%) |
chi-square
= 17.796, df=1, p<.01
(Yates'
correction for continuity applied)
|
SCENE
06 |
interpretation
X |
interpretation
Y |
|
group
A |
30
(58.8%) |
21
(41.2%) |
|
group
B |
28
(68.3%) |
13
(31.7%) |
chi-square
= .875, df=1, n.s.
6.6
Effects of music appropriateness
d_int = abs [% (interpretation X) - % (interpretation Y)]
|
Scene |
Fit |
Interpretation
X |
Interpretation
Y |
D_Int |
|
#01
(group A) |
7.06 |
82.40 |
17.60 |
64.80 |
|
#02
(group A) |
2.53 |
47.10 |
52.90 |
5.80 |
|
#03
(group A) |
4.59 |
29.40 |
70.60 |
41.20 |
|
#04
(group A) |
1.12 |
54.90 |
45.10 |
9.80 |
|
#05
(group A) |
6.24 |
3.90 |
96.10 |
92.20 |
|
#06
(group A) |
2.24 |
58.80 |
41.20 |
17.60 |
|
#01
(group B) |
1.53 |
63.40 |
36.60 |
26.80 |
|
#02
(group B) |
5.41 |
2.40 |
97.60 |
95.20 |
|
#03
(group B) |
4.42 |
9.80 |
90.20 |
80.40 |
|
#04
(group B) |
6.24 |
70.70 |
29.30 |
41.40 |
|
#05
(group B) |
5.82 |
39.00 |
61.00 |
22.00 |
|
#06
(group B) |
3.53 |
68.30 |
31.70 |
36.60 |
r (Fit, D_Int) = .658, n=12, p<.01
Whereas, when music and film are perceived as contrasting (i.e. low fit values), preferences will be more spread between alternatives.
Pearson's correlation coefficient was calculated for both Fit and Pleasure and for Fit and Arousal:
r (Fit, PL) = -.142, n=12, n.s.
r (Fit, AR) = .258, n=12, n.s.
Results indicate that the contrasting/congruent relationship between visual and auditory material (i.e. low vs. high fit) does not seem to affect the overall Pleasure and Arousal appraisal of the audiovisual combinations.
r (PL, D_Int) = .012, n=12, n.s.
r (AR, D_Int) = -.097, n=12, n.s.
A highly activating or playful scene will not trigger one specific explanation, and neither will a very calm or sad one.In other words, appraising the semantic qualities of a film scene seems to have little or nothing to do with the process of choosing an interpretation for it.
All the above results display that the distribution of preferences for the most likely interpretation is related only to the congruent vs. contrasting relationship between film and music, and not to the evaluative ratings of the stimuli.
(c)
2001-2002 Guglielmo Bottin
- all rights reserved