[ 6 ]

MUSIC AND FILM PERCEPTION AND INTERPRETATION

 

 

6.1 Aim of experiment

 

The final part of our research was aimed to investigate how the same film excerpts are perceived and interpreted when they are accompanied by different pieces of music.

First we measured the effect of different underscoring on pleasure and arousal ratings for each visual stimulus. Then we considered a deeper effect of music when used to accompany a film: soundtrack may also affect the viewer/listener's perception of an ambiguous stimulus, such as an open-ended film excerpt. On this account we hypothesized that from the same visual material different interpretations could arise, as an effect of the specific soundtrack the visuals are paired with. The interaction between the visuals and the music was also expected to vary from combinations in which film and soundtrack are contrasting, compared to combinations in which film and music fit well together.

 

6.2 Participants and experimental design

 

Participants (f=76, m=16), all students of University of Padova, were split into two groups and assigned to condition A (f=42, m=9) or condition B (f=34, m=7), which represented different combinations of the same film and music materialThey all were in an auditorium while the film was projected on a large screen and music was played through the speakers.The response sheet included the semantic differential scales used in the previous phases of the research:

 

Sad/Happy (-4; +4)

Calm/Exciting (-4; +4)

Playful/Solemn (-4; +4)

Interesting/Boring (-4; +4)

Tragic/Joyful (-4; +4)

Relaxing/Stimulating (-4; +4)

 

A multiple-choice question was added to the questionnaire. Participants were presented two possible interpretations of the film excerpts, and had to choose the one they considered the most likely.

Our hypothesis was that a change of underscoring for the same visual material could possibly trigger a different description of the scene as most appropriate. 

A small group appraised the material and produced different descriptions for each episode. The most widely shared interpretations (two mutually exclusive explanations for each scene) were then chosen for the final experiment.

 

 

Combination 01
Film: WALKING - Music: LYDIOM (group A), SUNSHINE (group B)
Interpretation: The young woman is
(1) Wandering on her own                    (2) Seeking company
 
Combination 02
Film: COUPLE - Music: DUNCAN (group A), CHILI (group B)
Interpretation: The people in the car are leaving for:
(1) A long journey                               (2) A day trip
 
Combination 03
Film: CHEERS - Music: CHILI (group A), GRACE (group B)
Interpretation: The young man does not accept the wine because
(1) He doesn't usually drink                           (2) He is not in the right mood
 
Combination 04
Film: PHONE Music: THROW (group A), DUNCAN (group B)
Interpretation: The phone call is about:
(1) Sentimental matters                         (2) Some illicit activity
Combination 05
Film: CARS - Music: GRACE (group A), THROW (group B)
Interpretation: The people in the first car are:
(1) Racing with the other car            (2) Worried they are being followed
 
Combination 06
Film: FLOWERS - Music: SUNSHINE (group A), LYDIOM (group B)
Interpretation: The young woman is asking
(1) About a missing person      (2) For advice on flowers to buy

  

6.3 Results

 

Pleasure and Arousal indices have been calculated using the same formulas as in the previous experiments. Results for group A were:

 

Group (A)

Pleasure

Arousal

combination #1

P=2.47 (.84)

A=4.02 (1.73)

combination #2

P=4.23 (1.67)

A=3.79 (1.71)

combination #3

P=4.93 (1.55)

A=4.61 (1.04)

combination #4

P=3.05 (.93)

A=4.78 (1.86)

combination #5

P=2.72 (1.25)

A=4.91 (1.07)

combination #6

P=3.65 (1.73)

A=4.35 (1.58)

 

Table 6.3.1 - Ratings of audiovisual combinations for group A (n=51).

 

Within group A, we compared the male and female ratings using independent-samples t-tests.All differences in Pleasure and Arousal were non-significant. Combinations presented to group B were rated as follows:

 

Group (B)

Pleasure

Arousal

Combination #1

P=2.80 (1.38)

A=3.93 (1.21)

Combination #2

P=5.47 (1.26)

A=4.20 (1.56)

Combination #3

P=3.02 (1.29)

A=3.63 (1.60)

Combination #4

P=1.92 (.98)

A=4.69 (1.66)

Combination #5

P=3.91 (1.60)

A=6.00 (1.09)

Combination #6

P=3.15 (.87)

A=3.55 (1.13)

 

Table 6.3.2 - Ratings of audiovisual combinations for group B (n=41). 

Also within group B male and female ratings were compared with independent-samples t-tests. All differences in Pleasure and Arousal were non-significant.

Please note that all music and film rated differently by female vs. male subgroups had already been removed from the stimuli set in the first part of the research. Thus, non-significant differences for both group A and group B can probably be ascribed to this exclusion.

6.4 Effects of underscoring

 

Differences between conditions are more easily identifiable when considering Pleasure and Arousal factors separately.These two tables display Pleasure and Arousal scores for film only, film + music A, and film + music B conditions.

 

PLEASURE

Film alone

Film + Music A

Film + Music B

01

P=4.07

P=2.47

P=2.80

02

P=5.00

P=4.23

P=5.47

03

P=4.70

P=4.93

P=3.02

04

P=2.63

P=3.05

P=1.92

05

P=3.46

P=2.72

P=3.91

06

P=4.15

P=3.65

P=3.15

 

Table 6.4.1 - Pleasure scores for film alone and film with soundtrack.

 

 

AROUSAL

Film alone

Film + Music A

Film + Music B

01

A=4.13

A=4.02

A=3.93

02

A=3.42

A=3.79

A=4.20

03

A=5.63

A=4.61

A=3.63

04

A=3.10

A=4.78

A=4.69

05

A=5.63

A=4.91

A=6.00

06

A=2.98

A=4.35

A=3.55

 

Table 6.4.2 - Arousal scores for film alone and film with soundtrack.

 

 

Chart 6.4.1 - Pleasure scores for film alone, film + music A, film + music B.

 

 

 

Chart 6.4.2 - Arousal scores for film alone, film + music A, film + music B.

 

We ran t-tests for independent samples to check whether the effect of underscoring on film appraisal was significant or not.Arousal and Pleasure means obtained in all different conditions have been compared as follows: 

a)      Film only   vs.     Film + Music A

b)      Film only   vs.     Film + Music B 

c) Film + Music A    vs.     Film + Music B 

 

 PLEASURE

 

Film only vs.

Film + Music A (df=156)

Film only vs.

Film + Music B (df=146)

Film + Music A vs.

Film + Music B (df=90)

1

t=10.6461**

t=7.1582**

t=1.4906, n.s.

2

t=3.7535**

t=2.2238*

t=4.8037**

3

t=1.2155, n.s.

t=8.5326**

t=7.5668**

4

t=2.2588*

t=3.4933**

t=5.4428**

5

t=4.4097**

t=2.3945*

t=4.7375**

6

t=2.4539*

t=5.0300**

t=2.0219*

 Table 6.4.3 t-test results (independent samples) for Pleasure means.(*: p<.05 ; **: p<.01)   

 

AROUSAL

 

Film only vs.

Film + Music A (df=156)

Film only vs.

Film + Music B (df=146)

Film + Music A vs.

Film + Music B (df=90)

1

t=.6012, n.s.    

t=.8933, n.s.

t=.3045, n.s.

2

t=1.9315, n.s.

t=3.8872**

t=1.5061, n.s.

3

t=5.8774**

t=9.9674**

t=4.0776**

4

t=8.0166**

t=7.2090**

t=0.3203, n.s.

5

t=3.1833**

t=1.6597, n.s.

t=4.0124**

6

t=6.7299**

t=2.4432**

t=2.7885**

 
Table 6.4.4 t-test results (independent samples) for Arousal means. (*: p<.05 ; **: p<.01)

 

From these results we can gather that music very often (75% of the cases) happens to affect overall semantic differential ratings of a film excerpt.

We can also see that when different pieces of music are used to underscore the same film, they have a different impact on the ratings.Such differences are probably due to singular characteristics of a particular piece of music.

However the effect of underscoring on semantic differential ratings seems to occur more frequently in the Pleasure dimension (89% of the cases) than in the Arousal dimension (61% of the cases). 

 

6.5 Soundtrack and interpretation

 

Interpretation was indicated by responses to the last item of the questionnaire, a multiple-choice question that featured two possible explanations for each film scene. Participants had to choose the one interpretation they thought it was more likely. For each film/music combination, the percentages of participants preferring interpretation X vs. interpretation Y are displayed in the following charts. 

 

   

 

Chart 6.5.1 - Percentage of participants for each group who choose interpretation X vs. interpretation Y as the most likely. 

 At this point, chi-square tests were used to verify the significance of inter-group differences in the interpretation of each sequence.   

 

SCENE 01

Interpretation X

interpretation Y

group A

42 (82.4%)

9 (17.6%)

group B

26 (63.4%)

15 (36.6%)

chi-square = 4.228, df=1, p<.05

 

 

SCENE 02

Interpretation X

interpretation Y

group A

24 (47.1%)

27 (52.9%)

group B

1 (2.4%)

40 (97.6%)

chi-square = 22.866, df=1, p<.01

(Yates' correction for continuity applied)

 

SCENE 03

interpretation X

interpretation Y

group A

15 (29.4%)

36 (70.6%)

group B

4 (9.8%)

37 (90.2%)

chi-square = 5.358, df=1, p<.05

(Yates' correction for continuity applied)

 

SCENE 04

interpretation X

interpretation Y

group A

28 (54.9%)

23 (45.1%)

group B

29 (70.7%)

12 (29.3%)

chi-square = 2.416, df=1, n.s.

 

SCENE 05

interpretation X

interpretation Y

group A

2 (3.9%)

49 (96.1%)

group B

16 (39.0%)

25 (61.0%)

chi-square = 17.796, df=1, p<.01

(Yates' correction for continuity applied)

 

SCENE 06

interpretation X

interpretation Y

group A

30 (58.8%)

21 (41.2%)

group B

28 (68.3%)

13 (31.7%)

chi-square = .875, df=1, n.s.

 

 

From the above results we can conclude that, in at least four cases out of six, a significant change in the choice of the most likely interpretation can be ascribed to the different underscore the film excerpts is accompanied by.In scene five a similar tendency is also detectable, although it does not reach a significant level. 

 

6.6 Effects of music appropriateness

 

Earlier we introduced the concept of 'fit' as 'music/film congruency', a measure of which has earlier been collected for each of the combinations used in the experiment. We also hypothesized that effect of music on film appraisal would vary from those cases in which the soundtrack was perceived congruent with the film, to the ones in which the music it was perceived as contrasting with the visual material.In other words, for high values in fit, the majority of participants would give their preference to one particular interpretation. Whereas for lower fit scores participants' preferences would be more spread to between the two interpretations.This hypothesis can be tested by calculating under different fit values how focused vs. spread the choices for interpretation are.

 

The variable d_int (difference between interpretation), which measures the polarization of participants' preferences, was calculated as the difference between the percentage of participants choosing interpretation X and the percentage of the ones choosing interpretation Y.

 

d_int = abs [% (interpretation X) - % (interpretation Y)]

 

Therefore, for each stimulus, if a vast consent goes to one interpretation, the value for d_int will be bigger. Whereas, when preferences are more spread between the alternatives, the value for d_int will be smaller. 

Scene

Fit

Interpretation X

Interpretation Y

D_Int

#01 (group A)

7.06

82.40

17.60

64.80

#02 (group A)

2.53

47.10

52.90

5.80

#03 (group A)

4.59

29.40

70.60

41.20

#04 (group A)

1.12

54.90

45.10

9.80

#05 (group A)

6.24

3.90

96.10

92.20

#06 (group A)

2.24

58.80

41.20

17.60

#01 (group B)

1.53

63.40

36.60

26.80

#02 (group B)

5.41

2.40

97.60

95.20

#03 (group B)

4.42

9.80

90.20

80.40

#04 (group B)

6.24

70.70

29.30

41.40

#05 (group B)

5.82

39.00

61.00

22.00

#06 (group B)

3.53

68.30

31.70

36.60

 

Table 6.6.1 -Fit, percentage of preferences, differences between percentages. 

 

 

Calculating Pearson's r coefficient, Fit and D_Int proved to be significantly correlated:

 

r (Fit, D_Int) = .658, n=12, p<.01

 

Thus, we can say that in conditions of perceived congruency between film and music (i.e. high fit values), preferences for the most likely interpretation will gather on one of the given alternatives. 

Whereas, when music and film are perceived as contrasting (i.e. low fit values), preferences will be more spread between alternatives. 

We also inspected the relation between Fit and overall Pleasure and Arousal scores of the audiovisual stimuli.This procedure was aimed to check whether participants' ratings of semantic differential scales were affected by the congruency vs. contrast of the audiovisual pairing when appraising the overall stimuli. 

 

Pearson's correlation coefficient was calculated for both Fit and Pleasure and for Fit and Arousal:

 

r (Fit, PL) = -.142, n=12, n.s.

 

r (Fit, AR) = .258, n=12, n.s.

 

Results indicate that the contrasting/congruent relationship between visual and auditory material (i.e. low vs. high fit) does not seem to affect the overall Pleasure and Arousal appraisal of the audiovisual combinations.

 

Pleasure and Arousal scores also do not seem to be related with the distribution of the choices for the two interpretations (D_Int):

 

r (PL, D_Int) = .012, n=12, n.s.

 

r (AR, D_Int) = -.097, n=12, n.s.

 

A highly activating or playful scene will not trigger one specific explanation, and neither will a very calm or sad one.In other words, appraising the semantic qualities of a film scene seems to have little or nothing to do with the process of choosing an interpretation for it. 

All the above results display that the distribution of preferences for the most likely interpretation is related only to the congruent vs. contrasting relationship between film and music, and not to the evaluative ratings of the stimuli.

 

[ next ]-[ index ]

(c) 2001-2002 Guglielmo Bottin - all rights reserved