Professional Documents
Culture Documents
The Influence of Media On Advertising Effectiveness: A Comparison of Internet, Posters and Radio
The Influence of Media On Advertising Effectiveness: A Comparison of Internet, Posters and Radio
47 Issue 4
Introduction
Research on the comparative effects of different advertising media has to
a large extent focused on the persuasive effectiveness of different media such
as print, radio and television (Wright 1974; Liu & Stout 1987; Stafford &
Day 1995; see also Taylor & Thompson 1982). Advertising effectiveness
is typically measured as attitude towards the advertised product/service,
attitude towards the advertisement, and intention to purchase the
advertised product/service. Recently the development of the internet has
resulted in an increased interest in the effects of media in advertising
(Ducoffe 1996; Briggs & Hollis 1997; Singh & Dalal 1999; Dahlen &
Bergendahl 2001; Dou et al. 2001; Chen et al. 2002; Cho 2003; Pashupati
& Lee 2003). However, only a few studies include a comparison of the
effectiveness of traditional media with internet and interactive media
(Brackett & Carr 2001; Gallagher, Foster & Parsons 2001; Gallagher,
Parsons & Foster 2001; Yoon & Kim 2001; Kaid 2002). Typically, these
studies reveal marginal differences in advertising effectiveness across
media. Previous studies comparing the effectiveness of advertisements
presented in traditional media (i.e. print, radio) have also identified few
and generally weak effects of the media on product attitudes (Wright
1974; Taylor & Thompson 1982; Liu & Stout 1987; Stafford & Day
1995). The lack of findings with respect to media effects is somewhat
surprising given the importance most practitioners and laymen attach to
the media.
There are several potential explanations for the lack of findings with
regard to media effects. For instance, there are a number of different effect
variables in addition to the ones outlined above that might have the
potential to vary across media. Variables such as attitude and intention to
buy products presuppose attention from the respondents and, based on
these outcome variables, it is difficult to identify effects with regard to the
relative ability of different media to attract attention. Also, research
procedures employed to separate media effects from other sources might
affect the findings with regard to media effectiveness. For example, in
experimental designs, the focus on content control of advertisements has
made researchers present the same text in various media. Wright’s (1974)
radio advertisement was based on reading aloud a print brochure. Thus,
the radio advertisement was not specifically designed as such, and hence
the quality might be inferior to that of a typical radio ad. Also in recent
studies including internet advertisements, Gallagher, Foster and Parsons
(2001) presented a brochure format on the web – although they included
some active links in the web presentation. Hence, procedures used to
achieve control of ad content to avoid confounding of media and ad
content, might introduce a rival explanation for the findings (or lack
thereof) in that ads in different media vary in terms of quality.
The purpose of this paper is to compare the advertising effectiveness of
different media. In this comparison of advertising effectiveness we focus
on the following variables: attitude towards the product; attitude towards
the ad; perceived decision support. Furthermore, the study includes a
control in that the relative quality of the ad is introduced as a covariate. In
the subsequent sections we start with a discussion of dimensions of adver-
tising effectiveness, followed by a discussion of potential media effects on
advertising effectiveness. Based on this discussion, we present a conceptual
model that serves as the basis for proposing several hypotheses, before we
address methodological considerations with regard to design and measure-
ment. Finally, the findings are presented and the implications discussed.
384
International Journal of Market Research Vol. 47 Issue 4
385
The influence of media on advertising effectiveness
386
International Journal of Market Research Vol. 47 Issue 4
1 Wright (1974) read the text of a print advertisement on the radio when comparing the advertising effectiveness of
print and radio. Hence, the comparison of media effectiveness may be based on a high-quality print advertisement
and a low-quality radio advertisement because the need for content control restricts the use of creative elements of
the radio. A radio advertisement without any music or sound effects will probably be perceived as dull and as a
relatively low-quality radio advertisement compared to other radio advertisements.
387
The influence of media on advertising effectiveness
Medium
Ad effectiveness
• Attitude to product
Medium × Appeal • Attitude to ad
• Decision support
Relative quality
of advertisement
Propositions
In the current study we focus on internet advertisements (pop-ups), print
advertisements (posters) and radio advertisements. The main reason for
expecting to find media effects on advertisement effectiveness is related to
the receivers’ opportunity to elaborate upon the information presented in
the advertisement. Wright (1974) argued that media effects stem from the
ability of different media to provide the receiver with the opportunity to
control the presentation and transmission of the information offered by
2 Employing several ads of varying quality for each medium would be a strong research design to detect media
effects in advertising. However, this would certainly require some financial consideration, because the development
of many ad copies is a costly procedure. Thus, employing relative ad quality as a covariate is perhaps a more
realistic alternative, although the design is somewhat weaker.
388
International Journal of Market Research Vol. 47 Issue 4
389
The influence of media on advertising effectiveness
390
International Journal of Market Research Vol. 47 Issue 4
391
The influence of media on advertising effectiveness
Methodology
The study included three different media: internet (pop-ups), print
(posters) and radio. Furthermore, the study included two appeals
(emotional and rational/informative) and two different products: an airline
ticket and a weekend stay at a hotel in a ski resort. The products were new
on the markets (fake products) offered by well-known companies. Thus, a
3 × 2 × 2 between-subject design was employed for the study.
Stimuli development
Several issues have to be addressed with regard to stimuli development.
First, the study must be designed carefully to avoid confounding between
the effects of the medium and the advertisement content. Second, the
stimuli should utilise and take full advantage of specific characteristics
392
International Journal of Market Research Vol. 47 Issue 4
393
The influence of media on advertising effectiveness
Internet (pop-ups)
The airline ticket/rational advertisement had a similar design to the poster,
and a description of the conditions that applied to using the ticket were
given at the website. In addition, users could click on links to get more
detailed information about the conditions of using the airline ticket.
394
International Journal of Market Research Vol. 47 Issue 4
Measures
Attitude towards the product contained three items focusing on how well
the product was perceived and how the respondents liked it (e.g. Mitchell
395
The influence of media on advertising effectiveness
Average
Factor Item variance
Items loadings1 reliability extracted2
Attitude to product
The advertised product was very good 0.89 0.80 0.65
The advertised product was very bad (reversed) 0.95 0.91
I became interested in the product after listening to/seeing
the advertisement 0.50 0.25
Attitude to advertisement
The advertisement was good 0.84 0.70 0.63
I liked the advertisement very much 0.76 0.58
The advertisement had a low quality (reversed) 0.77 0.60
Decision support
The information presented in the advertisement gave me a useful
base to decide whether or not to buy the product 0.81 0.66 0.65
I feel that the advertisement gave me good decision support 0.98 0.95
In addition to the advertisement, I would have needed more information
before deciding whether to buy the product or not (reversed) 0.59 0.35
Estimated correlations among dependent variables
1 2 3
Attitude to product (1) 1.0
Attitude to advertisement (2) 0.67** 1.0
(0.04)3
Decision support (3) 0.44** 0.47** 1.0
(0.05) (0.06)
Notes:
χ2 = 81.95 (24df), RMSEA = 0.097 [0.074–0.12], CFI = 0.96, GFI = 0.93
(1) Standardised loadings
(2) Recommended criterion > 0.5 (cf. Bagozzi & Yi 1988)
(3) Standard error in parentheses
** p < 0.01.
396
International Journal of Market Research Vol. 47 Issue 4
Manipulation check
Six items were used to examine the message appeal of the ad stimuli. A fac-
tor analysis (maximum likelihood, oblimin rotation) revealed two factors:
five items loading on the first factor was used as a measure of emotional
appeal (alpha = 0.89); the second factor contained a single item and was
used as a measure of rational appeal. The items are presented in the
Appendix.
A manipulation check of the message appeals revealed that, in general,
ads with emotional appeals were perceived both as more emotional (F =
15.020, p < 0.01) and as less rational (F = 9.758, p < 0.01) as compared
to ads with a rational appeal. A similar analysis was also conducted within
each of the three media. This showed significant differences between
emotional and rational appeal within radio and internet, but no significant
difference between emotional appeal and rational appeal for the posters.
In the subsequent presentation of the results we include all media, because
excluding the posters does not significantly alter the presented results.
Results
The effectiveness of the advertisements presented in the three media is
based on comparisons of mean values of the dependent variables: attitude
397
The influence of media on advertising effectiveness
398
International Journal of Market Research Vol. 47 Issue 4
Table 3 Results
399
The influence of media on advertising effectiveness
400
International Journal of Market Research Vol. 47 Issue 4
Discussion
It is argued that internet and print media provide the receiver with more
control with regard to processing ad information as opposed to ads
presented on radio. Given the opportunity to elaborate on the ad, such as
is offered by the experimental procedure employed, internet and print
(posters) appear to be more effective media as compared to radio. Hence,
the present research lends support to media effects on advertising
effectiveness. In addition, it reveals effects of message appeals and effects
of relative quality of advertisements on advertising effectiveness.
Radio was argued to provide less opportunity for the receiver to control
the processing of the advertisement information. Hence, it is potentially a
less suitable medium for information processing by a highly involved
audience. However, radio might be relatively more effective in a low-
involvement context. This accords with previous research on the use of
music and spokespeople in radio ads that found radio to be an effective
medium to facilitate recall (Wheatley & Brooker 1994).
The present research found few differences in advertising effectiveness
between print (posters) and internet media. To some extent these might be
attributable to the type of internet media used in the present study, which
focused on pop-up advertisements on a brand home page. However, there
are several other types of internet advertisement that could have been
investigated, such as banners and buttons. More importantly, the internet
advertisement stimuli presented in this study were rather limited in terms
of interactivity, omitting for instance communities and personalised ser-
vices. Thus, the internet advertisements appear relatively similar to print
advertisements. Based on the arguments with regard to control of infor-
mation processing in addition to increased feedback and personalisation
opportunities offered by internet media, it is not unlikely that internet
solutions offering these facilities would prove more effective as compared
to print advertisements. Furthermore, the variety of opportunities offered
by internet media suggest that this medium might possess the potential to
be more effective for almost all kinds of advertisement objective.
Several aspects of the procedure employed merit further attention. First,
the use of the brief as the basis for experimental control has not, to our
knowledge, been employed before. The main advantage with this
procedure is that it opens up full usage of the opportunities offered by
different media. In contrast, the most common procedure to attain
experimental control is to ensure that the message and major parts of the
presentation format are similar across media. In using this approach one
risks trading a realistic use of the characteristics offered by different media
401
The influence of media on advertising effectiveness
with experimental control of the message. This would most likely lead to
advertisements differing with regard to quality for the different media.
Consequently, the control employed to avoid confounding between
message and media might result in a confounding of advertisement quality
and media. Thus, differences attributed to the effectiveness of different
media might be attributable to differences in the quality of the stimuli
advertisements. In the present research both the use of the brief as well as
the use of a professional advertising agency imply a more realistic use of
the opportunities offered by different media. However, this does not
remove advertisement quality differences as a rival explanation for find-
ings with regard to media effects. The inclusion of relative advertisement
quality as a covariate in the analysis does tackle this particular problem.
Controlling for advertisement quality differences by including the
covariate in the analysis allows for a more accurate examination of media
effects. For instance, in the present research the first effect of media on
attitude towards the product that we found vanished when controlling for
quality differences in the advertisement stimuli across media.
Finally, the present results also point to the importance of the quality of
the creative aspect of advertisement creation. Contrary to most previous
research, we found relatively strong media effects with regard to
advertisement effectiveness between radio and internet/print. We believe
that this can, to a certain extent, be attributed to the use of the brief to
attain experimental control, allowing a professional agency to use the
opportunities offered by the different media. Furthermore, the direct
influence of the relative advertisement quality on advertisement
effectiveness offers additional support to the importance of the creative
process in the development of advertisements. However, the delegation of
substantial parts of the stimuli development to a professional agency may
also, at least partially, be a reason for the lack of differentiation between
message appeals for the posters in the present research.
Acknowledgements
This research project is funded by the Norwegian Research Council. The
authors want to thank Sigurd V. Troye and Leif B. Methlie for valuable
comments and suggestions.
402
International Journal of Market Research Vol. 47 Issue 4
Appendix
Construct Items
Attitude towards the ad The advertisement was good
I liked the advertisement very much
The advertisement had a low quality (reversed)
Attitude towards the product The advertised (product) was very good
The advertised (product) was very bad (reversed)
I became interested in the advertised (product) after listening to/seeing
the ad
Decision support The information presented in the advertisement gave me a useful base
to decide whether or not to buy the product
I feel that the advertisement gave me good decision support
In addition to the advertisement, I would have needed more information
before deciding whether or not to buy the product (reversed)
Relative ad quality The advertisement possessed a very high quality compared to other
advertisements I have heard/seen for (product) on radio/print/internet
The advertisement had a very high quality compared to other
advertisements I have heard/seen on radio/print/internet
Emotional appeal The advertisement was funny
The advertisement was entertaining
The advertisement was creative
The advertisement was vivid
The advertisement was warm
Rational appeal The advertisement was informative
Note:
All items were measured on seven-point Likert-type scales with the following anchors: Disagree completely –
Agree completely
References
Anderson, J.C. & Gerbing, D.W. (1988) Structural equation modeling in practice: a
review and recommended two-step approach. Psychological Bulletin, 103, 3,
pp. 411– 23.
Bagozzi, R.P. & Yi, Y. (1988) On the evaluation of structural equation models.
Journal of the Academy of Marketing Science, 16, 1, pp. 74– 79.
Baker, W.E. & Lutz, R.J. (2000) An empirical test of an updated relevance-
accessibility model of advertising effectiveness. Journal of Advertising, 29, 1,
pp. 1– 14.
Berthon, P., Pitt, L.F. & Watson, R.T. (1996) The World Wide Web as an advertising
medium. Toward an understanding of conversion efficiency. Journal of Advertising
Research, January/February, pp. 43– 54.
Brackett, L.K. & Carr, B.N. Jr (2001) Cyberspace advertising vs other media:
consumer vs mature student attitudes. Journal of Advertising Research,
September/October, pp. 23– 32.
403
The influence of media on advertising effectiveness
Breivik, E. & Olsson, U.H. (2001) Adding variables to improve model fit: the effect
of model size on fit assessment in LISREL. In R. Cudeck, S. Du Toit & D. Sörbom
(eds), Structural Equation Modeling: Present and Future, Lincolnwood, IL:
Scientific Software International, pp. 169– 194.
Briggs, R. & Hollis, N. (1997) Advertising on the web: is there response before
click-through? Journal of Advertising Research, March/April, pp. 33– 45.
Brown, S.P. & Stayman, D.M. (1992) Antecedents and consequences of attitude
toward the ad: a meta-analysis. Journal of Consumer Research, 19, June,
pp. 34– 51.
Burnett, J. & Moriarty, S.E. (1998) Introduction to Marketing Communications.
An Integrated Approach, 1st edn. London: Prentice Hall.
Chen, Q., Clifford, S.J. & Wells, W.D. (2002) Attitude toward the site II: new
information. Journal of Advertising Research, March/April, pp. 33– 45.
Cho, C.-H. (2003) The effectiveness of banner advertisements: involvement and
click-through. Journalism and Mass Communication Quarterly, 80, 3,
pp. 623– 645.
Dahlen, M. & Bergendahl, J. (2001) Informing and transforming on the web: an
empirical study of response to banner ads for functional and expressive products.
International Journal of Advertising, 20, 2, pp. 189– 206.
Davies, M. (1993) Developing combinations of message appeals for campaign
management. European Journal of Marketing, 27, 1, pp. 45– 63.
Dou, W., Linn, R. & Yang, S. (2001) How smart are ‘smart banners’? Journal of
Advertising Research, July/August, pp. 31– 43.
Drèze, X. & Zufryden, F. (1997) Testing website design and promotional content.
Journal of Advertising Research, March/April, pp. 77– 91.
Ducoffe, R.H. (1996) Advertising value and advertising on the web. Journal of
Advertising Research, May/June, pp. 21– 35.
Fill, C. (1995) Marketing Communication. Frameworks, Theories and Applications.
London: Prentice Hall.
Fishbein, M. & Ajzen, I. (1975) Belief, Attitude, Intention, and Behavior. Reading,
Mass.: Addison Wesley.
Fornell, C. & Larcker, D.F. (1981) Evaluating structural equation models with
unobservable variables and measurement error. Journal of Marketing Research,
18, 2, pp. 39– 50.
Gallagher, K., Foster, K.D. & Parsons, J. (2001) The medium is not the message:
advertising effectiveness and content evaluation in print and on the web. Journal
of Advertising Research, July/August, pp. 57– 70.
Gallagher, K., Parsons, J. & Foster, K.D. (2001) A tale of two studies: replicating
advertising effectiveness and content evaluation in print and on the web. Journal
of Advertising Research, July/August, pp. 71– 81.
Harvey, B. (1997) The expanded ARF model: bridge to the accountable advertising
future. Journal of Advertising Research, March/April, pp. 11– 20.
Hoffman, D.L. & Novak, T.P. (1996) Marketing in hypermedia computer-mediated
environments: conceptual foundations. Journal of Marketing, 60, July, pp. 50– 68.
Jöreskog, K.G., Sörbom, D., du Toit, S.H.C. & du Toit, M. (1999) LISREL 8: New
Statistical Features. Chicago: Scientific Software International.
404
International Journal of Market Research Vol. 47 Issue 4
Kaid, L.L. (2002) Political advertising and information seeking: comparing exposure
via traditional and internet channels. Journal of Advertising, 31, 1, pp. 27– 35.
Kenny, D.A. & McCoach, D.B. (2003) Effect of the number of variables on
measures of fit in structural equation modeling. Structural Equation Modeling, 10,
3, pp. 333– 351.
Kisielius, J. & Sternthal, B. (1984) Detecting and explaining vividness effects in
attitudinal judgments. Journal of Marketing Research, 21, February, pp. 54– 64.
Krugman, H.E. (1965) The impact of television advertising: learning without
involvement. Public Opinion Quarterly, Fall, pp. 349– 356.
Liu, S.S. & Stout, P.A. (1987) Effects of message modality and appeal on advertising
acceptance. Psychology & Marketing, 4, 3, pp. 167– 187.
Mitchell, A.A. & Olson, J.C. (1981) Are product attribute beliefs the only mediator
of advertising effects on brand attitude? Journal of Marketing Research, XVIII,
August, pp. 318– 332.
Pashupati, K. & Lee, J.H. (2003) Web banner ads in online newspapers.
International Journal of Advertising, 22, 4, pp. 531– 564.
Peter, J.P. & Olson, J.C. (1996) Consumer Behavior and Marketing Strategy. USA:
Irwin.
Petty, R.E. & Priester, J.R. (1994) Mass media attitude change: implications of the
elaboration likelihood model of persuasion. In J. Bryant & D. Zillmann (eds),
Media Effects. Advances in Theory and Research. Hillsdale, New Jersey: Lawrence
Erlbaum Associates Publishers, pp. 91– 122.
Roehm, H.A. & Haugtvedt, C.P. (1999) Understanding interactivity of cyberspace
advertising. In Schuman, D.W. & Thorson, E. (eds), Advertising and the World
Wide Web. New Jersey: Lawrence Erlbaum Associates Publishers, pp. 27– 39.
Singh, S.N. & Dalal, N.P. (1999) Web home pages as advertisements.
Communications of the ACM, 42, 8, pp. 91– 8.
Stafford, M.R. & Day, E. (1995) Retail services advertising: the effects of appeal,
medium, and service. Journal of Advertising, 24, Spring, pp. 57– 71.
Sterne, J. (1999) World Wide Web Marketing. Integrating the Web into Your
Marketing Strategy. New York: John Wiley & Sons, Inc.
Stewart, D.W. & Ward, S. (1994) Media effects on advertising. In J. Bryant &
D. Zillmann (eds), Media Effects. Advances in Theory and Research. Hillsdale,
New Jersey: Lawrence Erlbaum Associates Publishers, pp. 315– 363.
Taylor, S.E. & Thompson, S.C. (1982) Stalking the elusive ‘vividness’ effect.
Psychological Review, 89, 2, pp. 155– 181.
Wheatley, J.J. & Brooker, G. (1994) Music and spokesperson effects on recall and
cognitive response to a radio advertisement. In E.M. Clark, T.C. Brock &
D.W. Stewart (eds), Attention, Attitude and Affect in Response to Advertising.
Hillsdale, New Jersey: Lawrence Erlbaum Associates Publishers, pp. 189– 204.
Wright, P.L. (1974) Analyzing media effects on advertising responses. Public
Opinion Quarterly, 38, 2, pp. 192– 205.
Yoon, S.-J. & Kim J.-H. (2001) Is the internet more effective than traditional media?
Factors affecting the choice of media. Journal of Advertising Research,
November/December, pp. 53– 60.
405