SlideShare ist ein Scribd-Unternehmen logo
1 von 5
Downloaden Sie, um offline zu lesen
Message Maps
The Most Effective Technology for
Assessing Message Effectiveness
Research shows that
                                                        Most research companies rely on voters to guess at what motivates
voters are unable                                       them. What we know about how human beings evaluate
                                                        information, make choices, and respond to survey questions
                                                        tells us that the traditional approach to message testing—asking
to judge which                                          people how effective message would be—is not reliable.


messages actually                                       There are several reasons for this, including:

motivate them
                        The problem                     •	 Voters (or people in general) just aren’t good at understanding the
                                                           reasons they do things.  
                        Traditional research does not       >> There’s a reason that psychology and psychiatry are burgeoning
                           identify messages that              industries—most people act without fully understanding why they act
                          actually change opinions.            and often act in ways that are contrary to what they believe are their
during a telephone                                             preferences and motivations.
                                                            >> Voters just can’t differentiate among the importance of as many as a
                                                               dozen distinct messages, so they wind up rating one high and the rest
                                                               low, or all of them high, or another simple strategy. All of these can lead
survey, so WPA uses                                            to us reaching the wrong conclusion when we rely only on respondent
                                                               ratings to assess messages.

a methodology that                                      •	 Voters want to be liked by the interviewer.
                                                            >> The foundation of telephone polling is the social exchange between
                                                               interviewer and interviewee.
                                                            >> While this is what allows us ask 20 minute surveys, it creates bias in
measures the actual                                            message assessments.
                                                            >> People will say one thing and do another on socially controversial topics
                                                               such as race, class, honesty questions, and others.
effectiveness of each
                                                        •	 People tend to give greatest weight to what they’ve been exposed
                                                           to recently in the news (hot topics).
                                                            >> While these messages sound familiar at the time, they may not have any
message without                                                impact at all on their vote.
                                                            >> For this reason voters will say a message matters a lot that is already
                                                               driving their choice on the ballot—if we repeat that message in an ad we
having to rely on a                                            won’t gain any ground because everyone already know about it.



respondent’s guesses.
The Solution
   WPA’s Message Mapping
methodology measures actual   The solution to this problem is to measure the actual effect of
     change in opinion        hearing each message on a respondent’s vote choice.

                              We still ask respondents to rate messages because it gives them
                              a cognitive task that causes them to listen to each message. We
                              evaluate effectiveness, however, not by their responses, but by
                              using observed changes from the pre-ballot to the post-ballot.


                              The way this works is as follows:
                              •	 Each respondent is asked to rate a random selection of messages
                                 and then the ballot is retested.
                              •	 We record what messages each did and did not hear.
                              •	 We measure the actual behavioral response—the difference
                                 between their initial ballot vote and the informed ballot vote.
                              •	 We build a regression model with that response for each respondent
                                 as the dependent variable and a series of indicator variables for
                                 heard/did not hear each message as the independent variables.
                              •	 The coefficients on each heard/did not hear is the measurement of
                                 the effectiveness of each message in changing votes.
                              We then use the actual effect of each message on the X axis of
                              our Message Map™, and combine it with scales of stickiness (the
                              ability to recall the message later in the survey), and believability
                              of the message.

                              What our Message Maps reveal is the latent values that voters bring
                              to elections—and the messages that appeal to them—that we
                              would not get looking just at message ratings.
Examples                                                                                               WPA plots each message on a chart, showing the actual effectiveness on
                                                                                                            the X axis, the stickiness of the message on the Y axis, and the believability
                                                                                                            of a message represented by the size of the bubble. The best messages
•	 In a recent Texas legislative                                                                            are large bubbles in the green area, balancing effectiveness, stickiness,
                                                                                                            and believability.
   primary we found that voters
                                                                                                                                                                    Bubble Size: Believability
   who said they cared most about
                                                                                1.4
   border security and illegal
   immigration really responded




                                         Increasing Memorability of a Message
                                                                                1.2
   best to a message about life                                                                           1. Will fight for a
                                                                                                             balanced budget                                                 2. Will cut Dept of
   issues.  Illegal immigration was                                             1.0                          amendment                                                          Energy and Dept
                                                                                                                                                                                of Education
   a hot topic at the time, but                                                                                                                                                 funding
                                                                                0.8         6. Pro-life                                7. Wants to greatly
   Message Maps revealed that the                                                              champion                                   expand domestic oil
                                                                                                                                          drilling
   enduring issue of protecting life                                            0.6
                                                                                                                                                                5. Wants to privatize
   really mattered more and helped                                                                                                                                 Social Security
                                                                                                                               8. Will end pork
                                                                                0.4                                               spending
   our candidate win.                                                                                         4. Supports repeal
                                                                                                                 of Obamacare
                                                                                0.2

                                                                                                                      3. Cut corporate taxes
•	 In a competitive Congressional                                                                                        to spark economy
                                                                                0.0
   general election in Kansas last                                                    0.0                     0.25                                0.50                   0.75                      1.0

   cycle, voters rated a message
   about balanced budgets most
                                                                                                           Increasing Effectiveness of a Message
   highly.  But Message Maps
   revealed that a more aggressive
                                       •	 On this Message Map,                                             •	 Respondents’ self-reporting                        •	 This example illustrates
   message about fighting against         the most effective                                                  gave the strongest ratings to                         how respondents gave the
   the Governor’s tax hike proposal       messages are numbers                                                messages 4 and 8, repealing                           “expected” conservative
                                          2 and 5, cutting                                                    Obamacare, and ending pork                            responses—ending pork
   won more votes.  Voters                the funding of the                                                  spending. Messages 2 and 5                            spending and repealing
   wanted to believe they wouldn’t        Departments of Energy                                               were self reported as two of                          Obamacare—to the
                                          and Education funding,                                              the lowest-rated messages.                            interviewer while avoiding
   respond to a “combative”               and privatizing Social                                                 >> But our analysis shows that                     more controversial responses
   message, but in reality they did.      Security.1                                                                while respondents said                          regarding eliminating the
                                                                                                                    statements 4 and 8 would                        Departments of Energy and
                                                                                                                    motivate them, those messages                   Education and privatizing
                                                                                                                    ultimately had very little effect               Social Security.
                                                                                                                    on their vote choice.2                              >> But in reality, these controversial
                                                                                                                                                                           topics were the winning
                                                                                                                                                                           messages for this particular
                                                                                                                                                                           campaign.3
1.	 Krosnick, J.A., S. Narayan, W.R. Smith (1996). Satisficing in Surveys: Initial Evidence.
    New Directions for Evaluation 70: 29-44.
2.	 Fisher, R.J., J.E. Katz (2000). Social-desirability bias and the validity of self-reported
    values. Psychology and Marketing 17(2): 105-120.
3.	 Ashton, R.H., J. Kennedy. (2002) Eliminating recency with self-review. Behavioral
    Decision Making 15(3): 221-231.


324 Second Street, SE                   1319 Classen Dr                      1005 Congress
   Washington, DC                       Oklahoma City, OK                  Suite 495, Austin, TX
       20003                                 73103                                78701

                            www.WPAresearch.com

Weitere ähnliche Inhalte

Ähnlich wie Message Mapping Explained

WCSS 2010 - Talk
WCSS 2010 - TalkWCSS 2010 - Talk
WCSS 2010 - TalkFedelabss
 
Information and uncertainty: Concepts and Contexts
Information and uncertainty: Concepts and ContextsInformation and uncertainty: Concepts and Contexts
Information and uncertainty: Concepts and ContextsEvonne Mwangale Kiptinness
 
Communication skills week 1
Communication skills week 1Communication skills week 1
Communication skills week 1Wardah Azhar
 
Dorling Kindersley RFThinkstockLearning Objectives By.docx
Dorling Kindersley RFThinkstockLearning Objectives By.docxDorling Kindersley RFThinkstockLearning Objectives By.docx
Dorling Kindersley RFThinkstockLearning Objectives By.docxjacksnathalie
 
media credibility
media credibility media credibility
media credibility Kavitha Ravi
 
Introduction to Trufflenet for local government
Introduction to Trufflenet for local governmentIntroduction to Trufflenet for local government
Introduction to Trufflenet for local governmenttrufflenet
 
ICCM 2013 Panel 2: Crisis Mapping for Conflict Management
ICCM 2013 Panel 2: Crisis Mapping for Conflict ManagementICCM 2013 Panel 2: Crisis Mapping for Conflict Management
ICCM 2013 Panel 2: Crisis Mapping for Conflict ManagementTom Weinandy
 
Mcm 380 Persuasive CommunicationProcessing Persuasive Communi.docx
Mcm 380 Persuasive CommunicationProcessing Persuasive Communi.docxMcm 380 Persuasive CommunicationProcessing Persuasive Communi.docx
Mcm 380 Persuasive CommunicationProcessing Persuasive Communi.docxARIV4
 
Trust and Influence in the Complex Network of Social Media
Trust and Influence in the Complex Network of Social MediaTrust and Influence in the Complex Network of Social Media
Trust and Influence in the Complex Network of Social MediaTeradata Aster
 
Two step flow of communication theory.pdf
Two step flow of communication theory.pdfTwo step flow of communication theory.pdf
Two step flow of communication theory.pdfFakiha Naseer
 
Introduction to Corporate communication .pptx
Introduction to Corporate communication .pptxIntroduction to Corporate communication .pptx
Introduction to Corporate communication .pptxFUNICCameroon
 
{White Paper} Measuring Global Attention | Appinions
{White Paper} Measuring Global Attention | Appinions{White Paper} Measuring Global Attention | Appinions
{White Paper} Measuring Global Attention | AppinionsAppinions
 
Effective persuasion
Effective persuasionEffective persuasion
Effective persuasionjuw123
 
concepts related to communication
concepts related to communicationconcepts related to communication
concepts related to communicationshilpapanginikkode
 
Heres-What-Personality-Sounds-Like
Heres-What-Personality-Sounds-LikeHeres-What-Personality-Sounds-Like
Heres-What-Personality-Sounds-LikeMarcel Korst
 
Ashif presentation
Ashif presentationAshif presentation
Ashif presentationSUNISH PS
 
2015.07.18 mor the business communicator as presence allocator
2015.07.18 mor the business communicator as presence allocator2015.07.18 mor the business communicator as presence allocator
2015.07.18 mor the business communicator as presence allocatorAdela Rebancos
 

Ähnlich wie Message Mapping Explained (20)

WCSS 2010 - Talk
WCSS 2010 - TalkWCSS 2010 - Talk
WCSS 2010 - Talk
 
Information and uncertainty: Concepts and Contexts
Information and uncertainty: Concepts and ContextsInformation and uncertainty: Concepts and Contexts
Information and uncertainty: Concepts and Contexts
 
Communication skills week 1
Communication skills week 1Communication skills week 1
Communication skills week 1
 
INFORMATION-1.pptx
INFORMATION-1.pptxINFORMATION-1.pptx
INFORMATION-1.pptx
 
Dorling Kindersley RFThinkstockLearning Objectives By.docx
Dorling Kindersley RFThinkstockLearning Objectives By.docxDorling Kindersley RFThinkstockLearning Objectives By.docx
Dorling Kindersley RFThinkstockLearning Objectives By.docx
 
media credibility
media credibility media credibility
media credibility
 
Introduction to Trufflenet for local government
Introduction to Trufflenet for local governmentIntroduction to Trufflenet for local government
Introduction to Trufflenet for local government
 
ICCM 2013 Panel 2: Crisis Mapping for Conflict Management
ICCM 2013 Panel 2: Crisis Mapping for Conflict ManagementICCM 2013 Panel 2: Crisis Mapping for Conflict Management
ICCM 2013 Panel 2: Crisis Mapping for Conflict Management
 
Mcm 380 Persuasive CommunicationProcessing Persuasive Communi.docx
Mcm 380 Persuasive CommunicationProcessing Persuasive Communi.docxMcm 380 Persuasive CommunicationProcessing Persuasive Communi.docx
Mcm 380 Persuasive CommunicationProcessing Persuasive Communi.docx
 
Trust and Influence in the Complex Network of Social Media
Trust and Influence in the Complex Network of Social MediaTrust and Influence in the Complex Network of Social Media
Trust and Influence in the Complex Network of Social Media
 
Two step flow of communication theory.pdf
Two step flow of communication theory.pdfTwo step flow of communication theory.pdf
Two step flow of communication theory.pdf
 
Communication ppt
Communication pptCommunication ppt
Communication ppt
 
Introduction to Corporate communication .pptx
Introduction to Corporate communication .pptxIntroduction to Corporate communication .pptx
Introduction to Corporate communication .pptx
 
{White Paper} Measuring Global Attention | Appinions
{White Paper} Measuring Global Attention | Appinions{White Paper} Measuring Global Attention | Appinions
{White Paper} Measuring Global Attention | Appinions
 
Effective persuasion
Effective persuasionEffective persuasion
Effective persuasion
 
concepts related to communication
concepts related to communicationconcepts related to communication
concepts related to communication
 
Heres-What-Personality-Sounds-Like
Heres-What-Personality-Sounds-LikeHeres-What-Personality-Sounds-Like
Heres-What-Personality-Sounds-Like
 
Ashif presentation
Ashif presentationAshif presentation
Ashif presentation
 
Question2
Question2Question2
Question2
 
2015.07.18 mor the business communicator as presence allocator
2015.07.18 mor the business communicator as presence allocator2015.07.18 mor the business communicator as presence allocator
2015.07.18 mor the business communicator as presence allocator
 

Mehr von WPA Intelligence

2014 Post-Election Analysis
2014 Post-Election Analysis2014 Post-Election Analysis
2014 Post-Election AnalysisWPA Intelligence
 
WPA Nationwide Energy Security Study
WPA Nationwide Energy Security Study WPA Nationwide Energy Security Study
WPA Nationwide Energy Security Study WPA Intelligence
 
WPA Higher Education Capabilities
WPA Higher Education CapabilitiesWPA Higher Education Capabilities
WPA Higher Education CapabilitiesWPA Intelligence
 
Campaign Sciences Analytics White Paper
Campaign Sciences Analytics White PaperCampaign Sciences Analytics White Paper
Campaign Sciences Analytics White PaperWPA Intelligence
 
Campaign Sciences predictive analytics capabilities deck
Campaign Sciences predictive analytics capabilities deckCampaign Sciences predictive analytics capabilities deck
Campaign Sciences predictive analytics capabilities deckWPA Intelligence
 
WPA Predictive Analytics Capabilities
WPA Predictive Analytics CapabilitiesWPA Predictive Analytics Capabilities
WPA Predictive Analytics CapabilitiesWPA Intelligence
 
Credo 2012-activism-report
Credo 2012-activism-reportCredo 2012-activism-report
Credo 2012-activism-reportWPA Intelligence
 
Social Media Report Example--Cong. Ann Wagner(R-MO) Case Study
Social Media Report Example--Cong. Ann Wagner(R-MO)  Case StudySocial Media Report Example--Cong. Ann Wagner(R-MO)  Case Study
Social Media Report Example--Cong. Ann Wagner(R-MO) Case StudyWPA Intelligence
 
WPA Social Media Monitoring Capabilities and Pricing
WPA Social Media Monitoring Capabilities and PricingWPA Social Media Monitoring Capabilities and Pricing
WPA Social Media Monitoring Capabilities and PricingWPA Intelligence
 
WPA State of the 2012 Election
WPA State of the 2012 ElectionWPA State of the 2012 Election
WPA State of the 2012 ElectionWPA Intelligence
 
NRB Research Symposium Paper on Donor Types
NRB Research Symposium Paper on Donor TypesNRB Research Symposium Paper on Donor Types
NRB Research Symposium Paper on Donor TypesWPA Intelligence
 

Mehr von WPA Intelligence (12)

2014 Post-Election Analysis
2014 Post-Election Analysis2014 Post-Election Analysis
2014 Post-Election Analysis
 
WPA Nationwide Energy Security Study
WPA Nationwide Energy Security Study WPA Nationwide Energy Security Study
WPA Nationwide Energy Security Study
 
WPA Higher Education Capabilities
WPA Higher Education CapabilitiesWPA Higher Education Capabilities
WPA Higher Education Capabilities
 
Campaign Sciences Analytics White Paper
Campaign Sciences Analytics White PaperCampaign Sciences Analytics White Paper
Campaign Sciences Analytics White Paper
 
Campaign Sciences predictive analytics capabilities deck
Campaign Sciences predictive analytics capabilities deckCampaign Sciences predictive analytics capabilities deck
Campaign Sciences predictive analytics capabilities deck
 
WPA Predictive Analytics Capabilities
WPA Predictive Analytics CapabilitiesWPA Predictive Analytics Capabilities
WPA Predictive Analytics Capabilities
 
Credo 2012-activism-report
Credo 2012-activism-reportCredo 2012-activism-report
Credo 2012-activism-report
 
Social Media Report Example--Cong. Ann Wagner(R-MO) Case Study
Social Media Report Example--Cong. Ann Wagner(R-MO)  Case StudySocial Media Report Example--Cong. Ann Wagner(R-MO)  Case Study
Social Media Report Example--Cong. Ann Wagner(R-MO) Case Study
 
WPA Social Media Monitoring Capabilities and Pricing
WPA Social Media Monitoring Capabilities and PricingWPA Social Media Monitoring Capabilities and Pricing
WPA Social Media Monitoring Capabilities and Pricing
 
WPA State of the 2012 Election
WPA State of the 2012 ElectionWPA State of the 2012 Election
WPA State of the 2012 Election
 
Election 2008 Analysis
Election 2008 AnalysisElection 2008 Analysis
Election 2008 Analysis
 
NRB Research Symposium Paper on Donor Types
NRB Research Symposium Paper on Donor TypesNRB Research Symposium Paper on Donor Types
NRB Research Symposium Paper on Donor Types
 

Kürzlich hochgeladen

Anantkumar Hegde
Anantkumar Hegde  Anantkumar Hegde
Anantkumar Hegde NewsFeed1
 
19032024_First India Newspaper Jaipur.pdf
19032024_First India Newspaper Jaipur.pdf19032024_First India Newspaper Jaipur.pdf
19032024_First India Newspaper Jaipur.pdfFIRST INDIA
 
One India vs United India by Dream Tamilnadu
One India vs United India by Dream TamilnaduOne India vs United India by Dream Tamilnadu
One India vs United India by Dream TamilnaduDreamTamilnadu
 
Por estos dos motivos, defensa de JOH solicita repetir juicio
Por estos dos motivos, defensa de JOH solicita repetir juicioPor estos dos motivos, defensa de JOH solicita repetir juicio
Por estos dos motivos, defensa de JOH solicita repetir juicioAlexisTorres963861
 
Light Rail in Canberra: Too much, too little, too late: Is the price worth th...
Light Rail in Canberra: Too much, too little, too late: Is the price worth th...Light Rail in Canberra: Too much, too little, too late: Is the price worth th...
Light Rail in Canberra: Too much, too little, too late: Is the price worth th...University of Canberra
 
Ministry of Justice Extradition Eswatini 3.pdf
Ministry of Justice Extradition Eswatini 3.pdfMinistry of Justice Extradition Eswatini 3.pdf
Ministry of Justice Extradition Eswatini 3.pdfSABC News
 
Green Aesthetic Ripped Paper Thesis Defense Presentation_20240311_111012_0000...
Green Aesthetic Ripped Paper Thesis Defense Presentation_20240311_111012_0000...Green Aesthetic Ripped Paper Thesis Defense Presentation_20240311_111012_0000...
Green Aesthetic Ripped Paper Thesis Defense Presentation_20240311_111012_0000...virgfern3011
 
Another Day, Another Default Judgment Against Gabe Whitley
Another Day, Another Default Judgment Against Gabe WhitleyAnother Day, Another Default Judgment Against Gabe Whitley
Another Day, Another Default Judgment Against Gabe WhitleyAbdul-Hakim Shabazz
 
Européennes 2024 : projection du Parlement européen à trois mois du scrutin
Européennes 2024 : projection du Parlement européen à trois mois du scrutinEuropéennes 2024 : projection du Parlement européen à trois mois du scrutin
Européennes 2024 : projection du Parlement européen à trois mois du scrutinIpsos France
 

Kürzlich hochgeladen (9)

Anantkumar Hegde
Anantkumar Hegde  Anantkumar Hegde
Anantkumar Hegde
 
19032024_First India Newspaper Jaipur.pdf
19032024_First India Newspaper Jaipur.pdf19032024_First India Newspaper Jaipur.pdf
19032024_First India Newspaper Jaipur.pdf
 
One India vs United India by Dream Tamilnadu
One India vs United India by Dream TamilnaduOne India vs United India by Dream Tamilnadu
One India vs United India by Dream Tamilnadu
 
Por estos dos motivos, defensa de JOH solicita repetir juicio
Por estos dos motivos, defensa de JOH solicita repetir juicioPor estos dos motivos, defensa de JOH solicita repetir juicio
Por estos dos motivos, defensa de JOH solicita repetir juicio
 
Light Rail in Canberra: Too much, too little, too late: Is the price worth th...
Light Rail in Canberra: Too much, too little, too late: Is the price worth th...Light Rail in Canberra: Too much, too little, too late: Is the price worth th...
Light Rail in Canberra: Too much, too little, too late: Is the price worth th...
 
Ministry of Justice Extradition Eswatini 3.pdf
Ministry of Justice Extradition Eswatini 3.pdfMinistry of Justice Extradition Eswatini 3.pdf
Ministry of Justice Extradition Eswatini 3.pdf
 
Green Aesthetic Ripped Paper Thesis Defense Presentation_20240311_111012_0000...
Green Aesthetic Ripped Paper Thesis Defense Presentation_20240311_111012_0000...Green Aesthetic Ripped Paper Thesis Defense Presentation_20240311_111012_0000...
Green Aesthetic Ripped Paper Thesis Defense Presentation_20240311_111012_0000...
 
Another Day, Another Default Judgment Against Gabe Whitley
Another Day, Another Default Judgment Against Gabe WhitleyAnother Day, Another Default Judgment Against Gabe Whitley
Another Day, Another Default Judgment Against Gabe Whitley
 
Européennes 2024 : projection du Parlement européen à trois mois du scrutin
Européennes 2024 : projection du Parlement européen à trois mois du scrutinEuropéennes 2024 : projection du Parlement européen à trois mois du scrutin
Européennes 2024 : projection du Parlement européen à trois mois du scrutin
 

Message Mapping Explained

  • 1. Message Maps The Most Effective Technology for Assessing Message Effectiveness
  • 2. Research shows that Most research companies rely on voters to guess at what motivates voters are unable them. What we know about how human beings evaluate information, make choices, and respond to survey questions tells us that the traditional approach to message testing—asking to judge which people how effective message would be—is not reliable. messages actually There are several reasons for this, including: motivate them The problem • Voters (or people in general) just aren’t good at understanding the reasons they do things. Traditional research does not >> There’s a reason that psychology and psychiatry are burgeoning identify messages that industries—most people act without fully understanding why they act actually change opinions. and often act in ways that are contrary to what they believe are their during a telephone preferences and motivations. >> Voters just can’t differentiate among the importance of as many as a dozen distinct messages, so they wind up rating one high and the rest low, or all of them high, or another simple strategy. All of these can lead survey, so WPA uses to us reaching the wrong conclusion when we rely only on respondent ratings to assess messages. a methodology that • Voters want to be liked by the interviewer. >> The foundation of telephone polling is the social exchange between interviewer and interviewee. >> While this is what allows us ask 20 minute surveys, it creates bias in measures the actual message assessments. >> People will say one thing and do another on socially controversial topics such as race, class, honesty questions, and others. effectiveness of each • People tend to give greatest weight to what they’ve been exposed to recently in the news (hot topics). >> While these messages sound familiar at the time, they may not have any message without impact at all on their vote. >> For this reason voters will say a message matters a lot that is already driving their choice on the ballot—if we repeat that message in an ad we having to rely on a won’t gain any ground because everyone already know about it. respondent’s guesses.
  • 3. The Solution WPA’s Message Mapping methodology measures actual The solution to this problem is to measure the actual effect of change in opinion hearing each message on a respondent’s vote choice. We still ask respondents to rate messages because it gives them a cognitive task that causes them to listen to each message. We evaluate effectiveness, however, not by their responses, but by using observed changes from the pre-ballot to the post-ballot. The way this works is as follows: • Each respondent is asked to rate a random selection of messages and then the ballot is retested. • We record what messages each did and did not hear. • We measure the actual behavioral response—the difference between their initial ballot vote and the informed ballot vote. • We build a regression model with that response for each respondent as the dependent variable and a series of indicator variables for heard/did not hear each message as the independent variables. • The coefficients on each heard/did not hear is the measurement of the effectiveness of each message in changing votes. We then use the actual effect of each message on the X axis of our Message Map™, and combine it with scales of stickiness (the ability to recall the message later in the survey), and believability of the message. What our Message Maps reveal is the latent values that voters bring to elections—and the messages that appeal to them—that we would not get looking just at message ratings.
  • 4. Examples WPA plots each message on a chart, showing the actual effectiveness on the X axis, the stickiness of the message on the Y axis, and the believability of a message represented by the size of the bubble. The best messages • In a recent Texas legislative are large bubbles in the green area, balancing effectiveness, stickiness, and believability. primary we found that voters Bubble Size: Believability who said they cared most about 1.4 border security and illegal immigration really responded Increasing Memorability of a Message 1.2 best to a message about life 1. Will fight for a balanced budget 2. Will cut Dept of issues. Illegal immigration was 1.0 amendment Energy and Dept of Education a hot topic at the time, but funding 0.8 6. Pro-life 7. Wants to greatly Message Maps revealed that the champion expand domestic oil drilling enduring issue of protecting life 0.6 5. Wants to privatize really mattered more and helped Social Security 8. Will end pork 0.4 spending our candidate win. 4. Supports repeal of Obamacare 0.2 3. Cut corporate taxes • In a competitive Congressional to spark economy 0.0 general election in Kansas last 0.0 0.25 0.50 0.75 1.0 cycle, voters rated a message about balanced budgets most Increasing Effectiveness of a Message highly. But Message Maps revealed that a more aggressive • On this Message Map, • Respondents’ self-reporting • This example illustrates message about fighting against the most effective gave the strongest ratings to how respondents gave the the Governor’s tax hike proposal messages are numbers messages 4 and 8, repealing “expected” conservative 2 and 5, cutting Obamacare, and ending pork responses—ending pork won more votes. Voters the funding of the spending. Messages 2 and 5 spending and repealing wanted to believe they wouldn’t Departments of Energy were self reported as two of Obamacare—to the and Education funding, the lowest-rated messages. interviewer while avoiding respond to a “combative” and privatizing Social >> But our analysis shows that more controversial responses message, but in reality they did. Security.1 while respondents said regarding eliminating the statements 4 and 8 would Departments of Energy and motivate them, those messages Education and privatizing ultimately had very little effect Social Security. on their vote choice.2 >> But in reality, these controversial topics were the winning messages for this particular campaign.3
  • 5. 1. Krosnick, J.A., S. Narayan, W.R. Smith (1996). Satisficing in Surveys: Initial Evidence. New Directions for Evaluation 70: 29-44. 2. Fisher, R.J., J.E. Katz (2000). Social-desirability bias and the validity of self-reported values. Psychology and Marketing 17(2): 105-120. 3. Ashton, R.H., J. Kennedy. (2002) Eliminating recency with self-review. Behavioral Decision Making 15(3): 221-231. 324 Second Street, SE 1319 Classen Dr 1005 Congress Washington, DC Oklahoma City, OK Suite 495, Austin, TX 20003 73103 78701 www.WPAresearch.com