Replication Data for: The Variable Persuasiveness of Political Rhetoricdoi:10.7910/DVN/POMIFDHarvard Dataverse2022-01-211Blumenau, Jack E; Lauderdale, Benjamin E, 2022, "Replication Data for: The Variable Persuasiveness of Political Rhetoric", https://doi.org/10.7910/DVN/POMIFD, Harvard Dataverse, V1, UNF:6:00qe2wDft4qXZjT/ff4iZw== [fileUNF]Replication Data for: The Variable Persuasiveness of Political Rhetoricdoi:10.7910/DVN/POMIFDBlumenau, Jack ELauderdale, Benjamin EJack BlumenauHarvard DataverseJack BlumenauBlumenau, Jack E2021-08-06Social SciencesPersuasion (Rhetoric)Public opinionSurveysExternal validityWhich types of political rhetoric are most persuasive? Politicians make arguments that share common rhetorical elements, including metaphor, ad hominem attacks, appeals to expertise, moral appeals, and many others. However, political arguments are also highly multidimensional, making it difficult to assess the relative persuasive power of these elements. We report on a novel experimental design which assesses the relative persuasiveness of a large number of arguments that deploy a set of rhetorical elements to argue for and against proposals across a range of UK political issues. We find modest differences in the average effectiveness of rhetorical elements shared by many arguments, but also large variation in the persuasiveness of arguments of the same rhetorical type across issues. In addition to revealing that some argument-types are more effective than others in shaping public opinion, these results have important implications for the interpretation of survey-experimental studies in the field of political communication.This dataset underwent an independent verification process that replicated the tables and figures in the primary article. For the supplementary materials, verification was performed solely for the successful execution of code. The verification process was carried out by the Odum Institute for Research in Social Science at the University of North Carolina at Chapel Hill. <br></br> The associated article has been awarded Open Materials and Open Data Badges. Learn more about the Open Practice Badges from the <a href="https://osf.io/tvyxz/wiki/home/" target="_blank">Center for Open Science</a>.<br></br> <img src="https://odum.unc.edu/files/2020/03/OpenData_PR-1.png" alt="Open Data Badge" height="77" width="80"> <img src="https://odum.unc.edu/files/2020/03/OpenMaterials_PR-1.png" alt="Open Materials Badge" height="77" width="80">The <i>American Journal of Political Science</i> and the Odum Institute for Research in Social Science are not responsible for the accuracy or quality of data uploaded within the <i>AJPS</i> Dataverse, for the use of those data, or for interpretations or conclusions based on their use.This dataset is made available with limited information on how it can be used. You may wish to communicate with the Contact(s) specified before use.Blumenau, Jack E., and Benjamin E. Lauderdale. [date]. “The Variable Persuasiveness of Political Rhetoric.” <i>American Journal of Political Science</i> Forthcoming. <a href="http://ajps.org/" target="_blank">http://ajps.org/</a>Blumenau, Jack E., and Benjamin E. Lauderdale. [date]. “The Variable Persuasiveness of Political Rhetoric.” <i>American Journal of Political Science</i> Forthcoming. <a href="http://ajps.org/" target="_blank">http://ajps.org/</a>canonical_sentences_v2.tab3367text/tab-separated-valuesUNF:6:5k00zg4h1ZdNXtSyszL4CQ==elements.tab142text/tab-separated-valuesUNF:6:oTR3Vvs+2AGaqIwKPzgrhg==experiment_one.tab331756text/tab-separated-valuesUNF:6:DB2EKyqwHCv0cD+fhY/Crw==issue_prompts.tab126text/tab-separated-valuesUNF:6:XK83X/8TbpxfBn0gLoYh/A==PolicyUNF:6:vPZwyI6HMXFe4NELi+pKow==ElementUNF:6:q1ED1TFbPKFNAWsISvpOsQ==Pro.ConUNF:6:XYUvmx3TPtKQk+nOjVubMA==LinkUNF:6:Maz4stIPnLoPw0Zgukmj3A==ExcerptUNF:6:LelNV6rY274EYPfCDWQ63g==TextUNF:6:IwCRNYUllYzb9xVtvmbI1w==AlternativeUNF:6:MwPv3FtPgwXKI+pSOApkLA==ElementUNF:6:yEDy1FwuWOh9jf2+xY4JvA==DescriptionUNF:6:Qu561COl2SlUB2yEQtdjfQ==1.0.1659.0957.67974814130843317.03317.00.01659.0UNF:6:jLcu28Ne4TmL0PGd/j/2eA==weighting variable0.51314710056524036.6853182473765991.0.0.03317.00.4208811126756830.8643246827181361UNF:6:gUNVGP5HmALL0h2x8QVgyQ==Interview Start TimeUNF:6:aEKVwZdtOQHyZJ0nAf5RSA==Interview End TimeUNF:6:tqR1ylNRJ+dCfkbQRPFUHA==Talking to people about the General Election in June 2017, we have found that a lot of people didn’t manage to vote. How about you – did you manage to vote in the General Election?.99.03317.08.300943888795580.01.88121796804341021.01.01Yes, voted27222No, did not vote57199Don’t know24999Not Asked0998Skipped0UNF:6:LKhjE3FhTtVioBJ+2HGWNA==Which party did you vote for?.5.6539309331373852.01.02722.099.0595.018.6869016985075873Liberal Democrat20898Other291Conservative115499Don’t know769N/A02Labour10367Green534Scottish National Party (SNP)88999Not Asked05Plaid Cymru17998Skipped06UK Independence Party (UKIP)618N/A0UNF:6:N1LmAp7siYa8XEnd7YcybQ==Past vote 2016 EU referendum4.01.71450105517033642.0.1.00.74138243771515530.03317.02I voted to Leave13659Not Asked01I voted to Remain14733I did not vote4328Skipped04Can’t remember47UNF:6:My+8x3PZblOSynV/F6JW9A==Describe themselves on political scale as....1.03317.098.00.04.5201043345979854.05.0141694302080148Don’t know8211Very left-wing847Very right-wing376Fairly right-wing29199Not Asked03Slightly left-of-centre52798Skipped62Fairly left-wing4384Centre6355Slightly right-of-centre478UNF:6:nuBbNCGVERN7y4cNg27YFA==Age0.016.805997624247897.3317.0119.049.049.3436840518540918.0-8Skipped0-9Not Asked0UNF:6:0CDy49mzAWCmCNxO39KWrw==Education qualification (highest attained)14.0.0.03317.01.05.21611063800359120.012.4446789267410464Clerical and commercial506City & Guilds certificate - advanced7899Not Asked011GCE A level or Higher Certificate4529CSE grade 1, GCE O level, GCSE, School Certificate41720Prefer not to say1081No formal qualifications2113Recognised trade apprenticeship completed375City & Guilds certificate14512Scottish Higher Certificate567ONC2313Nursing qualification (e.g. SEN, SRN, SCM, RGN)4018Other technical, professional or higher qualification39516University or CNAA first degree (e.g. BA, B.Sc, B.Ed)65798Skipped014Teaching qualification (not degree)788CSE grades 2-5672Youth training certificate/skillseekers719Don't know5117University or CNAA higher degree (e.g. M.Sc, Ph.D)26910Scottish Ordinary/ Lower Certificate2415University diploma152UNF:6:hLkxvUG+7N9xIzt1thcp4w==Gender0.49651697088059081.5595417545975282.03317.00.0.2.01.02Female18561Male14618Skipped09Not Asked0UNF:6:OvAdag4aApibPpthHHlGUg==Region lived.11.02.96458964076676473317.00.01.06.2086222490201996.099Not Asked011Scotland3067London3372North West34110Wales1785West Midlands2918South East4633Yorkshire and the Humber3019South West35212Northern Ireland098Skipped04East Midlands26313Non UK & Invalid01North East1576East of England328UNF:6:sL9TV2NscGPtUZdAIqKgDw==Income - gross household9.014.2324389508590298.03317.020.574776018058361.0.0.013£70,000 to £99,999 per year1636£25,000 to £29,999 per year24212£60,000 to £69,999 per year12216Don't know1681under £5,000 per year5798Skipped17811£50,000 to £59,999 per year1699£40,000 to £44,999 per year1562£5,000 to £9,999 per year1497£30,000 to £34,999 per year22015£150,000 and over3217Prefer not to answer5818£35,000 to £39,999 per year1825£20,000 to £24,999 per year2593£10,000 to £14,999 per year21699Not Asked014£100,000 to £149,999 per year6810£45,000 to £49,999 per year1264£15,000 to £19,999 per year229UNF:6:a2dq+gSjReB2lNN0Fm9Haw==Household size - number of children12.50153650486650298.00.01.01.0.3317.03.2770575821526786213513234065 or more899Not Asked043878Don't know17102364541998Skipped569Prefer not to say727no square3UNF:6:25NbAUNN+GGBRzzKEES2+A==Marital status.2.01.08.00.02.9068435333132343317.02.1908499441134574Divorced2122Living as married4395Widowed1213Separated (after being married)687Civil Partnership436Never married8731Married15609Not Asked08Skipped1UNF:6:HiOc8q7NY/5xvX7GAWZm2Q==Social Grade (Chief Income Earner) A / B / C1 / C2 / D / E1.06.01.4680893760615463.00.0.3.30027132951462273317.07Refused099Not Asked05D3651A4002B5984C26026E35498Skipped03C19988Unknown0UNF:6:kWdU0vQ8usCoUXyBcgYEIA==Employment Status Main1.02.03.61883345658169150.098.03317.0.3.1947542960506495Retired8607Not working2216Unemployed994Full time student1472Working part time (8-29 hours a week)4463Working part time (Less than 8 hours a week)671Working full time (30 or more hours per week)13738Other10199Not Asked098Skipped3UNF:6:7UOCzK+Ofs69w8KO6LJj7Q==political_attention.2.24976032778099238.03317.01.07.1181790774796490.011.098Skipped0983624316587936765321110222108565463109171216399Not Asked05419332125UNF:6:WOIDk7tB3hRavF0qtmPVgg==Ethnicity1.02.8452517229859890.03317.01.759119686463674219.01.0.8Any other Mixed / Multiple ethnic background174Any other White background10917Arab415Caribbean141English / Welsh / Scottish / Northern Irish / British298499Not Asked011Bangladeshi1014African910Pakistani136White and Black African413Any other Asian background1018Any other ethnic group1216Any other Black / African / Caribbean background819Prefer not to say283Gypsy or Irish Traveller27White and Asian149Indian3312Chinese72Irish255White and Black Caribbean1498Skipped0UNF:6:hSdE3CHMI3OWowyHPhYbKQ==Randomization spec for module m_rand_allUNF:6:4gpYUqYkBy14SDuxlnFhyw==1_Building_a_third_runway_at_Heathrow0.09.09.06.3228821223997581.03317.0.3.7754841055520271Yes11108Skipped02No09Not Asked2207UNF:6:uzWEbiOaGjLOnOTAlyGgrw==2_Closing_large_retail_stores_on_Boxing_Day0.09.09.03317.01.0.3.77208894774094456.3325293940307468Skipped01Yes11069Not Asked22112No0UNF:6:VpeMNDgcO6csaSmqdczf6Q==3_Extending_the_Right_to_Buy1.00.0.9.03.7712358234627976.3349412119384989.03317.09Not Asked22122No08Skipped01Yes1105UNF:6:xECcpTaEglI/N8qm1/3xBA==4_Extension_of_surveillance_powers_in_the_UK6.33252939403074853317.09.09.01.0.3.7720889477409370.02No09Not Asked22111Yes11068Skipped0UNF:6:RWYO3jpmZJDMrqfD8AuxLg==5_Fracking_in_the_UK3.7720889477409413317.01.00.09.0.6.33252939403074859.09Not Asked22111Yes11068Skipped02No0UNF:6:lizVhwhkOppOdlug5K7qqg==6_Nationalisation_of_the_railways_in_the_UK3317.09.0.0.09.06.3204703044920111.03.77632856602514679Not Asked22068Skipped01Yes11112No0UNF:6:JqfR+O/gBvbWCKT2b/YJFA==7_Quotas_for_women_on_corporate_boards3.766944134185162.9.09.06.3470003014772393317.01.00.02No09Not Asked22178Skipped01Yes1100UNF:6:bFJf9muBjLwBT7HJ4JmRig==8_Reducing_the_legal_restrictions_on_cannabis_use3317.06.3373530298462511.00.03.7703809629039469.09.0.2No01Yes11049Not Asked22138Skipped0UNF:6:Z6M//Vd7LMNIdWyymP0KVQ==9_Reducing_university_tuition_fees1.03317.03.769524364883441.9.06.3397648477539940.09.09Not Asked22148Skipped01Yes11032No0UNF:6:KTtFfd5n3CHNwsspSBKJgw==10_Renewing_Trident6.337353029846249.3.7703809629039519.01.00.09.03317.01Yes11048Skipped09Not Asked22132No0UNF:6:S0HSNZEZdefP84hbOVvhRw==11_Spending_07_of_GDP_on_overseas_aid9.00.01.06.322882122399757.3317.03.7754841055520269.02No09Not Asked22078Skipped01Yes1110UNF:6:FU/+0/QVPC8BoVspcQU6Cw==12_Sugar_tax_in_the_UK6.3397648477539939.0.9.00.03317.03.76952436488344271.02No08Skipped01Yes11039Not Asked2214UNF:6:ps8FkPLwHzBfAT3SN2l2vA==756.0-9.00.03317.0.224.5855776289946-9.0122.38378052457041-9Not Asked2207-8Skipped0UNF:6:ldw0tFiIimg35J3DDNP2ew==121.38438347904706.3317.0756.00.0-9.0222.1715157753442-9.0-9Not Asked2211-8Skipped0UNF:6:WvXKg3Cs3+qqrP8NtdipKQ==221.77681237806385120.034066927947023317.0.756.00.0-9.0-9.0-8Skipped0-9Not Asked2212UNF:6:ap1IxqRb7GhC3sFxSVxrqw==-9.0.755.00.0-9.0221.0079306484222119.276756104914073317.0-8Skipped0-9Not Asked2211UNF:6:2BjQxWvp/n5PSDk7NUHy9w==-9.0756.0.3317.0121.656617425384430.0222.48805682645505-9.0-9Not Asked2211-8Skipped0UNF:6:8uHih+hlualKcGWmBZB0dQ==756.0-9.0121.097980102502190.0.3317.0223.29205206999688-9.0-9Not Asked2206-8Skipped0UNF:6:D+oGmKF7cQrHHPadcbAFKg==0.0754.0-9.0119.59330720530612221.5961523947531.-9.03317.0-9Not Asked2217-8Skipped0UNF:6:8deKoxj4IZc/Q7uvcM+M1Q==119.64727163099181-9.03317.0221.4948047351629-9.00.0756.0.-9Not Asked2213-8Skipped0UNF:6:QoAaubC/kWdj4612jWdowA==-9.00.0117.30810973771484756.0218.746523054805123317.0.-9.0-8Skipped0-9Not Asked2214UNF:6:Of2XymgGkVpsLwDKxipldg==-9.0223.34865723095612-9.0120.27735905939102.3317.00.0756.0-9Not Asked2213-8Skipped0UNF:6:Mdko+DlsAQr/h6vl8KoFgw==0.03317.0121.32800723545375-9.0-9.0223.02134616857018755.0.-8Skipped0-9Not Asked2207UNF:6:VYlZbWpdgoBY3SGZW7v2Vw==3317.0119.21404883931274221.0924993130915.-9.0-9.0756.00.0-9Not Asked2214-8Skipped0UNF:6:ej0e7EWO9tnyjTDniLkNow==0.09.09.06.6526982212842923317.0.3.3403583751542341.08Skipped02Argument **two** is more persuasive4483They are about the same3231Argument **one** is more persuasive3399Not Asked2207UNF:6:rCuXTzXm6xJO/sCNUqtlaQ==0.09.03.414327972239561.0.6.6077781127524849.03317.01Argument **one** is more persuasive4682Argument **two** is more persuasive3639Not Asked22113They are about the same2758Skipped0UNF:6:tRwjazeAjUiQHuj39bNAiQ==1.06.6635514018691593.33713449472031179.00.03317.09.0.8Skipped03They are about the same3331Argument **one** is more persuasive3489Not Asked22122Argument **two** is more persuasive424UNF:6:YdatuNzQy/QNHDgEBu7Hpw==9.00.01.03317.06.6430509496533.3.36730950739217069.03They are about the same3468Skipped01Argument **one** is more persuasive4229Not Asked22112Argument **two** is more persuasive338UNF:6:WPDpkvQBdfDvCdEIlybl0A==9.06.6599336750075369.00.01.03.3370387861840936.3317.02Argument **two** is more persuasive4909Not Asked22113They are about the same2981Argument **one** is more persuasive3188Skipped0UNF:6:zTIbtS0Ve6X1U4XtN7Pobw==3.406379037658986.607476635514018.1.00.09.09.03317.03They are about the same3209Not Asked22061Argument **one** is more persuasive4798Skipped02Argument **two** is more persuasive312UNF:6:I7v5VfI2SkitOW+L9/6zqw==3317.03.3466702008630051.0.9.09.06.6641543563460960.08Skipped03They are about the same3091Argument **one** is more persuasive3572Argument **two** is more persuasive4349Not Asked2217UNF:6:zckMAnwJSoSMbbYpuLV4WQ==3317.03.38040263412771366.6355140186915849.09.01.00.0.1Argument **one** is more persuasive4233They are about the same3088Skipped02Argument **two** is more persuasive3739Not Asked2213UNF:6:xHSKEdPRDLtvW4TUMuxzVA==9.0.3317.01.06.618932770575823.40697198237140249.00.08Skipped03They are about the same2971Argument **one** is more persuasive4742Argument **two** is more persuasive3329Not Asked2214UNF:6:QG6U+R0OqtFvDAtoMGB3uA==0.0.9.01.03317.03.37470733817813659.06.6394332227916811Argument **one** is more persuasive4133They are about the same3119Not Asked22132Argument **two** is more persuasive3808Skipped0UNF:6:nMMmDjAPIdtXAldSoin9uA==1.0.0.06.6183298160988879.09.03317.03.38995560723928659Not Asked22078Skipped03They are about the same2911Argument **one** is more persuasive4212Argument **two** is more persuasive398UNF:6:4w14cDYnz9sH9pNga//FPg==1.09.03.36843501268456129.00.03317.06.6439553813687064.8Skipped02Argument **two** is more persuasive4293They are about the same2909Not Asked22141Argument **one** is more persuasive384UNF:6:tFT9IQziG/EkurZGtcG9jg==PolicyId6.512.06.50.03.6055512754639891.012.0.UNF:6:/4zASuhIy3i8Vbaq/7ApYw==PolicyUNF:6:OGk8B7iPWySm+qQzYLw8ZA==DescriptionUNF:6:SaB6S6MK8MiPk7ZsZd/e5g==PromptproconUNF:6:a5uTUsqIcyeiok+PnHl8XA==PromptproproUNF:6:OgUeWzVtbTPahyHpxxIfeQ==PromptconconUNF:6:L21FFpBuWJ4IjWr3D+2GBg==01_experiment_1.Rtype/x-r-syntax02_experiment_2.Rtype/x-r-syntaxargument_fixed_effect.Rdataapplication/gzipCodebook.pdfapplication/pdfexperiment_two.savapplication/x-spss-savfor_against_screen.pngimage/pngheader.texapplication/x-texheader_si.texapplication/x-texliwc_dictionaries.Rdataapplication/gzipmanuscript.Rmdapplication/octet-streamposterior_correlation.Rdataapplication/x-rlang-transportposterior_correlation_element_policy.Rdataapplication/x-rlang-transportposterior_covariate_correlation_age.Rdataapplication/x-rlang-transportposterior_covariate_correlation_attention.Rdataapplication/x-rlang-transportposterior_covariate_correlation_educ.Rdataapplication/x-rlang-transportposterior_covariate_correlation_euvote.Rdataapplication/x-rlang-transportposterior_covariate_correlation_gender.Rdataapplication/x-rlang-transportposterior_covariate_correlation_vote17.Rdataapplication/x-rlang-transportposterior_linear.Rdataapplication/x-rlang-transportposterior_ordered.Rdataapplication/x-rlang-transportposterior_simple.Rdataapplication/x-rlang-transportposterior_simple_control.Rdataapplication/x-rlang-transportprompt_2.pngimage/pngREADME.txttext/plainrhetoric-experiment.bibapplication/octet-streamsupplemental_information.Rmdapplication/octet-stream10_Renewing_Trident.csvtext/csv11_Spending_0.7%_of_GDP_on_overseas_aid.csvtext/csv12_Sugar_tax_in_the_UK.csvtext/csv1_Building_a_third_runway_at_Heathrow.csvtext/csv2_Closing_large_retail_stores_on_Boxing_Day.csvtext/csv3_Extending_the_Right_to_Buy.csvtext/csv4_Extension_of_surveillance_powers_in_the_UK.csvtext/csv5_Fracking_in_the_UK.csvtext/csv6_Nationalisation_of_the_railways_in_the_UK.csvtext/csv7_Quotas_for_women_on_corporate_boards.csvtext/csv8_Reducing_the_legal_restrictions_on_cannabis_use.csvtext/csv9_Reducing_university_tuition_fees.csvtext/csvcorrelation.Rtype/x-r-syntaxcorrelation_arbitrary.Rtype/x-r-syntaxcorrelation_element_policy.Rtype/x-r-syntaxsimple.Rtype/x-r-syntaxsimple_controls.Rtype/x-r-syntaxlinear.Rtype/x-r-syntaxordered.Rtype/x-r-syntaxBoxing Day.csvtext/csvCannabis.csvtext/csvFracking.csvtext/csvHeathrow.csvtext/csvNationalising the railways.csvtext/csvOverseas aid.csvtext/csvQuotas for women.csvtext/csvReducing tuition fees.csvtext/csvRenewing Trident.csvtext/csvRight to Buy.csvtext/csvSugar tax.csvtext/csvSurveillance powers.csvtext/csv