Replication Data for: Choosing Reviewers: Predictors of Undergraduate Manuscript Evaluations (doi:10.7910/DVN/HLWNGC)

View:

Part 1: Document Description
Part 2: Study Description
Part 3: Data Files Description
Part 4: Variable Description
Entire Codebook

Document Description

Citation

Title:

Replication Data for: Choosing Reviewers: Predictors of Undergraduate Manuscript Evaluations

Identification Number:

doi:10.7910/DVN/HLWNGC

Distributor:

Harvard Dataverse

Date of Distribution:

2021-11-19

Version:

1

Bibliographic Citation:

Walker, Christina, 2021, "Replication Data for: Choosing Reviewers: Predictors of Undergraduate Manuscript Evaluations", https://doi.org/10.7910/DVN/HLWNGC, Harvard Dataverse, V1, UNF:6:18zRIR5rGFEzhua+sTg8zQ== [fileUNF]

Study Description

Citation

Title:

Replication Data for: Choosing Reviewers: Predictors of Undergraduate Manuscript Evaluations

Identification Number:

doi:10.7910/DVN/HLWNGC

Authoring Entity:

Walker, Christina (Oakland University)

Distributor:

Harvard Dataverse

Access Authority:

Walker, Christina

Access Authority:

Towner, Terri

Depositor:

Walker, Christina

Date of Deposit:

2021-11-15

Holdings Information:

https://doi.org/10.7910/DVN/HLWNGC

Study Scope

Keywords:

Social Sciences, Social Sciences

Abstract:

There is a fair amount of research examining bias in the peer-review process and its influence on journal articles’ quality and political science content. However, there is limited research examining how students peer-review other undergraduate research for publication. To better understand the predictors of manuscript evaluations and build on prior literature, this study examines seven years of undergraduate peer evaluations submitted to the Pi Sigma Alpha Undergraduate Journal of Politics (2013-2020). Empirical analyses reveal that a peer reviewer’s prior service on the Editorial Board (i.e., experience) and race are consistently and significantly associated with manuscript evaluations. By examining how undergraduate peer-reviewers assess anonymized manuscripts, this research reveals potential biases in the political science peer-review process. Additionally, the benefits of undergraduate students taking part in the peer-review process are explored and discussed.

Methodology and Processing

Sources Statement

Data Access

Notes:

CC0 Waiver

Other Study Description Materials

File Description--f5414349

File: anonymized_manuscript_analysis_with_no_groups.tab

  • Number of cases: 2218

  • No. of variables per record: 34

  • Type of File: text/tab-separated-values

Notes:

UNF:6:18zRIR5rGFEzhua+sTg8zQ==

Variable Description

List of Variables:

Variables

Placeholder

f5414349 Location:

Summary Statistics: Mean 1456.4891794409625; Max. 2921.0; StDev 843.1469009283132; Min. 2.0; Valid 2218.0

Variable Format: numeric

Notes: UNF:6:d7Ta3/tECk9w+crWRB5XJg==

Group

f5414349 Location:

Summary Statistics: Mean 0.0; Max. 0.0; Min. 0.0; Valid 2218.0; StDev 0.0

Variable Format: numeric

Notes: UNF:6:tOIYdgbuJSwU4mn+rF3vMQ==

SemesterYear

f5414349 Location:

Summary Statistics: Mean 6.563570784490558; StDev 3.2586262826629184; Valid 2218.0; Max. 12.0; Min. 1.0

Variable Format: numeric

Notes: UNF:6:EJRh5zyezOzk4lhqo1q12g==

Fall2014

f5414349 Location:

Summary Statistics: Valid 2218.0; Max. 1.0; StDev 0.230661973372831; Mean 0.05635707844905281; Min. 0.0;

Variable Format: numeric

Notes: UNF:6:dKkegVkRu5VhyWieJwuaaQ==

Winter2015

f5414349 Location:

Summary Statistics: Min. 0.0; StDev 0.23579427419817786; Mean 0.05906221821460874; Valid 2218.0; Max. 1.0

Variable Format: numeric

Notes: UNF:6:JeQ0T/CcIwPl1acyDLCDTA==

Fall2015

f5414349 Location:

Summary Statistics: Mean 0.11271415689810553; Max. 1.0; StDev 0.3163143785797542; Valid 2218.0; Min. 0.0

Variable Format: numeric

Notes: UNF:6:y550W34zLS+mPMH03I7GAw==

Winter2016

f5414349 Location:

Summary Statistics: Min. 0.0; Max. 1.0; StDev 0.29095618293798037; Valid 2218.0; Mean 0.09332732191163327

Variable Format: numeric

Notes: UNF:6:GoAUoXq1i3kdCQjhVbpLfw==

Fall2016

f5414349 Location:

Summary Statistics: Valid 2218.0; Min. 0.0; StDev 0.27519727815300093; Mean 0.08250676284941245; Max. 1.0;

Variable Format: numeric

Notes: UNF:6:LvIbEt+51B2C4OWdruEchA==

Winter0217

f5414349 Location:

Summary Statistics: Max. 1.0; Valid 2218.0; StDev 0.27791510224329624; Min. 0.0; Mean 0.08431018935978386

Variable Format: numeric

Notes: UNF:6:rA9KqUnbuKaNCybt+NDqfQ==

Fall2017

f5414349 Location:

Summary Statistics: Valid 2218.0; Min. 0.0; Mean 0.11361587015328949; StDev 0.3174157041457196; Max. 1.0;

Variable Format: numeric

Notes: UNF:6:OaJnKE+LswhcJH+a+7N0BQ==

Winter2018

f5414349 Location:

Summary Statistics: StDev 0.2717449408182951; Mean 0.08025247971145187; Min. 0.0; Valid 2218.0; Max. 1.0;

Variable Format: numeric

Notes: UNF:6:cDvRaw6fhWfAi5c9ZuQeRw==

Fall2018

f5414349 Location:

Summary Statistics: StDev 0.25652234692697007; Min. 0.0; Valid 2218.0; Max. 1.0; Mean 0.07078449053201073

Variable Format: numeric

Notes: UNF:6:k8MkCZorSodJijXAf/2KyA==

Winter2019

f5414349 Location:

Summary Statistics: Max. 1.0; Valid 2218.0; Mean 0.1104598737601438; StDev 0.3135327901873599; Min. 0.0

Variable Format: numeric

Notes: UNF:6:8t/8dpI664OrP2Va2+VVSQ==

Fall2019

f5414349 Location:

Summary Statistics: Valid 2218.0; Max. 1.0; Min. 0.0; Mean 0.05906221821460882; StDev 0.23579427419818408

Variable Format: numeric

Notes: UNF:6:8VWOg2yHQ9ZzUayGYmtebg==

Winter2020

f5414349 Location:

Summary Statistics: Min. 0.0; Mean 0.07754733994589649; Valid 2218.0; StDev 0.26751825363112763; Max. 1.0;

Variable Format: numeric

Notes: UNF:6:9jZiB7geuz9Egm1y02OrEA==

ManuscriptNumber

f5414349 Location:

Summary Statistics: Min. 1701.0; StDev 5452518.000176396; Mean 5298275.443490069; Valid 2212.0; Max. 9.2313402E7;

Variable Format: numeric

Notes: UNF:6:mSFAI0KRjlWsZXl14SObJg==

Reviewer

f5414349 Location:

Summary Statistics: StDev 39.74077184947242; Max. 134.0; Mean 64.3246167718656; Valid 2218.0; Min. 1.0

Variable Format: numeric

Notes: UNF:6:wLIv20B/khkv3N+irzWGrQ==

Leader

f5414349 Location:

Summary Statistics: Valid 2218.0; Mean 0.1952209197475205; Min. 0.0; StDev 0.39646005870180606; Max. 1.0;

Variable Format: numeric

Notes: UNF:6:3bNBRJMIcHldG8CuYxfVEA==

Race

f5414349 Location:

Summary Statistics: Mean 0.9273465703971117; Min. 0.0; Valid 2216.0; StDev 0.25962535765186834; Max. 1.0

Variable Format: numeric

Notes: UNF:6:P0361YzbjMwcAuNk311IyQ==

YearSchool

f5414349 Location:

Summary Statistics: Max. 4.0; Min. 1.0; StDev 0.6834845063358557; Mean 3.4616425992779774; Valid 2216.0;

Variable Format: numeric

Notes: UNF:6:NJyk4r+DnWzvSFRu43a4hA==

ReviewerSubfield

f5414349 Location:

Variable Format: character

Notes: UNF:6:N52SMNhZNUDMWALrkNH1+A==

PolsciMajor

f5414349 Location:

Summary Statistics: Valid 2216.0; Max. 1.0; Min. 0.0; StDev 0.38618734292589285; Mean 0.8176895306859195

Variable Format: numeric

Notes: UNF:6:/yDPnmclYrsutdOcZXwyvA==

SemestersServed

f5414349 Location:

Summary Statistics: StDev 1.2703560877350741; Min. 0.0; Valid 2216.0; Mean 1.0446750902527069; Max. 5.0

Variable Format: numeric

Notes: UNF:6:LYU7Bmwg/wL97fnpZA5zGw==

GenderReviewer

f5414349 Location:

Summary Statistics: Max. 1.0; Mean 0.39891696750902644; Valid 2216.0; StDev 0.4897861516688614; Min. 0.0

Variable Format: numeric

Notes: UNF:6:Rf5Qxan9GrjGXzkQ0ffRQw==

Original

f5414349 Location:

Summary Statistics: Valid 2166.0; StDev 0.7561965508457114; Min. 1.0; Mean 2.1860572483841194; Max. 3.0;

Variable Format: numeric

Notes: UNF:6:ZC1MTiLoufIhdZkDQZLnJQ==

Important

f5414349 Location:

Summary Statistics: Min. 1.0; Mean 2.952402745995422; Valid 2185.0; StDev 1.123151694042815; Max. 5.0

Variable Format: numeric

Notes: UNF:6:ZVb4HEfBOoBLXtMaszkcgA==

Interesting

f5414349 Location:

Summary Statistics: Max. 5.0; Min. 1.0; Mean 3.017367458866545; Valid 2188.0; StDev 1.2230337815455397

Variable Format: numeric

Notes: UNF:6:FxEAzWRtaxY2k9WgG1X2Jg==

Evidence

f5414349 Location:

Summary Statistics: StDev 1.149406515786656; Valid 2179.0; Mean 2.912804038549801; Min. 1.0; Max. 5.0

Variable Format: numeric

Notes: UNF:6:xQWmRmoDb4hNxMxE1JHW3Q==

Methods

f5414349 Location:

Summary Statistics: Min. 1.0; Valid 2153.0; StDev 1.2027920646655021; Mean 2.96470041802136; Max. 5.0;

Variable Format: numeric

Notes: UNF:6:3y1icqvwStyb/ohnwYyn+Q==

Writing

f5414349 Location:

Summary Statistics: StDev 1.1502207321760343; Max. 5.0; Mean 3.159817351598171; Min. 1.0; Valid 2190.0;

Variable Format: numeric

Notes: UNF:6:CIquJIfyZut/70hYyBwgdA==

Organized

f5414349 Location:

Summary Statistics: Mean 3.1988117001828162; Valid 2188.0; StDev 1.1960376799580734; Min. 1.0; Max. 5.0;

Variable Format: numeric

Notes: UNF:6:MOZDGcXNKMzjRLEPp0H0gg==

Recommendation

f5414349 Location:

Summary Statistics: Max. 3.0; Valid 2142.0; Min. 1.0; Mean 2.742763772175538; StDev 0.531696340797747

Variable Format: numeric

Notes: UNF:6:8hINadGo3pdmUblGFNiXjw==

Eval

f5414349 Location:

Summary Statistics: Min. 6.0; StDev 5.691087882161287; Valid 2124.0; Mean 18.24858757062148; Max. 30.0;

Variable Format: numeric

Notes: UNF:6:W7tfPEH/zTK9XSrpTSeQaw==

OriginalRecode

f5414349 Location:

Summary Statistics: Max. 3.0; StDev 0.7552336130850837; Valid 2166.0; Min. 1.0; Mean 2.1837488457987098

Variable Format: numeric

Notes: UNF:6:S8izZ97udE7ux3cjAbA9fQ==