10.7910/DVN/YJP1ZM Marcos Carvalho Borges Marcos Carvalho Borges Ribeirão Preto Medical School, University of São Paulo Luciane Loures Santos Luciane Loures Santos Ribeirão Preto Medical School, University of São Paulo Paulo Henrique Manso Paulo Henrique Manso Ribeirão Preto Medical School, University of São Paulo Elaine Christine Dantas Moisés Elaine Christine Dantas Moisés Ribeirão Preto Medical School, University of São Paulo Pedro Soler Coltro Pedro Soler Coltro Ribeirão Preto Medical School, University of São Paulo Priscilla Costa Fonseca Priscilla Costa Fonseca eduCat, Belo Horizonte Paulo Roberto Alves Gentil Paulo Roberto Alves Gentil eduCat, Belo Horizonte Rodrigo de Carvalho Santana Rodrigo de Carvalho Santana Ribeirão Preto Medical School, University of São Paulo Lucas Faria Rodrigues Lucas Faria Rodrigues Ribeirao Preto Clinical Hospital Benedito Carlos Maciel Benedito Carlos Maciel Ribeirão Preto Medical School, University of São Paulo Hilton Marcos Alves Ricz Ribeirão Preto Medical School, University of São Paulo Harvard Dataverse 2024 Medicine, Health and Life Sciences Marcos Carvalho Borges Marcos Carvalho Borges Ribeirão Preto Medical School, University of São Paulo 2024-11-10 2024-11-12 1568873 810841 968 852 499 692 8618 text/tab-separated-values text/tab-separated-values type/x-r-syntax text/tab-separated-values type/x-r-syntax text/tab-separated-values type/x-r-syntax 1.0 Creative Commons CC0 1.0 Universal Public Domain Dedication. With the COVID-19 pandemic, online high-stakes exams have become a viable alternative. This study evaluated the feasibility of computer-based testing (CBT) for medical residency applications in Brazil and its impacts on item quality and applicants' access compared to paper-based testing. In 2020, an online CBT was conducted in a Ribeirao Preto Clinical Hospital in Brazil. In total, 120 multiple-choice question items were constructed. Two years later, the exam was performed as paper-based testing. Item construction processes were similar for both exams. Difficulty and discrimination indexes, point-biserial coefficient, difficulty, discrimination, guessing parameters, and Cronbach's alpha coefficient were measured based on the item response and classical test theories. Internet stability for applicants was monitored.