The CEPS EurLex dataset: 142.036 EU laws from 1952-2019 with full text and 22 variablesdoi:10.7910/DVN/0EGYWYHarvard Dataverse2020-02-162Borrett, Camille; Laurer, Moritz, 2020, "The CEPS EurLex dataset: 142.036 EU laws from 1952-2019 with full text and 22 variables", https://doi.org/10.7910/DVN/0EGYWY, Harvard Dataverse, V2, UNF:6:+hH0OxeHX0vYGiIOintTyA== [fileUNF]The CEPS EurLex dataset: 142.036 EU laws from 1952-2019 with full text and 22 variablesdoi:10.7910/DVN/0EGYWYBorrett, CamilleLaurer, MoritzAndrea RendaCentre for European Policy StudiesBrussels, BelgiumRPython822735Harvard DataverseLaurer, MoritzCentre for European Policy Studies2020-02-16Computer and Information ScienceLawSocial SciencesText-As-DataEuropean UnionLawText AnalysisText-As-DataEuropean UnionLaw<h3>The CEPS EurLex dataset</h3> The dataset contains 142.036 EU laws - almost the entire corpus of the EU's digitally available legal acts passed between 1952 - 2019. It encompasses the three types of legally binding acts passed by the EU institutions: 102.304 regulations, 4.070 directives, 35.798 decisions in English language. The dataset was scraped from the official EU legal database (Eur-lex.eu) and transformed in machine-readable CSV format with the programming languages R and Python. The dataset was collected by the Centre for European Policy Studies (CEPS) for the TRIGGER project (https://trigger-project.eu/). We hope that it will facilitate future quantitative and computational research on the EU. Brief description: - The dataset is organised in tabular format, with each law representing one row and the columns representing 23 variables. - The full text of 134.633 laws is included (column "act_raw_text"). For newer laws, the text was scraped from Eur-lex.eu via the HTML pages, while for older laws, the text was extracted from (scanned) PDF documents (if available in English). - 22 additional variables are included, such as 'Act_name', 'Act_type', 'Subject_matter', 'Authors', 'Date_document', 'ELI_link', 'CELEX' (a unique identifier for every law). Please see the "CEPS_EurLex_codebook.pdf" file for an explanation of all variables. - Given its size, the dataset was uploaded in different batches to facilitate usage. Some Excel files are provided for non-technical users. We recommend, however, the use of the CSV files, since Excel does not save large amounts of data properly. EurLex_all.csv is the master file containing all data. Caveats: - The Eur-lex.eu website does not consistently provide data for all the variables. In addition, the HTML documents were not always cleanly formatted and text extraction from scanned PDFs is not entirely clean. Some data points are therefore missing for some laws and some laws were excluded entirely. - Not not all (older) laws were available in English, especially since Ireland and the UK only joined the European Communities in 1973. Non-English laws are excluded from the dataset. Other: - For details on the types of EU legal acts: https://ec.europa.eu/info/law/law-making-process/types-eu-law_en - An example for an experimental analysis with this dataset: https://trigger-project.eu/2019/10/28/a-data-science-approach-to-eu-differentiated-integration/ - The TRIGGER project is funded by the EU's Horizon 2020 programme, grant number 822735195220192019-07-012019-10-01Legal dataTextual dataThe official EUR-Lex database: https://eur-lex.europa.eu/homepage.html<a href="http://creativecommons.org/publicdomain/zero/1.0">CC0 1.0</a>EurLex_all_no_text.tab14203623text/tab-separated-valuesUNF:6:ALexVT8UYNA2w3u4iQeR7Q==Master file, without full text for easier use (Excel).EurLex_decisions_no_text.tab3579823text/tab-separated-valuesUNF:6:n+X1deQWBXScELg8426XKg==Only decisions, without full text (Excel).EurLex_directives.tab407024text/tab-separated-valuesUNF:6:qPnaXyWRbOjO2W4cozU45w==Only directives, with full text.EurLex_directives_no_text.tab407023text/tab-separated-valuesUNF:6:gb1IdA/ZViFt8g+15g9ZsQ==Only directives, without full text (Excel).EurLex_regulations_no_text_all.tab10216723text/tab-separated-valuesUNF:6:BgwKe5WA7BTUkNggZoEgdQ==All regulations, without full text (Excel)CELEXUNF:6:sQgiSdwBr+ZePrR8IAvxFA==ActnameUNF:6:UKTwN83Fq+X/uB5DV+w8pg==ActtypeUNF:6:jD79qBu6oJvqEbOxGFyE0Q==StatusUNF:6:likJiuv6TIt/Kx1KNJjJiw==EUROVOCUNF:6:8nba5ubl2zqJQU34ctNzHA==SubjectmatterUNF:6:0/HyJYHSkfptb13/IoEnPg==TreatyUNF:6:mmO8trKN4F5gf+CnUZDmYw==LegalbasiscelexUNF:6:MrJOPS6VRPCiziceSigKjA==AuthorsUNF:6:tJeipnoktZ8E+9n+JxZrrw==ProcedurenumberUNF:6:k1nuJHfXLcXMy/Dvj6lPvg==DatedocumentUNF:6:ig+P+hPx6NThD2RkkEpKVg==DatepublicationUNF:6:kZeGxCX59ieWDizNoJhlEg==FirstentryintoforceUNF:6:9GeiNQNCjCQi46obcIv5Vw==TemporalstatusUNF:6:fZC/4+1/X+BCnm1XgaGjUA==ActcitesUNF:6:ldpclLBFp6+iuxt+J4eeYg==CiteslinksUNF:6:sNAvC/BVd49AR+7hOMGivw==ActammendsUNF:6:2AibL+LDMuAFczgbfXCf2A==AmmendslinksUNF:6:Fz/diaJTn5ddAXsKncqbLQ==EurlexlinkNaNNaN.NaN142036.0NaN0.0NaNUNF:6:5l5wFnmNTi8K8AphgQWhrw==ELIlinkNaN0.0NaNNaN.142036.0NaNNaNUNF:6:5l5wFnmNTi8K8AphgQWhrw==ProposallinkNaNNaNNaN.NaN0.0142036.0NaNUNF:6:5l5wFnmNTi8K8AphgQWhrw==OeillinkNaNNaNNaN0.0.NaNNaN142036.0UNF:6:5l5wFnmNTi8K8AphgQWhrw==AdditionalinfoUNF:6:yCMQt09bao+21kwLugywBg==CELEXUNF:6:lzZW297KHfWkgcOCZ9GJpw==ActnameUNF:6:7jaASSgUog3EsHuOAEz42A==ActtypeUNF:6:hdJHy7xb49gOCB0QTaaaiw==StatusUNF:6:xcyGZB40LOPrtkuKBmEXeQ==EUROVOCUNF:6:NC2Vc78EtuR8QVj+B+Qspw==SubjectmatterUNF:6:2OHtP1t2/jyik/nV4vuxoA==TreatyUNF:6:6T5YS6Dn/08IsEPrG3fMQg==LegalbasiscelexUNF:6:HlFqkkQyqtMQzTj73q3BTg==AuthorsUNF:6:csIEC9StKR2Thc/1gmvomg==ProcedurenumberUNF:6:tEu4eScL023BZ/Skt0BAtg==DatedocumentUNF:6:e0wavxrkLUh2JF6MCU5/cQ==DatepublicationUNF:6:n8gBhvdK/Bbsq8u5vDDjkw==FirstentryintoforceUNF:6:5N9hTVZPePE0whhu8fpChg==TemporalstatusUNF:6:iHCKJjTVHDeD7Un8WUazDQ==ActcitesUNF:6:p3QWEkmE7DUcPwhD/PWeSg==CiteslinksUNF:6:WyBymXnF5MV2L3SDywc9aw==ActammendsUNF:6:St5nTyhrcdbyJYUuEcf75w==AmmendslinksUNF:6:Gxc7c5GDniGO/bMUi+JNVA==EurlexlinkUNF:6:S4xh15qvm5i6vnUMSoSRfA==ELIlink35798.0NaNNaNNaNNaNNaN.0.0UNF:6:nvJDwiAqcRZfvn1e2Wm4bA==ProposallinkNaN0.0NaNNaNNaN35798.0.NaNUNF:6:nvJDwiAqcRZfvn1e2Wm4bA==Oeillink.NaNNaNNaN35798.0NaNNaN0.0UNF:6:nvJDwiAqcRZfvn1e2Wm4bA==AdditionalinfoUNF:6:IUrSXHpaO+QpMDyOOjLkog==CELEXUNF:6:OqI8ikIDpFt3+UCHYdspwA==Act_nameUNF:6:J6b21PSnfEY/5/AQaq+20g==Act_typeUNF:6:gc/f8nDJbTVhmwp31XdG1w==StatusUNF:6:KCiADxqlOZCua/ng3G+EGg==EUROVOCUNF:6:REfCJBFpy2Kb4WzlwCuaHg==Subject_matterUNF:6:HnNH9kMz5j85m8NfoQgoww==TreatyUNF:6:ut6sk86TG7pQRaveOR1jhg==Legal_basis_celexUNF:6:zzeXojQam1O76bznw1r6RQ==AuthorsUNF:6:Qq0cz0AkmzHfnrNLj2FgDQ==Procedure_numberUNF:6:dDnx5THFokESAvKvoxidog==Date_documentUNF:6:c7v/dX3h/xnJlMSV4yZsEA==Date_publicationUNF:6:aYedgitIzXNPu6qsN78PxA==First_entry_into_forceUNF:6:3A/3gzkB5ReaDD/i75nXqw==Temporal_statusNaNNaN4070.0NaN0.0.NaNNaNUNF:6:07bGLdAvY0kWn6B9j2JqkA==Act_citesUNF:6:9+coX40fGRRSvaiuEDNFrA==Cites_linksUNF:6:jGYiSNpiqQ2FjgTHhtdIpw==Act_ammendsUNF:6:dML2DHcSz1EgzhdOVd2vnw==Ammends_linksUNF:6:Fo2i+RzRdm6vbjWYdQtVMA==Eurlex_linkUNF:6:YxPfbzm72poR1yYJdvGzzw==ELI_linkUNF:6:mvFIlfqjOk9ePiYtL6tGvg==Proposal_linkUNF:6:yr5pA4cs/lX0RJHvCMTmtA==Oeil_linkUNF:6:7dRS+39XvOpXsVG1quRYBA==Additional_infoUNF:6:W10Z9WTu2cbDwBuHgqhJCQ==act_raw_textUNF:6:dOagXV6gsBamyDzL7082Ag==CELEXUNF:6:OqI8ikIDpFt3+UCHYdspwA==ActnameUNF:6:J6b21PSnfEY/5/AQaq+20g==ActtypeUNF:6:gc/f8nDJbTVhmwp31XdG1w==StatusUNF:6:KCiADxqlOZCua/ng3G+EGg==EUROVOCUNF:6:REfCJBFpy2Kb4WzlwCuaHg==SubjectmatterUNF:6:HnNH9kMz5j85m8NfoQgoww==TreatyUNF:6:ut6sk86TG7pQRaveOR1jhg==LegalbasiscelexUNF:6:zzeXojQam1O76bznw1r6RQ==AuthorsUNF:6:Qq0cz0AkmzHfnrNLj2FgDQ==ProcedurenumberUNF:6:dDnx5THFokESAvKvoxidog==DatedocumentUNF:6:c7v/dX3h/xnJlMSV4yZsEA==DatepublicationUNF:6:QVpcjFNnej0m/LrqSAB/cg==FirstentryintoforceUNF:6:AB34p3TBu2cG/+v99fijgA==TemporalstatusNaNNaNNaNNaN4070.0.0.0NaNUNF:6:07bGLdAvY0kWn6B9j2JqkA==ActcitesUNF:6:9+coX40fGRRSvaiuEDNFrA==CiteslinksUNF:6:Dr1ZHHXwIRH/LzJlq7ApdQ==ActammendsUNF:6:dML2DHcSz1EgzhdOVd2vnw==AmmendslinksUNF:6:gnKU9FxB32K6Xbcr80t47w==EurlexlinkUNF:6:YxPfbzm72poR1yYJdvGzzw==ELIlinkUNF:6:mvFIlfqjOk9ePiYtL6tGvg==ProposallinkUNF:6:yr5pA4cs/lX0RJHvCMTmtA==OeillinkUNF:6:7dRS+39XvOpXsVG1quRYBA==AdditionalinfoUNF:6:W10Z9WTu2cbDwBuHgqhJCQ==CELEXUNF:6:Ccm94Fh9WZ1MFrgDpfWsEQ==ActnameUNF:6:AwZRd2NOamjBcwEOe3qmFg==ActtypeUNF:6:LETivE/Vm2Dlv5+FEUu3GQ==StatusUNF:6:xSGJjN6nKGLe5ifTImRyJw==EUROVOCUNF:6:6zdzfV26z1Hhedt71iG7gw==SubjectmatterUNF:6:lnLgiRpkbm+DsNHU89XaQg==TreatyUNF:6:YCSmzKgrHODMCfePfFEVFg==LegalbasiscelexUNF:6:wl/6hsmpFj05PhlddDahiQ==AuthorsUNF:6:0uKMfSXfbkD431SiNMGjFQ==ProcedurenumberUNF:6:T8TFnaoVGoPTx6ASrkQWng==DatedocumentUNF:6:4nHTZZ/FyrtCvhlhiPg88g==Datepublication0.0.102167.0NaNNaNNaNNaNNaNUNF:6:j1r/hvaUtHKtF7Q4mqhdTg==FirstentryintoforceUNF:6:WkxarQbYBpnFA6AwCbPoIQ==TemporalstatusNaNNaNNaN.NaN0.0102167.0NaNUNF:6:j1r/hvaUtHKtF7Q4mqhdTg==ActcitesUNF:6:CN3YUBm6xB+UG3eHBrL1Ng==CiteslinksUNF:6:sNdUOOxt3swurWranzVOAg==ActammendsUNF:6:3rVvRGeIdZYxzaLv0hlUPA==AmmendslinksUNF:6:tqJmtq4yrYIXpd80JkHOow==EurlexlinkUNF:6:lrw+VihwAyorQ4mN2HyUIA==ELIlinkNaNNaN.NaNNaNNaN102167.00.0UNF:6:j1r/hvaUtHKtF7Q4mqhdTg==Proposallink.NaNNaN0.0102167.0NaNNaNNaNUNF:6:j1r/hvaUtHKtF7Q4mqhdTg==OeillinkNaNNaN.NaN0.0102167.0NaNNaNUNF:6:j1r/hvaUtHKtF7Q4mqhdTg==AdditionalinfoUNF:6:tN3y83tZjjGSyQl5SNngBg==CEPS_EurLex_codebook.pdfA codebook, explaining the different variables available in the dataset application/pdfEurLex_all.csvMaster file. Contains all data. We recommend using this file. text/csvEurLex_decisions.csvOnly decisions, with full text.text/csvEurLex_regulations_1952_1990.csvOnly regulations from 1952 - 1990, with full texttext/csvEurLex_regulations_1990_2000.csvOnly regulations from 1990 - 2000, with full texttext/csvEurLex_regulations_2000_2019.csvOnly regulations from 2000 - 2019, with full texttext/csvEurLex_regulations_all.csvAll regulations, with full texttext/csv