|
View: |
Part 1: Document Description
|
|
Citation |
|
|---|---|
|
Title: |
word2vec model trained on universities corpus |
|
Identification Number: |
doi:10.7910/DVN/BZ1RWS |
|
Distributor: |
Harvard Dataverse |
|
Date of Distribution: |
2019-06-10 |
|
Version: |
1 |
|
Bibliographic Citation: |
Rozado, David, 2019, "word2vec model trained on universities corpus", https://doi.org/10.7910/DVN/BZ1RWS, Harvard Dataverse, V1 |
|
Citation |
|
|
Title: |
word2vec model trained on universities corpus |
|
Identification Number: |
doi:10.7910/DVN/BZ1RWS |
|
Authoring Entity: |
Rozado, David (CSIRO) |
|
Distributor: |
Harvard Dataverse |
|
Access Authority: |
Rozado, David |
|
Depositor: |
Rozado, David |
|
Date of Deposit: |
2019-06-10 |
|
Holdings Information: |
https://doi.org/10.7910/DVN/BZ1RWS |
|
Study Scope |
|
|
Keywords: |
Computer and Information Science, Social Sciences, word2vec Model, word embeddings |
|
Abstract: |
word2vec model trained on the concatenation of all the individual universities corpora. To generate the word embeddings of the corpus, the gensim implementation of word2vec (CBOW) was used. For training the word embeddings model, the following parameters were used: vector dimensions=300, window size=10, negative sampling=10, down sampling frequent words = 0.00008 (downsamples 612 most-common words), number of iterations (epochs) through the corpus=10, maximum final vocabulary= 3 million. The maximum final vocabulary resulted in an effective minimum frequency count of 20. That is, only terms that appear more than 20 times in the corpus were included into the word embedding model vocabulary. The exponent used to shape the negative sampling distribution was 0.5. |
|
Methodology and Processing |
|
|
Sources Statement |
|
|
Data Access |
|
|
Notes: |
<a href="http://creativecommons.org/publicdomain/zero/1.0">CC0 1.0</a> |
|
Other Study Description Materials |
|
|
Label: |
word2vecModelsTrigrams.part1.rar |
|
Notes: |
application/x-rar-compressed |
|
Label: |
word2vecModelsTrigrams.part2.rar |
|
Notes: |
application/x-rar-compressed |