- d
A n-grams collection extracted from the Portuguese Web
- dataone.org
- dados.gov.pt
- +1more
Updated Nov 8, 2023
Share
Facebook
Twitter
EmailClick to copy linkLink copiedCiteBatista, David (2023). A n-grams collection extracted from the Portuguese Web [Dataset]. http://doi.org/10.7910/DVN/ZSXC55Unique identifierhttps://doi.org/10.7910/DVN/ZSXC55Dataset updatedNov 8, 2023Dataset provided byHarvard DataverseAuthorsBatista, DavidDescriptionThe n-grams collection was extracted from the collected documents whose identified language was Portuguese. We extracted word n-grams up to the fifht order (5-grams). A set of regular expressions to tokenize the text were applied. After the extraction, all n-grams with tokens having more than 32 characters were discarded. N-grams with frequencies below 5 were discarded as well. The n-grams collection is available as a set of UTF-8 encoded files, containing the n-grams and their frequencies
Not seeing a result you expected?
Learn how you can add new datasets to our index.
FacebookTwitterEmailThe n-grams collection was extracted from the collected documents whose identified language was Portuguese. We extracted word n-grams up to the fifht order (5-grams). A set of regular expressions to tokenize the text were applied. After the extraction, all n-grams with tokens having more than 32 characters were discarded. N-grams with frequencies below 5 were discarded as well. The n-grams collection is available as a set of UTF-8 encoded files, containing the n-grams and their frequencies