65 datasets found
  1. h

    wikitext2

    • huggingface.co
    • opendatalab.com
    Updated Oct 21, 2023
    + more versions
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Jan Karsten Kuhnke (2023). wikitext2 [Dataset]. https://huggingface.co/datasets/mindchain/wikitext2
    Explore at:
    Dataset updated
    Oct 21, 2023
    Authors
    Jan Karsten Kuhnke
    License

    Attribution-ShareAlike 3.0 (CC BY-SA 3.0)https://creativecommons.org/licenses/by-sa/3.0/
    License information was derived automatically

    Description

    Dataset Card for "wikitext"

      Dataset Summary

    The WikiText language modeling dataset is a collection of over 100 million tokens extracted from the set of verified Good and Featured articles on Wikipedia. The dataset is available under the Creative Commons Attribution-ShareAlike License. Compared to the preprocessed version of Penn Treebank (PTB), WikiText-2 is over 2 times larger and WikiText-103 is over 110 times larger. The WikiText dataset also features a far larger… See the full description on the dataset page: https://huggingface.co/datasets/mindchain/wikitext2.

  2. WikiText-2 Data

    • kaggle.com
    zip
    Updated Jul 20, 2021
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    VIVEK METTU (2021). WikiText-2 Data [Dataset]. https://www.kaggle.com/vivekmettu/wikitext2-data
    Explore at:
    zip(4132739 bytes)Available download formats
    Dataset updated
    Jul 20, 2021
    Authors
    VIVEK METTU
    Description

    Dataset

    This dataset was created by VIVEK METTU

    Contents

  3. h

    wikitext-2-v1

    • huggingface.co
    Updated Apr 20, 2023
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Mark Mealman (2023). wikitext-2-v1 [Dataset]. https://huggingface.co/datasets/Dracones/wikitext-2-v1
    Explore at:
    CroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.
    Dataset updated
    Apr 20, 2023
    Authors
    Mark Mealman
    Description

    Dracones/wikitext-2-v1 dataset hosted on Hugging Face and contributed by the HF Datasets community

  4. t

    Wikitext-2 - Dataset - LDM

    • service.tib.eu
    • resodate.org
    Updated Dec 3, 2024
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    (2024). Wikitext-2 - Dataset - LDM [Dataset]. https://service.tib.eu/ldmservice/dataset/wikitext-2
    Explore at:
    Dataset updated
    Dec 3, 2024
    Description

    The dataset used in this paper is not explicitly described. However, it is mentioned that the authors used the Wikitext-2 dataset for text generation tasks.

  5. h

    wikitext-2-raw-v1-forbidden-titles-train

    • huggingface.co
    Updated Jul 25, 2024
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    ActiveRetrieval (2024). wikitext-2-raw-v1-forbidden-titles-train [Dataset]. https://huggingface.co/datasets/Self-GRIT/wikitext-2-raw-v1-forbidden-titles-train
    Explore at:
    CroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.
    Dataset updated
    Jul 25, 2024
    Dataset authored and provided by
    ActiveRetrieval
    Description

    Self-GRIT/wikitext-2-raw-v1-forbidden-titles-train dataset hosted on Hugging Face and contributed by the HF Datasets community

  6. Wikitext-103

    • kaggle.com
    • paperswithcode.com
    • +1more
    zip
    Updated Jul 12, 2024
    + more versions
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Vadim Kurochkin (2024). Wikitext-103 [Dataset]. https://www.kaggle.com/datasets/vadimkurochkin/wikitext-103
    Explore at:
    zip(192808534 bytes)Available download formats
    Dataset updated
    Jul 12, 2024
    Authors
    Vadim Kurochkin
    License

    Apache License, v2.0https://www.apache.org/licenses/LICENSE-2.0
    License information was derived automatically

    Description

    The WikiText language modeling dataset is a collection of over 100 million tokens extracted from the set of verified Good and Featured articles on Wikipedia. The dataset is available under the Creative Commons Attribution-ShareAlike License.

    Compared to the preprocessed version of Penn Treebank (PTB), WikiText-2 is over 2 times larger and WikiText-103 is over 110 times larger. The WikiText dataset also features a far larger vocabulary and retains the original case, punctuation and numbers - all of which are removed in PTB. As it is composed of full articles, the dataset is well suited for models that can take advantage of long term dependencies.

  7. h

    wikitext-2-raw-v1-shuffled

    • huggingface.co
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Tongyao, wikitext-2-raw-v1-shuffled [Dataset]. https://huggingface.co/datasets/tyzhu/wikitext-2-raw-v1-shuffled
    Explore at:
    CroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.
    Authors
    Tongyao
    Description

    Dataset Card for "wikitext-2-raw-v1-shuffled"

    More Information needed

  8. wikitext-2-v1

    • kaggle.com
    zip
    Updated May 31, 2024
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    bestwater (2024). wikitext-2-v1 [Dataset]. https://www.kaggle.com/datasets/bestwater/wikitext-2-v1/code
    Explore at:
    zip(4542135 bytes)Available download formats
    Dataset updated
    May 31, 2024
    Authors
    bestwater
    Description

    Dataset

    This dataset was created by bestwater

    Contents

  9. h

    wikitext-tiny

    • huggingface.co
    Updated Aug 31, 2023
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    yujiepan (2023). wikitext-tiny [Dataset]. https://huggingface.co/datasets/yujiepan/wikitext-tiny
    Explore at:
    CroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.
    Dataset updated
    Aug 31, 2023
    Authors
    yujiepan
    Description

    This dataset is sampled from wikitext/wikitext-2-v1/train. Codes to generate this dataset: import datasets dataset = datasets.load_dataset('wikitext', 'wikitext-2-v1')

    selected = [] i = -1 while len(selected) < 24: i += 1 text = dataset['train'][i]['text'] if 8 < len(text.split(' ')) <= 16 and '=' not in text: selected.append(i)

    tiny_dataset = dataset['train'].select(selected)

  10. h

    wikitext-2

    • huggingface.co
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Mika Senghaas, wikitext-2 [Dataset]. https://huggingface.co/datasets/mikasenghaas/wikitext-2
    Explore at:
    CroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.
    Authors
    Mika Senghaas
    Description

    mikasenghaas/wikitext-2 dataset hosted on Hugging Face and contributed by the HF Datasets community

  11. r

    WikiText-2 dataset

    • resodate.org
    • service.tib.eu
    Updated Dec 16, 2024
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Ziyi Guan; Hantao Huang; Yupeng Su; Hong Huang; Ngai Wong; Hao Yu (2024). WikiText-2 dataset [Dataset]. https://resodate.org/resources/aHR0cHM6Ly9zZXJ2aWNlLnRpYi5ldS9sZG1zZXJ2aWNlL2RhdGFzZXQvd2lraXRleHQtMi1kYXRhc2V0
    Explore at:
    Dataset updated
    Dec 16, 2024
    Dataset provided by
    Leibniz Data Manager
    Authors
    Ziyi Guan; Hantao Huang; Yupeng Su; Hong Huang; Ngai Wong; Hao Yu
    Description

    The WikiText-2 dataset is a benchmark for evaluating the performance of large language models.

  12. h

    wikitext-2-nonulls-sample

    • huggingface.co
    Updated Jul 5, 2001
    + more versions
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Clara Na (2001). wikitext-2-nonulls-sample [Dataset]. https://huggingface.co/datasets/claran/wikitext-2-nonulls-sample
    Explore at:
    CroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.
    Dataset updated
    Jul 5, 2001
    Authors
    Clara Na
    Description

    claran/wikitext-2-nonulls-sample dataset hosted on Hugging Face and contributed by the HF Datasets community

  13. wikitext

    • kaggle.com
    zip
    Updated Aug 9, 2020
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Rohit Gupta (2020). wikitext [Dataset]. https://www.kaggle.com/datasets/rohitgr/wikitext/discussion
    Explore at:
    zip(396673278 bytes)Available download formats
    Dataset updated
    Aug 9, 2020
    Authors
    Rohit Gupta
    Description

    Dataset is taken from https://blog.einstein.ai/the-wikitext-long-term-dependency-language-modeling-dataset

  14. h

    wikitext-2-second-half

    • huggingface.co
    + more versions
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Hao Li, wikitext-2-second-half [Dataset]. https://huggingface.co/datasets/tartspuppy/wikitext-2-second-half
    Explore at:
    CroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.
    Authors
    Hao Li
    Description

    tartspuppy/wikitext-2-second-half dataset hosted on Hugging Face and contributed by the HF Datasets community

  15. h

    wikitext-2-noheader-sample

    • huggingface.co
    + more versions
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Clara Na, wikitext-2-noheader-sample [Dataset]. https://huggingface.co/datasets/claran/wikitext-2-noheader-sample
    Explore at:
    CroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.
    Authors
    Clara Na
    Description

    claran/wikitext-2-noheader-sample dataset hosted on Hugging Face and contributed by the HF Datasets community

  16. E

    WikiText-103 & 2

    • live.european-language-grid.eu
    txt
    Updated Dec 30, 2016
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    (2016). WikiText-103 & 2 [Dataset]. https://live.european-language-grid.eu/catalogue/corpus/5169
    Explore at:
    txtAvailable download formats
    Dataset updated
    Dec 30, 2016
    License

    Attribution-ShareAlike 3.0 (CC BY-SA 3.0)https://creativecommons.org/licenses/by-sa/3.0/
    License information was derived automatically

    Description

    Dataset contains word and character level tokens extracted from Wikipedia

  17. WIkipedia Text Generation

    • kaggle.com
    zip
    Updated Oct 25, 2022
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Romi Kumar (2022). WIkipedia Text Generation [Dataset]. https://www.kaggle.com/datasets/romikumar7/wikipedia-text-generation
    Explore at:
    zip(4542135 bytes)Available download formats
    Dataset updated
    Oct 25, 2022
    Authors
    Romi Kumar
    Description

    Dataset

    This dataset was created by Romi Kumar

    Contents

  18. f

    Word-level valid and test perplexity on WikiText-2.

    • plos.figshare.com
    xls
    Updated Jun 10, 2023
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Lu Yuwen; Shuyu Chen; Xiaohan Yuan (2023). Word-level valid and test perplexity on WikiText-2. [Dataset]. http://doi.org/10.1371/journal.pone.0249820.t010
    Explore at:
    xlsAvailable download formats
    Unique identifier
    https://doi.org/10.1371/journal.pone.0249820.t010
    Dataset updated
    Jun 10, 2023
    Dataset provided by
    PLOS ONE
    Authors
    Lu Yuwen; Shuyu Chen; Xiaohan Yuan
    License

    Attribution 4.0 (CC BY 4.0)https://creativecommons.org/licenses/by/4.0/
    License information was derived automatically

    Description

    Word-level valid and test perplexity on WikiText-2.

  19. h

    wikitext-2-raw-v1-test

    • huggingface.co
    Updated Oct 21, 2025
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Data Filtering Challenge for Training Edge Language Models (2025). wikitext-2-raw-v1-test [Dataset]. https://huggingface.co/datasets/data4elm/wikitext-2-raw-v1-test
    Explore at:
    Dataset updated
    Oct 21, 2025
    Dataset authored and provided by
    Data Filtering Challenge for Training Edge Language Models
    Description

    wikitext-2-raw-v1-test

    Test split for lm-eval-harness.

  20. h

    wikitext-2-raw-v1-forbidden-titles-1k

    • huggingface.co
    Updated Aug 7, 2024
    + more versions
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    ActiveRetrieval (2024). wikitext-2-raw-v1-forbidden-titles-1k [Dataset]. https://huggingface.co/datasets/Self-GRIT/wikitext-2-raw-v1-forbidden-titles-1k
    Explore at:
    CroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.
    Dataset updated
    Aug 7, 2024
    Dataset authored and provided by
    ActiveRetrieval
    Description

    Self-GRIT/wikitext-2-raw-v1-forbidden-titles-1k dataset hosted on Hugging Face and contributed by the HF Datasets community

Share
FacebookFacebook
TwitterTwitter
Email
Click to copy link
Link copied
Close
Cite
Jan Karsten Kuhnke (2023). wikitext2 [Dataset]. https://huggingface.co/datasets/mindchain/wikitext2

wikitext2

WikiText

mindchain/wikitext2

Explore at:
Dataset updated
Oct 21, 2023
Authors
Jan Karsten Kuhnke
License

Attribution-ShareAlike 3.0 (CC BY-SA 3.0)https://creativecommons.org/licenses/by-sa/3.0/
License information was derived automatically

Description

Dataset Card for "wikitext"

  Dataset Summary

The WikiText language modeling dataset is a collection of over 100 million tokens extracted from the set of verified Good and Featured articles on Wikipedia. The dataset is available under the Creative Commons Attribution-ShareAlike License. Compared to the preprocessed version of Penn Treebank (PTB), WikiText-2 is over 2 times larger and WikiText-103 is over 110 times larger. The WikiText dataset also features a far larger… See the full description on the dataset page: https://huggingface.co/datasets/mindchain/wikitext2.

Search
Clear search
Close search
Google apps
Main menu