- h
openwebtext
- huggingface.co
- paperswithcode.com
- +4more
Updated Sep 28, 2020+ more versions
Share
Facebook
Twitter
EmailClick to copy linkLink copiedCiteAaron Gokaslan (2020). openwebtext [Dataset]. https://huggingface.co/datasets/Skylion007/openwebtextDataset updatedSep 28, 2020AuthorsAaron GokaslanLicensehttps://choosealicense.com/licenses/cc0-1.0/https://choosealicense.com/licenses/cc0-1.0/
DescriptionAn open-source replication of the WebText dataset from OpenAI.
- O
openwebtext-10k
- opendatalab.com
- huggingface.co
zipUpdated Jan 1, 2019ShareFacebookTwitterEmailClick to copy linkLink copiedCite(2019). openwebtext-10k [Dataset]. https://opendatalab.com/OpenDataLab/openwebtext-10kzipAvailable download formatsDataset updatedJan 1, 2019LicenseCC0 1.0 Universal Public Domain Dedicationhttps://creativecommons.org/publicdomain/zero/1.0/
License information was derived automaticallyDescription10K slice of OpenWebText - An open-source replication of the WebText dataset from OpenAI. This is a small subset representing the first 10K records from the original dataset - created for testing.
- h
openwebtext-tokenized-Llama-3.2
- huggingface.co
Updated Mar 26, 2025ShareFacebookTwitterEmailClick to copy linkLink copiedCiteAlex Gulko (2025). openwebtext-tokenized-Llama-3.2 [Dataset]. https://huggingface.co/datasets/GulkoA/openwebtext-tokenized-Llama-3.2Dataset updatedMar 26, 2025AuthorsAlex GulkoDescriptionOpenWebText dataset (open-source replication of the WebText dataset from OpenAI, that was used to train GPT-2) tokenized for Llama 3.2 models Useful for accelerated training and testing of sparse autoencoders Context size: 128, not shuffled
- h
openwebtext.json
- huggingface.co
Updated Mar 12, 2025+ more versionsShareFacebookTwitterEmailClick to copy linkLink copiedCiteOliver Carey (2025). openwebtext.json [Dataset]. https://huggingface.co/datasets/olivercareyncl/openwebtext.jsonDataset updatedMar 12, 2025AuthorsOliver CareyDescriptionolivercareyncl/openwebtext.json dataset hosted on Hugging Face and contributed by the HF Datasets community
- h
openwebtext
- huggingface.co
Updated Feb 1, 2017+ more versionsShareFacebookTwitterEmailClick to copy linkLink copiedCiteOliver Carey (2017). openwebtext [Dataset]. https://huggingface.co/datasets/olivercareyncl/openwebtextCroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.Dataset updatedFeb 1, 2017AuthorsOliver CareyDescriptionolivercareyncl/openwebtext dataset hosted on Hugging Face and contributed by the HF Datasets community
- h
openwebtext-gemma-1024-abbrv-2B
- huggingface.co
Updated Feb 20, 2025+ more versionsShareFacebookTwitterEmailClick to copy linkLink copiedCiteDavid Chanin (2025). openwebtext-gemma-1024-abbrv-2B [Dataset]. https://huggingface.co/datasets/chanind/openwebtext-gemma-1024-abbrv-2BCroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.Dataset updatedFeb 20, 2025AuthorsDavid ChaninDescriptionchanind/openwebtext-gemma-1024-abbrv-2B dataset hosted on Hugging Face and contributed by the HF Datasets community
- h
Skylion007-openwebtext-tokenizer-gpt2
- huggingface.co
Updated Mar 11, 2025+ more versionsShareFacebookTwitterEmailClick to copy linkLink copiedCiteXiangchen Song (2025). Skylion007-openwebtext-tokenizer-gpt2 [Dataset]. https://huggingface.co/datasets/xiangchensong/Skylion007-openwebtext-tokenizer-gpt2Dataset updatedMar 11, 2025AuthorsXiangchen SongDescriptionxiangchensong/Skylion007-openwebtext-tokenizer-gpt2 dataset hosted on Hugging Face and contributed by the HF Datasets community
- h
Skylion007-openwebtext-tokenizer-gpt2-64
- huggingface.co
Updated Jul 14, 2024ShareFacebookTwitterEmailClick to copy linkLink copiedCitePerception, Control, and Cognition Lab (2024). Skylion007-openwebtext-tokenizer-gpt2-64 [Dataset]. https://huggingface.co/datasets/pccl-org/Skylion007-openwebtext-tokenizer-gpt2-64CroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.Dataset updatedJul 14, 2024Dataset authored and provided byPerception, Control, and Cognition LabDescriptionpccl-org/Skylion007-openwebtext-tokenizer-gpt2-64 dataset hosted on Hugging Face and contributed by the HF Datasets community
openwebtext_val_vocab
- kaggle.com
zipUpdated Feb 15, 2024ShareFacebookTwitterEmailClick to copy linkLink copiedCitetuggypetu (2024). openwebtext_val_vocab [Dataset]. https://www.kaggle.com/tuggypetu/openwebtext-val-vocabzip(1618447286 bytes)Available download formatsDataset updatedFeb 15, 2024AuthorstuggypetuDescriptionDataset
This dataset was created by tuggypetu
Contents
- O
pile-10k
- opendatalab.com
zipUpdated Dec 16, 2023+ more versionsShareFacebookTwitterEmailClick to copy linkLink copiedCite(2023). pile-10k [Dataset]. https://opendatalab.com/OpenDataLab/pile-10kzipAvailable download formatsDataset updatedDec 16, 2023DescriptionThe first 10K elements of The Pile, useful for debugging models trained on it. See the HuggingFace page for the full Pile for more info. Inspired by stas' great resource doing the same for OpenWebText
Not seeing a result you expected?
Learn how you can add new datasets to our index.
FacebookTwitterEmailopenwebtext
OpenWebText
Skylion007/openwebtext
https://choosealicense.com/licenses/cc0-1.0/https://choosealicense.com/licenses/cc0-1.0/
An open-source replication of the WebText dataset from OpenAI.