- h
pile-arxiv-slm-l1sae420
- huggingface.co
Updated Mar 15, 2025+ more versions
Share
Facebook
Twitter
EmailClick to copy linkLink copiedCiteTimaeus (2025). pile-arxiv-slm-l1sae420 [Dataset]. https://huggingface.co/datasets/timaeus/pile-arxiv-slm-l1sae420CroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.Dataset updatedMar 15, 2025Dataset authored and provided byTimaeusDescriptiontimaeus/pile-arxiv-slm-l1sae420 dataset hosted on Hugging Face and contributed by the HF Datasets community
- h
pile-arxiv-elimination-disjoint-slm-l1sae1568
- huggingface.co
Updated Mar 19, 2025+ more versionsShareFacebookTwitterEmailClick to copy linkLink copiedCiteTimaeus (2025). pile-arxiv-elimination-disjoint-slm-l1sae1568 [Dataset]. https://huggingface.co/datasets/timaeus/pile-arxiv-elimination-disjoint-slm-l1sae1568Dataset updatedMar 19, 2025Dataset authored and provided byTimaeusDescriptiontimaeus/pile-arxiv-elimination-disjoint-slm-l1sae1568 dataset hosted on Hugging Face and contributed by the HF Datasets community
- h
scaling_mia_the_pile_00_arxiv
- huggingface.co
Updated Feb 3, 2025+ more versionsShareFacebookTwitterEmailClick to copy linkLink copiedCiteParameter Lab (2025). scaling_mia_the_pile_00_arxiv [Dataset]. https://huggingface.co/datasets/parameterlab/scaling_mia_the_pile_00_arxivCroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.Dataset updatedFeb 3, 2025Dataset authored and provided byParameter LabDescriptionThis dataset includes all arxiv documents from the 00.jsonl.zst partition of The Pile. It was created with this script: pile_path = "data/the_pile/train/00.jsonl.zst"
with zstd.open(pile_path, 'r') as fr: with open("/tmp/arxiv.jsonl", "w") as fw: for i, line in enumerate(tqdm(fr)): doc = json.loads(line) source = doc['meta']['pile_set_name'] if source == "ArXiv": fw.write(json.dumps(doc) + " ")
The validation and test sets are… See the full description on the dataset page: https://huggingface.co/datasets/parameterlab/scaling_mia_the_pile_00_arxiv.
- h
proof-pile
- huggingface.co
Updated Dec 25, 2022+ more versionsShareFacebookTwitterEmailClick to copy linkLink copiedCiteHoskinson Center for Formal Mathematics (2022). proof-pile [Dataset]. https://huggingface.co/datasets/hoskinson-center/proof-pileCroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.Dataset updatedDec 25, 2022Dataset authored and provided byHoskinson Center for Formal MathematicsLicenseApache License, v2.0https://www.apache.org/licenses/LICENSE-2.0
License information was derived automaticallyDescriptionA dataset of high quality mathematical text.
- h
pile-eval
- huggingface.co
ShareFacebookTwitterEmailClick to copy linkLink copiedCiteWilson Wu, pile-eval [Dataset]. https://huggingface.co/datasets/wiwu2390/pile-evalAuthorsWilson WuDescriptionFirst 100 rows of each of timaeus/pile-github, timaeus/pile-wikipedia_en, timaeus/pile-arxiv, timaeus/pile-pile-cc in that order.
- h
gptneo-pubmed-abstracts
- huggingface.co
Updated Jun 22, 2024ShareFacebookTwitterEmailClick to copy linkLink copiedCiterachel lai (2024). gptneo-pubmed-abstracts [Dataset]. https://huggingface.co/datasets/rachel6603/gptneo-pubmed-abstractsCroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.Dataset updatedJun 22, 2024Authorsrachel laiLicenseMIT Licensehttps://opensource.org/licenses/MIT
License information was derived automaticallyDescriptionDataset Card for Dataset Name
This dataset card aims to be a base template for new datasets. It has been generated using this raw template.
Dataset Details Dataset DescriptionThis is a dataset consisting of 10000 PubMed abstracts from The Pile (arXiv:2101.00027), along with completions (both human, and LLM-generated), in order to be used to calculate Heaps Law, in the manner described in the preliminary paper, Heaps' Law in GPT-Neo Large Language… See the full description on the dataset page: https://huggingface.co/datasets/rachel6603/gptneo-pubmed-abstracts.
Not seeing a result you expected?
Learn how you can add new datasets to our index.
FacebookTwitterEmailtimaeus/pile-arxiv-slm-l1sae420 dataset hosted on Hugging Face and contributed by the HF Datasets community