- h
pile-uncopyrighted
- huggingface.co
Updated Aug 27, 2024
Share
Facebook
Twitter
EmailClick to copy linkLink copiedCiteRichard Erkhov (2024). pile-uncopyrighted [Dataset]. https://huggingface.co/datasets/RichardErkhov/pile-uncopyrightedCroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.Dataset updatedAug 27, 2024AuthorsRichard ErkhovLicensehttps://choosealicense.com/licenses/other/https://choosealicense.com/licenses/other/
DescriptionPile Uncopyrighted
In response to authors demanding that LLMs stop using their works, here's a copy of The Pile with all copyrighted content removed.Please consider using this dataset to train your future LLMs, to respect authors and abide by copyright law.Creating an uncopyrighted version of a larger dataset (ie RedPajama) is planned, with no ETA.
MethodologyCleaning was performed by removing everything from the Books3, BookCorpus2, OpenSubtitles, YTSubtitles, and OWT2… See the full description on the dataset page: https://huggingface.co/datasets/RichardErkhov/pile-uncopyrighted. - h
PubMed
- huggingface.co
Updated Apr 3, 2025ShareFacebookTwitterEmailClick to copy linkLink copiedCiteyanjx (2025). PubMed [Dataset]. https://huggingface.co/datasets/yanjx21/PubMedDataset updatedApr 3, 2025AuthorsyanjxLicensehttps://choosealicense.com/licenses/other/https://choosealicense.com/licenses/other/
DescriptionPile Uncopyrighted
In response to authors demanding that LLMs stop using their works, here's a copy of The Pile with all copyrighted content removed.Please consider using this dataset to train your future LLMs, to respect authors and abide by copyright law.Creating an uncopyrighted version of a larger dataset (ie RedPajama) is planned, with no ETA.
MethodologyCleaning was performed by removing everything from the Books3, BookCorpus2, OpenSubtitles, YTSubtitles, and OWT2… See the full description on the dataset page: https://huggingface.co/datasets/yanjx21/PubMed. - h
pile-uncopyrighted
- huggingface.co
Updated Aug 30, 2023ShareFacebookTwitterEmailClick to copy linkLink copiedCitemonology (2023). pile-uncopyrighted [Dataset]. https://huggingface.co/datasets/monology/pile-uncopyrightedCroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.Dataset updatedAug 30, 2023AuthorsmonologyLicensehttps://choosealicense.com/licenses/other/https://choosealicense.com/licenses/other/
DescriptionPile Uncopyrighted
In response to authors demanding that LLMs stop using their works, here's a copy of The Pile with all copyrighted content removed.Please consider using this dataset to train your future LLMs, to respect authors and abide by copyright law.Creating an uncopyrighted version of a larger dataset (ie RedPajama) is planned, with no ETA.
MethodologyCleaning was performed by removing everything from the Books3, BookCorpus2, OpenSubtitles, YTSubtitles, and OWT2… See the full description on the dataset page: https://huggingface.co/datasets/monology/pile-uncopyrighted. 
Not seeing a result you expected?
Learn how you can add new datasets to our index.
FacebookTwitterEmailpile-uncopyrighted
RichardErkhov/pile-uncopyrighted
https://choosealicense.com/licenses/other/https://choosealicense.com/licenses/other/
Pile Uncopyrighted
In response to authors demanding that LLMs stop using their works, here's a copy of The Pile with all copyrighted content removed.Please consider using this dataset to train your future LLMs, to respect authors and abide by copyright law.Creating an uncopyrighted version of a larger dataset (ie RedPajama) is planned, with no ETA.
MethodologyCleaning was performed by removing everything from the Books3, BookCorpus2, OpenSubtitles, YTSubtitles, and OWT2… See the full description on the dataset page: https://huggingface.co/datasets/RichardErkhov/pile-uncopyrighted.