Post-OCR correction is a large corpus of 1 billion words containing original texts with a varying number of OCR mistakes and an experimental multilingual post-OCR correction output created by Pleias. Generation of Post-OCR correction was performed using HPC resources from GENCI–IDRIS (Grant 2023-AD011014736) on Jean-Zay.

  Description

All the texts come from collections integrated into Common Corpus, the largest open corpus for pretraining previously released by Pleias on HuggingFace.… See the full description on the dataset page: https://huggingface.co/datasets/PleIAs/Post-OCR-Correction.

emanuelaboros/Pleias-French-Post-OCR-Correction-Instructions dataset hosted on Hugging Face and contributed by the HF Datasets community

emanuelaboros/Pleias-French-Post-OCR-Correction-Corrected-Instructions-4000 dataset hosted on Hugging Face and contributed by the HF Datasets community

🇲🇪 Latin Public Domain Books (Latin) 🇲🇪

Latin-Public Domain or Latin-PD is a large collection aiming to aggregate all Latin monographies and periodicals in the public domain. As of June 2024, it is the largest Latin open corpus.

  Dataset summary

The collection contains 16,521,454,086 words (159,070 titles) recovered from multiple sources, including the Internet Archive and various European national libraries and cultural heritage institutions (BDH, BNF). Each parquet… See the full description on the dataset page: https://huggingface.co/datasets/PleIAs/Latin-PD.

🇩🇰 Danish Public Domain 🇩🇰

Danish-Public Domain or Danish-PD is a large collection aiming to aggregate all Danish monographies and periodicals in the public domain. As of March 2024, it is the biggest Danish open corpus.

  Dataset summary

The collection contains 3113 individual titles making up 322,141,347 words recovered from multiple sources, including Internet Archive and various European national libraries and cultural heritage institutions. Each parquet file has… See the full description on the dataset page: https://huggingface.co/datasets/PleIAs/Danish-PD.

🇨🇿 Czech Public Domain 🇨🇿

Czech-Public Domain or Czech-PD is a large collection aiming to aggregate all Czech monographies and periodicals in the public domain. As of March 2024, it is the biggest Czech open corpus.

  Dataset summary

The collection contains 1585 individual titles making up 259,435,959 words recovered from multiple sources, including Internet Archive and various European national libraries and cultural heritage institutions. Each parquet file has the… See the full description on the dataset page: https://huggingface.co/datasets/PleIAs/Czech-PD.

🇵🇹 Portuguese Public Domain 🇵🇹

Portuguese-Public Domain or Portuguese-PD is a large collection aiming to aggregate all Portuguese monographies and periodicals in the public domain. As of March 2024, it is the biggest Portuguese open corpus.

  Dataset summary

The collection contains 7,840 individual titles making up 672,197,538 words recovered from multiple sources, including Internet Archive and various European national libraries and cultural heritage institutions.… See the full description on the dataset page: https://huggingface.co/datasets/PleIAs/Portuguese-PD.