This is a new collection of translated movie subtitles from http://www.opensubtitles.org/.

IMPORTANT: If you use the OpenSubtitle corpus: Please, add a link to http://www.opensubtitles.org/ to your website and to your reports and publications produced with the data!

This is a slightly cleaner version of the subtitle collection using improved sentence alignment and better language checking.

62 languages, 1,782 bitexts total number of files: 3,735,070 total number of tokens: 22.10G total number of sentence fragments: 3.35G

A multilingual corpus of movie subtitles aligned on the sentence-level. Contains data on more than 50 languages with a focus on the Indo-European language family. Morphosyntactic annotation (part-of-speech, features, dependencies) in Universal Dependency-style is available for 47 languages.

The dataset is used to test the proposed methodologies for mining parallel data from comparable corpora.

The real-time subtitles market is experiencing robust growth, driven by the increasing demand for accessible content across diverse platforms and languages. The market's expansion is fueled by several key factors: the rising adoption of streaming services and online video platforms, growing accessibility regulations mandating subtitles for various media, and the proliferation of multilingual content consumption. Technological advancements, such as improved speech-to-text accuracy and AI-powered subtitle generation, are further accelerating market growth. The market is segmented by technology (e.g., cloud-based, on-premise), application (e.g., live streaming, video conferencing, education), and end-user (e.g., media & entertainment, corporate, education). Competitive landscape analysis reveals a mix of established players and emerging technology companies, vying for market share through innovation in accuracy, speed, and integration with existing workflows. The forecast period (2025-2033) anticipates continued expansion, with a projected compound annual growth rate (CAGR) reflecting the increasing penetration of real-time subtitling across diverse industries and regions. Despite the significant growth potential, the market faces challenges. High initial investment costs for advanced technologies, the need for highly skilled professionals for accurate transcription and quality control, and variations in language complexities and accents can all constrain market penetration. However, these challenges are being addressed through continuous innovation, including the development of more affordable and user-friendly solutions, improvements in automated transcription technology, and increased accessibility of training programs. Overcoming these hurdles will be crucial for ensuring the continued and sustainable growth of the real-time subtitles market throughout the forecast period. The market is expected to reach a substantial value by 2033, driven by consistent technological advancements, regulatory support, and rising demand.

techiaith/YouTube-Subtitles dataset hosted on Hugging Face and contributed by the HF Datasets community

Exploring language usage through frequency analysis in large corpora is a defining feature in most recent work in corpus and computational linguistics. From a psycholinguistic perspective, however, the corpora used in these contributions are often not representative of language usage: they are either domain-specific, limited in size, or extracted from unreliable sources. In an effort to address this limitation, we introduce SubIMDB, a corpus of everyday language spoken text we created which contains over 225 million words. The corpus was extracted from 38,102 subtitles of family, comedy and children movies and series, and is the first sizeable structured corpus of subtitles made available. Our experiments show that word frequency norms extracted from this corpus are more effective than those from well-known norms such as Kucera-Francis, HAL and SUBTLEXus in predicting various psycholinguistic properties of words, such as lexical decision times, familiarity, age of acquisition and simplicity. We also provide evidence that contradict the long-standing assumption that the ideal size for a corpus can be determined solely based on how well its word frequencies correlate with lexical decision times.

Word Frequency based on American English subtitles (SUBTLEX)

Word frequency is an important variable in cognitive processing. High-frequency words are perceived and produced faster and more efficiently than low-frequency words. At the same time, they are easier to recall but more difficult to recognize in episodic memory tasks.

Brysbaert & New compiled a new frequency measure on the basis of American subtitles (51 million words in total). There are two measures:

• The frequency per million words, called SUBTLEX (Subtitle frequency: word form frequency)
• The percentage of films in which a word occurs, called SUBTLEX (Subtitle frequency: contextual diversity; see Adelman, Brown, & Quesada (2006) for the qualities of this measure).

Columns

1. Word. This starts with a capital when the word more often starts with an uppercase letter than with a lowercase letter.
2. FREQcount. This is the number of times the word appears in the corpus (i.e., on the total of 51 million words).
3. CDcount. This is the number of films in which the word appears (i.e., it has a maximum value of 8,388).
4. FREQlow. This is the number of times the word appears in the corpus starting with a lowercase letter. This allows users to further match their stimuli.
5. CDlow. This is the number of films in which the word appears starting with a lowercase letter.
6. SUBTLWF. This is the word frequency per million words. It is the measure you would preferably use in your manuscripts, because it is a standard measure of word frequency independent of the corpus size. It is given with two digits precision, in order not to lose precision of the frequency counts.
7. Lg10WF. This value is based on log10(FREQcount+1) and has four digit precision.
8. SUBTLCD. This indicates in how many percent of the films the word appears. This value has two-digit precision in order not to lose information.
9. Lg10CD. This value is based on log10(CDcount+1) and has four digit precision. It is the best value to use if you want to match words on word frequency.
10. Dom_PoS_SUBTLEX. The dominant (most frequent) Part of Speech of each entry
11. Freq_dom_PoS_SUBTLEX. The frequency of the dominant Part of Speech
12. Percentage_dom_PoS. The relative frequency of the dominant Part of Speech
13. All_PoS_SUBTLEX. All Parts of Speech observed for the entry
14. All_freqs_SUBTLEX. The frequencies of each Part of Speech

Sorted Dataset

• Only includes words with a FREQcount greater than 1.
• Is sorted based on the CDcount then alphabetically.

Source

This data set is taken from the Ghent University "SUBTLEXUS American Word Frequency" list compiled by Brysbaert & New. SUBTLEXUS website Brysbaert & New full analysis paper

According to a survey of who watch foreign content, as of November 2021, subtitling video content was preferred over dubbing in the United States and the United Kingdom, with ** percent and ** percent of respondents reporting preferring the first method, respectively. By comparison, ** percent of video viewers in Italy reported preferring dubbing, while in Germany, this number rose to ********* respondents.

Context

There's a story behind every dataset and here's your opportunity to share yours.

Content

What's inside is more than just rows and columns. Make it easy for others to get started by describing how you acquired the data and what time period it represents, too.

Acknowledgements

We wouldn't be here without the help of others. If you owe any attributions or thanks, include them here along with any citations of past research.

Inspiration

Your data will be in front of the world's largest data science community. What questions do you want to see answered?

Enhancement of comprehension and more profound understanding of accents were the most common reasons why American adults use subtitles while watching TV in a known language, according to a survey conducted between June and July 2023. Another ** percent of the respondents stated that they did so because they were in a noisy environment.

The global video subtitle translation services market is experiencing robust growth, driven by the proliferation of video content across various platforms and the increasing demand for accessibility and global reach. The market's expansion is fueled by several key factors. Firstly, the rise of streaming services and online video platforms necessitates multilingual subtitles to cater to a diverse global audience. Secondly, the growing emphasis on accessibility for individuals with hearing impairments is driving demand for accurate and high-quality subtitles. Thirdly, advancements in artificial intelligence (AI) and machine learning (ML) technologies are enhancing the speed and efficiency of translation processes, making the service more cost-effective. Finally, globalization and increased cross-border communication are further propelling market growth. We estimate the market size in 2025 to be approximately $2.5 billion, with a Compound Annual Growth Rate (CAGR) of 15% from 2025 to 2033, leading to a projected market value of around $7.8 billion by 2033. This growth trajectory is anticipated despite certain restraints, such as the need for human oversight to ensure accuracy and cultural nuances in translations, and the challenges associated with handling diverse dialects and languages. Market segmentation plays a crucial role in understanding the landscape. While specific segment breakdowns aren't provided, we can infer significant segments based on industry trends. These likely include language pairs (e.g., English to Spanish, English to Mandarin), video type (e.g., corporate videos, films, educational content), and service type (e.g., human translation, machine translation with post-editing). The competitive landscape is characterized by a mix of established players like Stepes, Ai-Media, and 3Play Media, and smaller, specialized companies catering to niche markets. The ongoing technological advancements and increasing market demand indicate that the video subtitle translation services market is poised for sustained, considerable growth in the coming years, creating opportunities for both established and emerging players.

Survivor Subtitles Dataset (cleaned)

  Dataset Description

A collection of subtitles from the American reality television show "Survivor", spanning seasons 1 through 47. The dataset contains subtitle text extracted from episode broadcasts. This dataset is a modification of the original Survivor Subtitles dataset after cleaning up and joining subtitle fragments. This dataset is a work in progress and any contributions are welcome.

  Source

The subtitles were… See the full description on the dataset page: https://huggingface.co/datasets/hipml/survivor-subtitles-cleaned.

Real Time Subtitles Market Outlook

The global real time subtitles market size was valued at approximately USD 2.5 billion in 2023 and is expected to surge to around USD 6.8 billion by 2032, growing at a compound annual growth rate (CAGR) of 11.5% during the forecast period. This notable growth can be attributed to several factors, including the rising demand for accessible content, advancements in artificial intelligence (AI) and machine learning (ML) technologies, and the increasing globalization of media and corporate communications.

One of the primary growth factors driving the real time subtitles market is the increasing emphasis on accessibility and inclusiveness in media and communications. Governments and organizations worldwide are instituting regulations and policies requiring content to be accessible to individuals who are deaf or hard of hearing. For instance, the Americans with Disabilities Act (ADA) in the United States mandates that video content be accessible, propelling the adoption of real-time subtitle solutions. This regulatory environment, coupled with growing social awareness, significantly fuels market growth.

Another critical driver is the rapid advancement of AI and ML technologies, which have revolutionized the accuracy and efficiency of real-time subtitle generation. Modern AI-driven subtitle solutions can now offer near-perfect synchronization and error-free transcription, enhancing user experience. These technological advancements are making real-time subtitles more reliable and scalable, thereby increasing their adoption across various sectors such as broadcasting, education, and corporate communications.

The globalization of media content and corporate operations further contributes to the market's expansion. As companies and content creators aim to reach a global audience, the need for multilingual subtitle solutions becomes imperative. Real-time subtitles facilitate effective communication across different languages and cultural contexts, thereby broadening the reach and appeal of content. This globalization trend is particularly evident in the streaming services sector, where platforms are increasingly providing real-time subtitles in multiple languages to cater to diverse audiences.

Film Subtitling plays a crucial role in the globalization of media content, as it allows films to reach audiences across different linguistic and cultural backgrounds. With the rise of streaming platforms and international film festivals, the demand for high-quality film subtitling services has surged. These services not only enhance the accessibility of films for non-native speakers but also preserve the original context and cultural nuances of the content. As the film industry continues to expand its global footprint, the importance of accurate and culturally sensitive film subtitling cannot be overstated. This trend is particularly significant for independent filmmakers and studios aiming to distribute their content internationally, as it opens up new markets and increases viewership.

Regionally, North America and Europe are currently the largest markets for real-time subtitles, driven by stringent accessibility regulations and the advanced state of digital infrastructure. However, the Asia Pacific region is expected to witness the highest growth rate during the forecast period, owing to increasing internet penetration, the proliferation of digital content, and rising awareness about accessibility. China and India, with their massive consumer bases and growing digital economies, are poised to be significant contributors to this regional market growth.

Component Analysis

The real time subtitles market by component can be broadly categorized into software, hardware, and services. Each of these segments plays a crucial role in the comprehensive ecosystem of real-time subtitle solutions. The software segment includes various applications and platforms that facilitate subtitle generation and synchronization. This segment is expected to dominate the market due to continuous advancements in AI and ML algorithms that significantly improve the accuracy and efficiency of subtitle generation. Companies are investing heavily in R&D to develop innovative software solutions that cater to diverse linguistic and accessibility needs.

The hardware segment encompasses the physical devices required to support real-time subtitle generation and display. These include specialized subtitle generation hardware,

The dataset represents the processed movie subtitle data adjusted for sentiment analysis, which was implemented using IBM Watson Natural Language Understanding (IBM NLU). The source data contains Slovak and English subtitles from 10 movies, which are matched into pairs. Each of the subtitles is matched with a machine translation generated using Google Translate and identified sentiment score using the OpenAI GPT model. In the next matrix, the results of the sentiment analysis from IBM NLU service for each segment are processed. The third file contains the results of validating the accuracy and error rates of the machine translations from the BLEU and TER metrics.

This dataset contains 871 articles from Wikipedia (retrieved on 8th August 2016), selected from the list of featured articles ({https://en.wikipedia.org/wiki/Wikipedia:Featured_articles}) of the 'Media', 'Literature and Theater', 'Music biographies', 'Media biographies', 'History biographies' and 'Video gaming' categories. From the list of articles, the structure of the document, i.e. sections and subsections of the text, is extracted.

The dataset also contains a proposed clusterization of the event names to increase comparability of Wikipedia articles.

The global subtitling and captioning market is experiencing robust growth, driven by the increasing consumption of streaming media, the rise of multilingual content creation, and the growing demand for accessibility features. The market's expansion is fueled by the proliferation of over-the-top (OTT) platforms, which necessitate multilingual support to reach wider audiences. Furthermore, legislative mandates promoting accessibility for individuals with hearing impairments are significantly contributing to the market's expansion. Technological advancements, such as the development of automated subtitling and captioning tools powered by Artificial Intelligence (AI), are streamlining workflows and reducing production costs, further accelerating market growth. However, challenges remain, including the need for high-quality, culturally appropriate translations and the complexities of adapting subtitles to different screen sizes and video formats. Competition is fierce, with a mix of established players and emerging technology companies vying for market share. The market is segmented by service type (subtitling, captioning, transcription), language, content type (movies, TV shows, documentaries, corporate videos), and region. Based on industry trends and the listed companies, the market is likely to maintain a healthy CAGR (let's assume 12% for illustrative purposes), resulting in substantial growth over the forecast period (2025-2033). Key players are focusing on strategic partnerships, acquisitions, and technological innovation to solidify their position in this dynamic and expanding market. The market shows a positive trend in terms of the rising demand for multilingual content and improved accessibility. The competitive landscape is characterized by a mix of large multinational companies offering comprehensive language services and smaller, specialized firms focusing on niche markets or specific languages. Companies are increasingly leveraging AI and machine learning to improve speed and efficiency while maintaining high-quality outputs. However, human review and editing remain crucial for ensuring accuracy and cultural appropriateness. Geographic distribution varies, with North America and Europe currently holding significant market shares due to established media industries and a large consumer base. However, the Asia-Pacific region is expected to experience faster growth due to increasing internet penetration and the burgeoning streaming market. Successful companies in this market will be those that can effectively balance technological advancements with human expertise to deliver high-quality, culturally sensitive, and accessible content to a global audience.

The AI video subtitle translator market is experiencing significant growth, driven by the increasing demand for accessible and multilingual video content. The market's expansion is fueled by several key factors: the proliferation of video content across various platforms, a growing global audience with diverse linguistic needs, and advancements in AI-powered translation technology leading to improved accuracy and efficiency. While precise market sizing data isn't provided, considering the rapid adoption of AI solutions and the substantial size of the global video market, a reasonable estimate for the 2025 market size could be in the range of $500 million, projecting a Compound Annual Growth Rate (CAGR) of 25% over the forecast period (2025-2033). This robust growth is primarily driven by the increasing adoption of AI-powered solutions by content creators, educators, and filmmakers who need to reach broader audiences. The platform-based segment is currently dominant, offering ease of integration and scalability, while software solutions are gaining traction due to their flexibility and customization options. Geographic growth is expected to be widespread, with North America and Europe leading initially due to higher technological adoption and greater demand for multilingual content. However, significant growth is anticipated in the Asia-Pacific region, driven by expanding internet penetration and rising content consumption. Market restraints include concerns around translation accuracy, data privacy, and the cost of implementation, although technological advancements are continuously mitigating these challenges. The future of the AI video subtitle translator market looks bright. Continued advancements in natural language processing (NLP) and machine learning (ML) will further enhance translation accuracy and speed, making the technology more accessible and affordable. The integration of AI subtitle translation tools into video editing software and content management systems will streamline the workflow for content creators. Furthermore, the growing demand for personalized video experiences, including subtitles tailored to individual user preferences, will create new opportunities for market expansion. The competitive landscape is dynamic, with established players and emerging startups vying for market share. Strategic partnerships and mergers and acquisitions are anticipated as companies seek to strengthen their market positions and expand their technological capabilities. Ultimately, the market's growth trajectory is projected to remain upward, driven by the ongoing convergence of AI, video, and multilingual communication needs.

Context

Subtitles of all 3 parts of Iron Man.

Inspiration

Wanted to create a wordcloud with ironman data.

The video subtitle images were collected from 24 videos shared on Facebook and Youtube. The subtitle text included Thai and English languages, including Thai characters, Roman characters, Thai numerals, Arabic numerals, and special characters with 157 characters in total.

In the data-preprocessing step, we converted all 24 videos to images and obtained 2,700 images with subtitle text. The size of the subtitle text image was 1280x720 pixels and it was stored in JPG format. Further, we generated the ground truth from 4,224 subtitle images using the labelImg program. Also, the labels were then assigned to each subtitle image. Note that the number before the label is the order of the subtitle text image.

The global subtitles editor market is experiencing robust growth, driven by the increasing consumption of video content across various languages and platforms. The market's expansion is fueled by several key factors. The rise of streaming services and online video platforms necessitates accurate and efficient subtitling for broader audience reach. Furthermore, the increasing demand for accessible media for individuals with hearing impairments is a significant driver. Educational institutions and businesses increasingly utilize subtitles for training materials and online courses, further boosting market demand. Technological advancements, such as the development of AI-powered automated subtitling tools, are streamlining the subtitling process, leading to increased efficiency and reduced costs. However, challenges remain, including the need for skilled human editors to ensure accuracy and quality, as well as the linguistic nuances that automated tools may overlook. Market segmentation reveals strong demand from media workers, subtitle translators, and educators, with software solutions currently dominating the market share. The market is geographically diverse, with North America and Europe representing significant portions of the market, but strong growth potential exists in Asia-Pacific and other emerging regions as internet penetration and video consumption continue to rise. We estimate a current market size of approximately $300 million in 2025, with a projected CAGR of 15% from 2025 to 2033. This growth trajectory suggests a sizeable market opportunity for established players and new entrants alike. The competitive landscape is fragmented, with a mix of established software providers and newer AI-powered solutions vying for market share. Companies are focusing on developing user-friendly interfaces, advanced features like real-time subtitling and multilingual support, and efficient integration with video editing platforms. The ongoing innovation in AI-powered transcription and translation technologies is expected to further transform the market, potentially leading to greater efficiency and affordability. However, maintaining accuracy and addressing the ethical considerations of AI implementation will remain critical for sustained growth and market acceptance. The focus on providing highly accurate and culturally sensitive translations will also be vital in penetrating new markets globally, particularly in regions with diverse languages and dialects. Future growth hinges on delivering value-added services, such as quality control, streamlined workflows, and collaborative platforms, in response to the ever-evolving needs of video content creators and consumers.