As of February 2025, English was the most popular language for web content, with over 49.4 percent of websites using it. Spanish ranked second, with six percent of web content, while the content in the German language followed, with 5.6 percent. English as the leading online language United States and India, the countries with the most internet users after China, are also the world's biggest English-speaking markets. The internet user base in both countries combined, as of January 2023, was over a billion individuals. This has led to most of the online information being created in English. Consequently, even those who are not native speakers may use it for convenience. Global internet usage by regions As of October 2024, the number of internet users worldwide was 5.52 billion. In the same period, Northern Europe and North America were leading in terms of internet penetration rates worldwide, with around 97 percent of its populations accessing the internet.

The statistic shows distribution of programming languages used by Internet of Things developers, according to a survey conducted in 2016. At that time, 31.5 percent of respondents indicated that they were using Node.js when developing Internet of Things solutions.

Canadian Internet use survey, Internet use, by language used to search for information, for Canada in 2005. (Terminated)

According to a 2023 survey, ** percent of internet users in urban India preferred using the internet in English. Meanwhile, ** percent of users accessed the internet in Indian languages, with Hindi being the most preferred language among them. Over *** million internet users reside in the urban areas of India.

As of 2024, JavaScript and HTML/CSS were the most commonly used programming languages among software developers around the world, with more than 62 percent of respondents stating that they used JavaScript and just around 53 percent using HTML/CSS. Python, SQL, and TypeScript rounded out the top five most widely used programming languages around the world. Programming languages At a very basic level, programming languages serve as sets of instructions that direct computers on how to behave and carry out tasks. Thanks to the increased prevalence of, and reliance on, computers and electronic devices in today’s society, these languages play a crucial role in the everyday lives of people around the world. An increasing number of people are interested in furthering their understanding of these tools through courses and bootcamps, while current developers are constantly seeking new languages and resources to learn to add to their skills. Furthermore, programming knowledge is becoming an important skill to possess within various industries throughout the business world. Job seekers with skills in Python, R, and SQL will find their knowledge to be among the most highly desirable data science skills and likely assist in their search for employment.

Reliable and updated indicators of the presence of languages in the Internet are required to drive efficiently policies for languages, to forecast e-commerce market or to support further researches on the field of digital support of languages. This article presents a complete description of the methodological elements involved in the production of an unprecedented set of indicators of the presence in the Internet of the 329 languages with more than 1 million L1 speakers. A special emphasis is given to the treatment of the comprehensive set of biases involved in the process, either from the method or the various sources used in the modeling process. The biases related to other sources providing similar data are also discussed, and in particular, it is shown how the lack of consideration of the high level of multilingualism of the Web leads to a huge overestimation of the presence of English. The detailed list of sources is presented in the various annexes. For the first time in the history of the Internet, the production of indicators about virtual presence of a large set of languages could allow progress in the fields of economy of languages, cyber-geography of languages and language policies for multilingualism.

This statistic shows the results of a survey conducted in the Middle East and North Africa region in 2015 on the percentage of people who use the English language to access different types of media. According to the survey, ** percent of respondents in Egypt used English to access the internet, as opposed to ***** percent who used English to access TV.

The statistical operation Survey on the Information Society-ESI-Families, provides regular information on the implementation of New Information and Communication Technology -ICT- among the population of the Basque Country. Specifically, it records and describes ICT equipment of the population both in the home and the place of study or in the workplace and measures the level of use made of it, especially as related to the Internet. It lets us compare the level of implementation of these ICT technologies In Basque society in relation to other surrounding communities.

In 2025, there were around 1.53 billion people worldwide who spoke English either natively or as a second language, slightly more than the 1.18 billion Mandarin Chinese speakers at the time of survey. Hindi and Spanish accounted for the third and fourth most widespread languages that year. Languages in the United States The United States does not have an official language, but the country uses English, specifically American English, for legislation, regulation, and other official pronouncements. The United States is a land of immigration, and the languages spoken in the United States vary as a result of the multicultural population. The second most common language spoken in the United States is Spanish or Spanish Creole, which over than 43 million people spoke at home in 2023. There were also 3.5 million Chinese speakers (including both Mandarin and Cantonese),1.8 million Tagalog speakers, and 1.57 million Vietnamese speakers counted in the United States that year. Different languages at home The percentage of people in the United States speaking a language other than English at home varies from state to state. The state with the highest percentage of population speaking a language other than English is California. About 45 percent of its population was speaking a language other than English at home in 2023.

Context:

How frequently a word occurs in a language is an important piece of information for natural language processing and linguists. In natural language processing, very frequent words tend to be less informative than less frequent one and are often removed during preprocessing. Human language users are also sensitive to word frequency. How often a word is used affects language processing in humans. For example, very frequent words are read and understood more quickly and can be understood more easily in background noise.

Content:

This dataset contains the counts of the 333,333 most commonly-used single words on the English language web, as derived from the Google Web Trillion Word Corpus.

Acknowledgements:

Data files were derived from the Google Web Trillion Word Corpus (as described by Thorsten Brants and Alex Franz, and distributed by the Linguistic Data Consortium) by Peter Norvig. You can find more information on these files and the code used to generate them here.

The code used to generate this dataset is distributed under the MIT License.

Inspiration:

• Can you tag the part of speech of these words? Which parts of speech are most frequent? Is this similar to other languages, like Japanese?
• What differences are there between the very frequent words in this dataset, and the the frequent words in other corpora, such as the Brown Corpus or the TIMIT corpus? What might these differences tell us about how language is used?

Canadian Internet use survey, Internet use, by language used to search for information, for Canada in 2005. (Terminated)

This Flash Eurobarometer studied how Europeans use different languages online. While 90% of European internet users prefer to surf the internet in their own language, 55% at least occasionally use a language other than their own when online according to a pan-EU Eurobarometer survey released today. However, 44% feel they are missing interesting information because web pages are not in a language that they understand.

The results by volumes are distributed as follows:

• Volume A: Countries
• Volume AA: Groups of countries
• Volume A' (AP): Trends
• Volume AA' (AAP): Trends of groups of countries
• Volume B: EU/socio-demographics
• Volume B' (BP) : Trends of EU/ socio-demographics
• Volume C: Country/socio-demographics ---- Researchers may also contact GESIS - Leibniz Institute for the Social Sciences: https://www.gesis.org/eurobarometer

This Dataset, in 29 files of xlsx format, contains the data of all metrics and accumulated information as they are described in the methodology, results and discussion section of the research article "Exploring the Dominance of the English Language on the Websites of EU Countries".

This study explores the integration of corpus linguistic and sociolinguistic approaches for the analysis of a unique 4-million word longitudinal corpus of messages posted to the 'Teenage Health Freak' website. The website, run by UK-based GPs, is designed to be interactive, confidential and evidence-based providing adolescents with accessible advice and information pertaining to a broad range of health issues. The descriptive advantages afforded by the tools of corpus linguistics will be used to inform sociolinguistic observations of adolescent language innovation and change on the specific topic of health care. Key words and key phrases used by adolescent advice-seekers, with associated meanings and patterns of use over a period of ten years, will be extracted from the corpus and then analysed to highlight emergent trends in adolescent sociolinguistic style and register. As well as the academic value of this combined methodological approach, the findings of the analysis will be made available to health care providers and users of health care services in the form of a practical, encyclopaedic resource, thus contributing to the continuous professional development of user groups in the NHS, as well as being a resource for parents, teachers and adolescents themselves.

The statistical operation Survey on the Information Society-ESI- Companies, provides regular information on the implementation of New Information and Communication Technology -ICT- in the companies of the Basque Country. Specifically, it records and describes the level of use of the Internet in the different establishments: the systems of Internet access, activities carried out via the Internet, as well as the availability of the website and its main characteristics. It also measures the implementation of E-commerce purchases and sales in economic activity and the means used to carry it out.

The survey charted citizen views on written and spoken Finnish. Themes studied included, for instance, language change, the relationship between written and spoken language, loanwords from English, and language practices in the public sphere. Opinions on the use of Finnish and its change were charted. The respondents were asked how important they regarded the well-being of the Finnish language, whether they thought everyday language written by people was careless, whether the language used in factual texts (e.g. reports, news) had become too colloquial, and whether they thought that one can use the kind of language one wants to on the Internet (for example, on Facebook). Reasons for being or not being worried of language change were examined (e.g. "English grammar affects Finnish in a negative manner", "Language change does not mean a deterioration of language"). A number of statements relating to spoken language and language used when greeting and addressing people were presented to respondents who were asked to indicate the extent to which they agreed with them (e.g. "Guests of current affairs programmes on TV and radio may use colloquial language", "I find it irritating that telemarketers often address their customers by first name"). Opinions on the use and acceptability of English loanwords in Finnish were surveyed (e.g. "They bother me because I don't always understand what they mean", "They facilitate communication between people who speak different languages"). The respondents were also asked whether some words or phrases annoyed them. Regarding written language, opinions were charted on the fact that there are multiple acceptable/'correct' forms in written Finnish as well as who or which institution should be responsible for ensuring that factual texts are written according to language guidelines. Finally, the respondents were asked which issues relating to grammar, structure, and style they occasionally had to consider when writing factual texts. Background variables included the respondent's age group, gender, education, region (NUTS 3) of residence, mother tongue, languages spoken, and writing and reading habits.

Preprint

Abstract

The World Wide Web is a complex interconnected digital ecosystem, where information and attention flow between platforms and communities throughout the globe. These interactions co-construct how we understand the world, reflecting and shaping public discourse. Unfortunately, researchers often struggle to understand how information circulates and evolves across the web because platform-specific data is often siloed and restricted by linguistic barriers. To address this gap, we present a comprehensive, multilingual dataset capturing all Wikipedia links shared in posts and comments on Reddit from 2020 to 2023, excluding those from private and NSFW subreddits. Each linked Wikipedia article is enriched with revision history, page view data, article ID, redirects, and Wikidata identifiers. Through a research agreement with Reddit, our dataset ensures user privacy while providing a query and ID mechanism that integrates with the Reddit and Wikipedia APIs. This enables extended analyses for researchers studying how information flows across platforms. For example, Reddit discussions use Wikipedia for deliberation and fact-checking which subsequently influences Wikipedia content, by driving traffic to articles or inspiring edits. By analyzing the relationship between information shared and discussed on these platforms, our dataset provides a foundation for examining the interplay between social media discourse and collaborative knowledge consumption and production.

Datasheet

Motivation

The motivations for this dataset stem from the challenges researchers face in studying the flow of information across the web. While the World Wide Web enables global communication and collaboration, data silos, linguistic barriers, and platform-specific restrictions hinder our ability to understand how information circulates, evolves, and impacts public discourse. Wikipedia and Reddit, as major hubs of knowledge sharing and discussion, offer an invaluable lens into these processes. However, without comprehensive data capturing their interactions, researchers are unable to fully examine how platforms co-construct knowledge. This dataset bridges this gap, providing the tools needed to study the interconnectedness of social media and collaborative knowledge systems.

Composition

WikiReddit, a comprehensive dataset capturing all Wikipedia mentions (including links) shared in posts and comments on Reddit from 2020 to 2023, excluding those from private and NSFW (not safe for work) subreddits. The SQL database comprises 336K total posts, 10.2M comments, 1.95M unique links, and 1.26M unique articles spanning 59 languages on Reddit and 276 Wikipedia language subdomains. Each linked Wikipedia article is enriched with its revision history and page view data within a ±10-day window of its posting, as well as article ID, redirects, and Wikidata identifiers. Supplementary anonymous metadata from Reddit posts and comments further contextualizes the links, offering a robust resource for analysing cross-platform information flows, collective attention dynamics, and the role of Wikipedia in online discourse.

Collection Process

Data was collected from the Reddit4Researchers and Wikipedia APIs. No personally identifiable information is published in the dataset. Data from Reddit to Wikipedia is linked via the hyperlink and article titles appearing in Reddit posts.

Preprocessing/cleaning/labeling

Extensive processing with tools such as regex was applied to the Reddit post/comment text to extract the Wikipedia URLs. Redirects for Wikipedia URLs and article titles were found through the API and mapped to the collected data. Reddit IDs are hashed with SHA-256 for post/comment/user/subreddit anonymity.

Uses

We foresee several applications of this dataset and preview four here. First, Reddit linking data can be used to understand how attention is driven from one platform to another. Second, Reddit linking data can shed light on how Wikipedia's archive of knowledge is used in the larger social web. Third, our dataset could provide insights into how external attention is topically distributed across Wikipedia. Our dataset can help extend that analysis into the disparities in what types of external communities Wikipedia is used in, and how it is used. Fourth, relatedly, a topic analysis of our dataset could reveal how Wikipedia usage on Reddit contributes to societal benefits and harms. Our dataset could help examine if homogeneity within the Reddit and Wikipedia audiences shapes topic patterns and assess whether these relationships mitigate or amplify problematic engagement online.

Distribution

The dataset is publicly shared with a Creative Commons Attribution 4.0 International license. The article describing this dataset should be cited: https://doi.org/10.48550/arXiv.2502.04942

Maintenance

Patrick Gildersleve will maintain this dataset, and add further years of content as and when available.

SQL Database Schema

Table: posts

Table: comments

Table: postlinks

Table: commentlinks

Dataset

This dataset was created by ma7555

Released under GPL 2

Contents

This dataset tracks annual reading and language arts proficiency from 2010 to 2022 for Internet Academy vs. Washington and Federal Way School District

Digital Language Learning Market Outlook

The global digital language learning market size was valued at approximately USD 12 billion in 2023 and is expected to reach around USD 25 billion by 2032, growing at a CAGR of 8.5% during the forecast period. The growth of this market is driven by factors such as increasing globalization, the rise of online education, and technological advancements that make language learning more accessible and engaging.

One of the primary growth factors of the digital language learning market is the increasing prevalence of globalization and the demand for multilingual communication skills. In an interconnected world, the ability to communicate in multiple languages has become a critical skill for both personal and professional development. Businesses are expanding their operations across borders, which necessitates employees to be proficient in multiple languages. Consequently, both individuals and organizations are investing heavily in digital language learning solutions to bridge language barriers and enhance communication efficiency.

Technological advancements have also played a significant role in propelling the growth of the digital language learning market. The advent of artificial intelligence, machine learning, and natural language processing has revolutionized the way languages are taught and learned. These technologies enable personalized learning experiences, adaptive learning paths, and real-time feedback, which significantly enhance the effectiveness of language acquisition. Moreover, the proliferation of smartphones and high-speed internet has made digital language learning solutions more accessible to a broader audience, further fueling market growth.

The rise of online education and e-learning platforms has provided a significant boost to the digital language learning market. With the growing acceptance of online education as a viable alternative to traditional classroom-based learning, more individuals are turning to digital platforms for their language learning needs. These platforms offer flexibility, convenience, and a wide range of resources that cater to different learning styles and preferences. Additionally, the COVID-19 pandemic has accelerated the adoption of online education, as lockdowns and social distancing measures have forced educational institutions and learners to transition to digital modes of learning.

The emergence of Online Language Training has further revolutionized the digital language learning landscape. With the flexibility and accessibility that online platforms provide, learners can access a plethora of resources tailored to their individual needs and learning styles. These platforms often incorporate multimedia elements, such as videos, interactive quizzes, and virtual classrooms, to create an engaging and immersive learning environment. The ability to learn at one's own pace and schedule has made online language training particularly appealing to busy professionals and students alike, who can now integrate language learning seamlessly into their daily routines. Additionally, the global reach of online platforms allows learners to connect with native speakers and cultural experts, enhancing their language proficiency and cultural understanding.

Regionally, the Asia Pacific region is expected to witness substantial growth in the digital language learning market. This can be attributed to the increasing focus on English language learning in countries like China, Japan, and India, where English proficiency is seen as a key driver of academic and professional success. Additionally, government initiatives to promote digital education and the presence of a large population of young learners are further contributing to the market growth in this region. North America and Europe are also significant markets, driven by the high adoption of technology in education and the presence of a large number of immigrants seeking language learning solutions.

Product Type Analysis

The digital language learning market is segmented by product type into on-premises and cloud-based solutions. On-premises solutions involve the installation of software on local servers or personal computers, offering greater control over data and customization options. These solutions are often preferred by large organizations and academic institutions that require extensive language learning programs and have the necessary IT infrastructure to support them. However, the high initial costs and maintenance req