Web Scraper Software Market Valuation – 2024-2031

Web Scraper Software Market was valued at USD 568.2 Million in 2024 and is projected to reach USD 1628.6 Million by 2031, growing at a CAGR of 14.1% from 2024 to 2031.

Global Web Scraper Software Market Drivers

Data-Driven Decision Making: Businesses increasingly rely on data-driven insights to make informed decisions. Web scraping tools enable organizations to collect large amounts of structured and unstructured data from various websites, empowering them to analyze market trends, consumer behavior, and competitor activities.

Price Intelligence: E-commerce businesses utilize web scraping to monitor competitor pricing, identify pricing opportunities, and optimize their own pricing strategies.

Market Research and Analysis: Web scraping tools help researchers and analysts gather data on market trends, consumer sentiment, and industry benchmarks. This data is invaluable for conducting in-depth market research and analysis.

Global Web Scraper Software Market Restraints

Ethical and Legal Considerations: Web scraping can raise ethical and legal concerns, particularly when it violates website terms of service or copyright laws. It's crucial to adhere to ethical guidelines and respect website owners' rights.

Technical Challenges: Web scraping can be technically complex, requiring knowledge of programming languages like Python and libraries such as Beautiful Soup and Scrapy. Additionally, websites often implement anti-scraping measures, making data extraction challenging.

The global web scraper software market, valued at $7241.5 million in 2025, is poised for substantial growth. While the provided CAGR is missing, considering the rapid expansion of e-commerce, big data analytics, and the increasing need for real-time data across various sectors, a conservative estimate would place the Compound Annual Growth Rate (CAGR) between 15% and 20% for the forecast period 2025-2033. This growth is fueled by several key drivers. The rising demand for automated data extraction from websites for market research, price comparison, lead generation, and competitive analysis is significantly boosting market adoption. Furthermore, advancements in AI and machine learning are enhancing the capabilities of web scrapers, enabling more efficient and accurate data retrieval. The diverse application segments, including retail & e-commerce, advertising & media, finance, and real estate, all contribute to the market's expansive potential. While challenges such as website structure changes and legal constraints related to data scraping exist, the overall market outlook remains positive. The increasing sophistication of web scraping tools and the development of robust solutions that address legal and ethical concerns are mitigating these restraints. The market segmentation reveals a diverse landscape. General-purpose web scrapers cater to a broad user base, while focused scrapers target specific data types and websites. Incremental scrapers efficiently update existing datasets, and deep web scrapers access data beyond standard search engines. The application-based segmentation underscores the versatility of the technology, with e-commerce and advertising and media sectors being significant contributors. Leading players like Apify, Import.io, and Octoparse are driving innovation and competition, contributing to a robust and evolving market. Regional analysis suggests significant market presence across North America and Europe, followed by a growing presence in the Asia-Pacific region. The continued development of robust, ethical, and user-friendly web scraping solutions will be key to unlocking the full potential of this rapidly expanding market.

Web Scraping Tools Market Outlook

The global web scraping tools market size was valued at approximately USD 1.2 billion in 2023 and is projected to reach around USD 3.8 billion by 2032, growing at a compound annual growth rate (CAGR) of 14.5% during the forecast period. The growing demand for web scraping tools is primarily driven by the increasing need for data extraction and analysis across various industries. These tools have become essential in gathering competitive intelligence, monitoring prices, conducting market research, and generating leads, which are critical activities for businesses looking to maintain a competitive edge in a data-driven world.

One of the primary growth factors for the web scraping tools market is the exponential increase in data generation on the internet. With the proliferation of e-commerce, social media, and other online platforms, businesses need to collect vast amounts of data to analyze consumer behavior, market trends, and competitor strategies. Web scraping tools enable automated data extraction from various online sources, providing businesses with valuable insights that can inform decision-making and strategic planning. Moreover, advancements in machine learning and artificial intelligence have enhanced the capabilities of these tools, making them more efficient and accurate in extracting relevant data.

Another significant growth driver is the rising adoption of web scraping tools by small and medium enterprises (SMEs). These enterprises often lack the resources to conduct extensive market research or data analysis in-house. Web scraping tools offer a cost-effective solution for SMEs to gather critical business intelligence without substantial investment in manual data collection. Furthermore, the availability of cloud-based web scraping solutions has made these tools more accessible to SMEs, enabling them to leverage scalable and flexible data extraction capabilities without the need for significant infrastructure or technical expertise.

The increasing application of web scraping tools across various industry verticals is also contributing to market growth. Industries such as retail and e-commerce, banking, financial services, and insurance (BFSI), healthcare, media and entertainment, and information technology and telecommunications are leveraging these tools for various purposes. For instance, in the retail sector, web scraping tools are used for price monitoring and competitive analysis, while in the BFSI sector, they assist in fraud detection and risk management. The growing demand for these applications is expected to drive the adoption of web scraping tools across different industries.

Data Extraction Software plays a pivotal role in the web scraping ecosystem, providing the backbone for efficient data collection processes. These software solutions are designed to handle vast amounts of data from diverse online sources, ensuring that businesses can access the information they need for strategic decision-making. With the increasing complexity of data available on the internet, Data Extraction Software has evolved to include advanced features such as machine learning algorithms and artificial intelligence capabilities. These enhancements allow for more precise and accurate data extraction, enabling businesses to gain deeper insights into market trends and consumer behavior. As industries continue to rely on data-driven strategies, the demand for robust Data Extraction Software is expected to grow, further fueling the expansion of the web scraping tools market.

From a regional perspective, North America holds the largest market share for web scraping tools, driven by the high adoption of advanced technologies and a strong presence of key market players. However, the Asia Pacific region is expected to witness the highest growth rate during the forecast period, attributed to the rapid digital transformation and increasing internet penetration in countries like China and India. The growing number of start-ups and SMEs in the region is also contributing to the rising demand for web scraping tools. Europe and Latin America are also experiencing steady growth, driven by the increasing focus on data-driven decision-making and business intelligence.

Type Analysis

The web scraping tools market can be segmented by type into browser extensions, standalone software, cloud-based so

We create tailor-made solutions for every customer, so there are no limits to how we can customize your scraper. You don't have to worry about buying and maintaining complex and expensive software, or hiring developers.

You can get the data on a one-time or recurring (based on your needs) basis.

Get the data in any format and to any destination you need: Excel, CSV, JSON, XML, S3, GCP, or any other.

The global web screen scraping tools market is experiencing robust growth, projected to reach $2831.7 million in 2025 and maintain a Compound Annual Growth Rate (CAGR) of 4.6% from 2025 to 2033. This expansion is driven by the increasing need for businesses to automate data extraction from websites for various applications, including e-commerce price monitoring, market research, investment analysis, and cryptocurrency tracking. The rise of big data analytics and the demand for real-time insights further fuel this market's growth. Different segments within the market cater to specific user needs, including "pay-to-use" and "free-to-use" models, each with its own set of advantages and target audiences. The application-based segmentation highlights the diverse use cases, with e-commerce, investment analysis, and cryptocurrency applications leading the charge. The competitive landscape is dynamic, featuring a mix of established players like Import.io and Scrapinghub alongside emerging solutions. Geographic expansion is also a significant factor, with North America and Europe currently holding the largest market shares, but Asia-Pacific showing significant potential for future growth due to increasing internet penetration and digitalization initiatives. The market's continued growth is supported by ongoing technological advancements in web scraping tools, making them more efficient, user-friendly, and adaptable to evolving website structures. However, challenges remain, including legal and ethical considerations surrounding data scraping, as well as the need for continuous adaptation to counter anti-scraping measures implemented by websites. Furthermore, the increasing complexity of website architecture and the emergence of dynamic content can pose difficulties for scraping tools. To mitigate these challenges, vendors are continually innovating, incorporating features like intelligent handling of dynamic content, proxy rotation for IP management, and robust error handling capabilities. This continuous evolution ensures the long-term viability and growth of the web screen scraping tools market.

Web Scraper Software Market Outlook

The global web scraper software market size was valued at approximately $600 million in 2023 and is projected to reach around $1.8 billion by 2032, growing at a compound annual growth rate (CAGR) of 12.7% during the forecast period. This substantial growth rate is driven by the increasing need for data extraction and analysis across various industries, enhanced by advancements in machine learning and artificial intelligence.

One major growth factor for the web scraper software market is the exponential increase in data generation and the corresponding need for data extraction tools. Organizations across industries are recognizing the immense value of web data in driving strategic decisions, optimizing operational efficiency, and gaining competitive advantage. The ability to extract large volumes of data from diverse web sources in real-time is catalyzing the adoption of web scraper software. Moreover, the integration of AI and machine learning technologies into web scraping tools has significantly enhanced their capabilities, making them more efficient and accurate, thereby driving market growth.

Another significant factor contributing to market growth is the surge in e-commerce and online retail activities. The retail sector, in particular, heavily relies on web scraper software for market research, price comparison, product monitoring, and customer sentiment analysis. The competitive landscape of the online retail market necessitates the continuous monitoring and analysis of a vast amount of data, which can be efficiently managed through web scraping tools. This trend is likely to continue, further bolstering the web scraper software market.

Furthermore, the financial services sector is increasingly leveraging web scraper software for various applications, including risk management, investment analysis, fraud detection, and market sentiment analysis. The need for accurate, timely, and comprehensive data is critical for financial institutions, and web scraper software provides an effective solution for meeting these requirements. The growing adoption of big data analytics in financial services is expected to be a significant driver of the web scraper software market during the forecast period.

The evolution of Python Web Frameworks Software has significantly influenced the development of web scraper software. These frameworks, such as Django and Flask, provide robust and flexible platforms for building web applications, which can be integrated with web scraping tools to enhance their functionality. By leveraging the capabilities of Python web frameworks, developers can create more efficient and scalable web scraping solutions that cater to the growing demand for data extraction. The seamless integration of these frameworks with web scraper software allows for the automation of data collection processes, enabling organizations to gather and analyze vast amounts of web data with ease. This integration is particularly beneficial for industries that require real-time data analysis, such as e-commerce and financial services, where timely insights can drive competitive advantage.

Regionally, North America is expected to hold a dominant share of the web scraper software market, driven by the high adoption of advanced technologies and the presence of key market players. However, the Asia Pacific region is anticipated to exhibit the highest growth rate due to the rapid digital transformation, increasing investments in IT infrastructure, and the growing awareness of data analytics benefits among businesses in the region. Europe is also a significant market, with a strong focus on data protection and compliance driving the adoption of sophisticated web scraping solutions.

Type Analysis

The web scraper software market is segmented by type into cloud-based and on-premises solutions. Cloud-based web scraper software has gained significant traction due to its scalability, flexibility, and cost-effectiveness. These solutions enable organizations to access and manage data from anywhere, providing a significant advantage for businesses with distributed teams or those involved in remote work. Additionally, cloud-based solutions often come with automatic updates and maintenance, reducing the burden on internal IT teams and ensuring that the software remains up-to-date with the latest features and security protocols.

On the other hand, on-premises web scraper software offe

The no-code web scraping tool market is experiencing robust growth, driven by the increasing demand for automated data extraction across diverse sectors. The market's expansion is fueled by several key factors. Firstly, the rise of e-commerce and the need for competitive pricing intelligence necessitates efficient data collection. Secondly, the travel and hospitality industries leverage web scraping for dynamic pricing and competitor analysis. Thirdly, academic research, finance, and human resources departments utilize these tools for large-scale data analysis and trend identification. The ease of use offered by no-code platforms democratizes web scraping, eliminating the need for coding expertise, and significantly accelerating the data acquisition process. This accessibility attracts a wider user base, contributing to market expansion. The market is segmented by application (e-commerce, travel & hospitality, academic research, finance, human resources, and others) and type (text-based, cloud-based, and API-based web scrapers). While the market is competitive, with numerous players offering varying functionalities and pricing models, the continued growth in data-driven decision-making across industries assures continued expansion. Cloud-based solutions are expected to dominate due to scalability and ease of access. Future growth hinges on the development of more sophisticated no-code platforms offering enhanced features such as AI-powered data cleaning and intelligent data analysis capabilities. Geographic regions like North America and Europe currently hold significant market share, but Asia-Pacific is poised for substantial growth due to increasing digital adoption and expanding e-commerce markets. The historical period (2019-2024) likely witnessed a moderate growth rate, setting the stage for the accelerated expansion projected for the forecast period (2025-2033). Assuming a conservative CAGR of 15% for the historical period, resulting in a 2024 market size of approximately $500 million, and applying a slightly higher CAGR of 20% for the forecast period, reflects the increasing adoption and sophistication of these tools. Factors such as stringent data privacy regulations and the increasing sophistication of anti-scraping measures present potential restraints, but innovative solutions are emerging to address these challenges, including ethical data sourcing and advanced proxy management features. The ongoing integration of AI and machine learning capabilities into no-code platforms is also expected to propel market growth, enabling more sophisticated data extraction and analysis with minimal user input.

The global data scraping tools market, valued at $15.57 billion in 2025, is experiencing robust growth. While the provided CAGR is missing, a reasonable estimate, considering the expanding need for data-driven decision-making across various sectors and the increasing sophistication of web scraping techniques, would be between 15-20% annually. This strong growth is driven by the proliferation of e-commerce platforms generating vast amounts of data, the rising adoption of data analytics and business intelligence tools, and the increasing demand for market research and competitive analysis. Businesses leverage these tools to extract valuable insights from websites, enabling efficient price monitoring, lead generation, market trend analysis, and customer sentiment monitoring. The market segmentation shows a significant preference for "Pay to Use" tools reflecting the need for reliable, scalable, and often legally compliant solutions. The application segments highlight the high demand across diverse industries, notably e-commerce, investment analysis, and marketing analysis, driving the overall market expansion. Challenges include ongoing legal complexities related to web scraping, the constant evolution of website structures requiring adaptation of scraping tools, and the need for robust data cleaning and processing capabilities post-scraping. Looking forward, the market is expected to witness continued growth fueled by advancements in artificial intelligence and machine learning, enabling more intelligent and efficient scraping. The integration of data scraping tools with existing business intelligence platforms and the development of user-friendly, no-code/low-code scraping solutions will further boost adoption. The increasing adoption of cloud-based scraping services will also contribute to market growth, offering scalability and accessibility. However, the market will also need to address ongoing concerns about ethical scraping practices, data privacy regulations, and the potential for misuse of scraped data. The anticipated growth trajectory, based on the estimated CAGR, points to a significant expansion in market size over the forecast period (2025-2033), making it an attractive sector for both established players and new entrants.

Web Screen Scraping Tools Market Outlook

The global web screen scraping tools market size is projected to grow from USD 737.2 million in 2023 to approximately USD 1,896.4 million by 2032, at a compound annual growth rate (CAGR) of 11.0% during the forecast period. This substantial market growth can be attributed to the increasing importance of data analytics, the exponential growth of e-commerce, and the rising need for competitive intelligence across various industries. Organizations are increasingly leveraging web scraping tools to extract large volumes of data from websites, which are then used to make data-driven decisions, optimize operations, and enhance customer experience.

One of the primary growth factors for the web screen scraping tools market is the rising importance of data in driving business strategies. As the digital landscape becomes more complex, businesses are generating and consuming vast amounts of data. Web scraping tools enable organizations to efficiently gather, process, and analyze web data, which is critical for market research, competitive analysis, and strategic planning. The ability to extract real-time data from multiple sources provides companies with actionable insights that can lead to more informed decision-making and a competitive edge in the market.

Another significant factor propelling the growth of the web screen scraping tools market is the growth of e-commerce. E-commerce platforms and online marketplaces are rich sources of product information, pricing data, customer reviews, and other valuable insights. Retailers and brands utilize web scraping tools to monitor and analyze competitor pricing, track inventory levels, and understand consumer behavior. This data is essential for optimizing pricing strategies, improving product offerings, and enhancing the overall customer experience. As e-commerce continues to expand globally, the demand for web scraping tools is expected to rise correspondingly.

Furthermore, the need for automated data extraction processes is also contributing to market growth. Manual data collection methods are time-consuming, prone to errors, and inefficient. Web scraping tools offer a more efficient and reliable solution by automating the data collection process. These tools can handle large volumes of data, operate at high speeds, and ensure accuracy and consistency. The automation of data extraction processes not only saves time and resources but also enables businesses to focus on higher-value activities such as data analysis and strategy development.

Regionally, North America holds a significant share of the web screen scraping tools market, driven by the presence of major technology companies, high internet penetration, and a strong emphasis on data-driven decision-making. Europe is also a key market, with increasing adoption of web scraping tools in sectors such as retail, finance, and healthcare. The Asia Pacific region is expected to witness the highest growth rate due to the rapid digital transformation, the growth of the e-commerce sector, and the increasing focus on data analytics. Latin America and the Middle East & Africa are also anticipated to show steady growth, supported by the expanding internet infrastructure and growing awareness of the benefits of data-driven strategies.

Type Analysis

The web screen scraping tools market can be segmented by type into browser extension, standalone software, and cloud-based solutions. Browser extensions are popular due to their ease of use and accessibility. These tools integrate directly with web browsers, allowing users to scrape data from websites without requiring any additional software installation. Browser extensions are particularly useful for small-scale scraping tasks and are favored by individual users and small businesses. However, their functionality may be limited compared to more robust solutions.

Standalone software offers more comprehensive features and greater flexibility. These tools are installed on a user's computer and can be customized to meet specific data extraction needs. Standalone software solutions typically support larger-scale scraping operations and can handle complex data structures. Businesses that require extensive data extraction capabilities often prefer standalone software due to its ability to automate and schedule scraping tasks, manage large datasets, and provide advanced data processing and analysis features.

No Code Web Scraper Tool Market Outlook

As of 2023, the global market size for No Code Web Scraper Tools is valued at approximately USD 850 million and is projected to reach nearly USD 2.5 billion by 2032, growing at a compound annual growth rate (CAGR) of 12.5%. This growth is primarily driven by the increasing demand for simplified data extraction solutions that do not require extensive coding knowledge, enabling businesses of all sizes to efficiently collect and utilize web data.

The burgeoning need for data-driven decision-making across industries is a significant growth factor for the No Code Web Scraper Tool market. Organizations are increasingly recognizing the value of web data in gaining competitive insights, making informed business decisions, and optimizing operations. The ability to scrape web data without needing advanced technical skills democratizes data access, allowing non-technical users to harness the power of web data extraction. This trend is further propelled by the rise of small and medium enterprises (SMEs) that require cost-effective and efficient tools to stay competitive.

The growth of e-commerce and digital marketing also plays a pivotal role in the expansion of the No Code Web Scraper Tool market. As online retail continues to flourish, businesses are keen to monitor competitor pricing, track customer reviews, and gather market intelligence. No code web scraping tools provide an accessible and scalable solution for e-commerce platforms to automate these data collection processes. Furthermore, digital marketers utilize these tools to gather and analyze data from various online sources, supporting more targeted and effective marketing campaigns.

Technological advancements and the integration of artificial intelligence (AI) and machine learning (ML) in web scraping tools are additional drivers of market growth. These advancements enhance the capabilities of web scraping tools, making them more efficient, accurate, and user-friendly. AI and ML technologies facilitate the automatic adaptation to changes in website structures, reducing the need for manual intervention and ensuring continuous data extraction. This technological evolution not only improves the functionality of these tools but also broadens their applicability across different sectors.

In the realm of web scraping, a Hook Extractor is a crucial component that enhances the efficiency and accuracy of data extraction processes. This tool is designed to seamlessly integrate with existing web scraping frameworks, allowing users to capture specific data elements from complex web pages. By utilizing a Hook Extractor, businesses can streamline their data collection efforts, ensuring that they gather only the most relevant information for their needs. This is particularly beneficial in scenarios where web pages are dynamic and frequently updated, as the Hook Extractor can adapt to changes in the website structure without requiring manual reconfiguration. As a result, organizations can maintain a competitive edge by continuously accessing up-to-date data insights.

Regionally, North America holds a significant share of the No Code Web Scraper Tool market, driven by the high adoption rate of advanced technologies and the presence of numerous tech-savvy enterprises. The Asia-Pacific region is expected to witness the highest growth rate during the forecast period, fueled by the rapid digitalization and increasing internet penetration. Europe also presents lucrative opportunities, supported by the growing awareness and adoption of data-driven strategies among businesses. Latin America, the Middle East, and Africa are gradually catching up, with increasing investments in IT infrastructure and digital transformation initiatives.

Component Analysis

The No Code Web Scraper Tool market by component is segmented into software and services. The software segment comprises the actual web scraping tools that businesses use to extract data from websites. These tools are designed to be user-friendly, often featuring drag-and-drop interfaces and pre-built templates that simplify the data extraction process. The software segment is expected to dominate the market, driven by continuous innovations and the development of more sophisticated, AI-powered scraping solutions. Additionally, the subscription-based pricing model for these tools makes them accessible to a wide range of users, from individual entrepreneurs to large enterprises.

In contrast,

Web Scraping Services Market is segmented By Type (Browser Extension, Installable Software, and Cloud Based) and Application (Data Aggregation, Customer Insight, and Others)

The Web Scraping Market is Segmented by Solution (Software, Services), Deployment Type (Cloud, On-Premise), End-User Industry (BFSI, Retail and E-Commerce, Real Estate, Manufacturing, Government, Healthcare, Advertising and Media, and More), Use Case (Data Scaping / ETL, Price and Competitive Monitoring, and More), and Geography.

Scraping Grader Market Outlook

The global market size for the Scraping Grader market was valued at approximately USD 1.2 billion in 2023 and is projected to reach around USD 3.5 billion by 2032, growing at a CAGR of about 12.5% during the forecast period. This growth is primarily driven by the increasing need for accurate and timely data extraction across various industries.

One of the main growth factors for the Scraping Grader market is the escalating demand for data-driven decision-making in business operations. As industries grow more competitive, the need for real-time data extraction to inform strategic decisions has become imperative. This has led to an increased adoption of scraping and grading technologies that can efficiently process large volumes of data from various sources. Both large enterprises and SMEs are investing significantly in these technologies to stay ahead of the curve and maintain a competitive edge.

Another significant driver is the rise in digital transformation across industries. Companies are increasingly leveraging web scraping tools to gather critical market insights, conduct competitive analysis, and monitor pricing strategies. The exponential growth of e-commerce and online businesses has further augmented the demand for scraping graders, as these enterprises need to continuously analyze market trends, customer preferences, and competitor activities. The integration of advanced technologies like AI and machine learning into scraping solutions has enhanced their efficiency and accuracy, making them indispensable tools for modern businesses.

The expanding applications of scraping graders in diverse sectors such as BFSI, healthcare, and retail is also a noteworthy growth factor. In the financial sector, for instance, scraping graders are used for market analysis, monitoring stock prices, and collecting financial news. Similarly, in healthcare, these tools help in gathering patient data, tracking pharmaceutical prices, and monitoring market trends. Retailers use scraping graders for price monitoring, inventory management, and understanding customer behavior. This wide range of applications across multiple sectors is significantly boosting the demand for scraping grader solutions.

From a regional perspective, North America holds a dominant position in the Scraping Grader market due to the early adoption of advanced technologies and the presence of major market players in the region. However, the Asia Pacific region is expected to witness the highest growth rate during the forecast period. This can be attributed to the rapid digital transformation in countries like China and India, growing e-commerce activities, and increasing investments in data-driven technologies. Europe and Latin America are also expected to experience substantial growth, driven by the rising demand for efficient data extraction solutions and the growing awareness of the benefits of data-driven decision-making.

Component Analysis

The Scraping Grader market by component is segmented into software, hardware, and services. The software segment dominates the market, accounting for a significant share due to the increasing adoption of advanced scraping tools and solutions. These software solutions offer a wide range of functionalities, including data extraction, processing, and analysis, which are essential for businesses to make informed decisions. The integration of AI and machine learning algorithms in these software solutions has further enhanced their efficiency and accuracy, making them highly sought after in the market.

The hardware segment, although smaller in comparison to software, plays a crucial role in the overall functioning of scraping grader solutions. High-performance hardware is required to support the complex algorithms and large-scale data processing needs of modern scraping tools. With advancements in computing technology, the hardware segment is expected to grow steadily, driven by the need for more powerful and efficient systems to handle the increasing volumes of data.

The services segment encompasses a range of offerings, including consulting, implementation, training, and support services. These services are critical for the successful deployment and operation of scraping grader solutions. Consulting services help organizations identify the right tools and strategies for their specific needs, while implementation services ensure seamless integration with existing systems. Training and support services are essential for maximizing the benefits of these solutions by ensuring that users are well-versed in t

We create tailor-made solutions for every customer, so there are no limits to how we can customize your scraper. You don't have to worry about buying and maintaining complex and expensive software, or hiring developers.

You can get the data on a one-time or recurring (based on your needs) basis.

Get the data in any format and to any destination you need: Excel, CSV, JSON, XML, S3, GCP, or any other.

The review dataset for 3 video games - Call of Duty : Black Ops 3, Persona 5 Royal and Counter Strike: Global Offensive was taken through a web scrape of SteamDB [https://steamdb.info/] which is a large repository for game related data such as release dates, reviews, prices, and more. In the initial scrape, each individual game has two files - customer reviews (Count: 100 reviews) and price time series data.

To obtain data on the reviews of the selected video games, we performed web scraping using R software. The customer reviews dataset contains the date that the review was posted and the review text, while the price dataset contains the date that the price was changed and the price on that date. In order to clean and prepare the data we first start by sectioning the data in excel. After scraping, our csv file fits each review in one row with the date. We split the data, separating date and review, allowing them to have separate columns. Luckily scraping the price separated price and date, so after the separating we just made sure that every file had similar column names.

After, we use R to finish the cleaning. Each game has a separate file for prices and review, so each of the prices is converted into a continuous time series by extending the previously available price for each date. Then the price dataset is combined with its respective in R on the common date column using left join. The resulting dataset for each game contains four columns - game name, date, reviews and price. From there, we allow the user to select the game they would like to view.