Retail sales of specific packaged goods (coffee, laundry detergent, shampoo) broken out by U.S. region, brand, size, packaging material, UPC, and price.

Abstract

NielsenIQ Retail Scanner Data

Methodology

Through a relationship with NielsenIQ, the Kilts Center at the University of Chicago Booth School of Business provides multiple consumer datasets to academic researchers around the world.

Columbia has an agreement with the Kilts Center. Authorized faculty, graduate students, and research staff can apply to access this dataset.

Annual funding of the dataset is shared between the Program for Economic Research and the Libraries.

Funding for data analysis using the Columbia Data Platform is provided by the Program for Economic Research.

Usage

The Retail Scanner Data (also referred to as RMS data) consists of weekly pricing, volume, and store merchandising conditions generated by participating retail store point-of-sale systems in all US markets. Depending on the year, data are included from approximately 30,000-50,000 participating grocery, drug, mass merchandiser, and other stores. Products from all NielsenIQ-tracked categories are included in the data, such as food, non-food grocery items, health and beauty aids, and select general merchandise. Currently, the years 2006-2021 are included. We expect to update the data on an annual basis. Updates are expected to be available in the first quarter of each calendar year, and will always lag by 2 years (e.g. 2022 Retail Scanner data is expected to be released in Q1 of 2024).

There are three major types of files associated with the Retail Scanner Data: Stores, Product Description, and Movement (i.e., weekly sales and pricing). The Stores file contains information about each individual store location. The Product Description file contains information about each UPC. The Movement files contain the price and quantity of goods sold at specific stores on a specific week.

In 2021, Nielsen, the second largest company in the market research and data analytics sector, generated a total revenue of almost *** billion U.S. dollars in the United States, a decrease of approximately *** million dollars when compared to the previous year.

The global audience measurement systems market is booming, projected to reach $8.093 billion by 2025 with a 14.7% CAGR. This report analyzes market drivers, trends, restraints, and key players like Nielsen & Kantar across segments including digital, streaming, and TV measurement. Discover key insights and regional market share data.

The audience measurement market is experiencing robust growth, driven by the increasing importance of understanding consumer behavior across diverse media platforms. The market's value, while not explicitly stated, can be reasonably estimated based on the provided study period (2019-2033) and a likely substantial initial market size. Considering the involvement of major players like Nielsen, Kantar, and Comscore, and the continued expansion of digital media, a conservative estimate for the 2025 market size might be around $15 billion. A Compound Annual Growth Rate (CAGR) of, let's assume, 7% (a reasonable figure given industry trends) projects substantial growth through 2033. Key drivers include the need for precise audience measurement across traditional and digital media, the rise of streaming services and their demand for accurate viewership data, increasing sophistication in data analytics, and the growth of cross-platform measurement solutions. Trends indicate a shift towards more holistic and integrated measurement approaches, incorporating data from multiple sources to provide a comprehensive view of audience engagement. Despite this growth, the market faces certain restraints, including data privacy concerns, the complexity of cross-platform measurement, and the evolving landscape of media consumption habits. The segmentation of the market likely includes areas like television, digital, out-of-home, and social media, each presenting unique measurement challenges. The competitive landscape is highly concentrated, with established players like Nielsen and Kantar holding significant market share. However, the market also witnesses the emergence of specialized firms focusing on specific media types or analytical techniques. The presence of companies like Tubular and GeoPoll highlights the growing importance of digital-first measurement solutions. Future growth will be shaped by advancements in data science and artificial intelligence, leading to more accurate and granular audience insights. The ongoing debate surrounding measurement methodologies and standards will continue to influence market dynamics. Geographical variations in media consumption and regulatory frameworks also impact the market's regional distribution. The forecast period (2025-2033) promises significant expansion, driven by ongoing technological advancements and the ever-increasing demand for accurate audience data in an evolving media landscape.

Discover the booming digital audience measurement market! This in-depth analysis reveals a $15 billion market in 2025, projected to grow at 12% CAGR through 2033. Explore key drivers, trends, and regional insights, including North America, Europe, and Asia-Pacific, and learn how top players like Nielsen and Kantar are shaping the future of online audience analytics.

Discover the booming audience measurement systems market, projected to reach $40.85 billion by 2033 with a significant CAGR. This in-depth analysis covers key market drivers, trends, restraints, and regional breakdowns, featuring leading companies like Nielsen, Kantar, and Comscore. Gain insights into digital, streaming, and cross-media measurement solutions.

The article discusses the highly competitive cereal market and the concept of market share in the industry. It mentions major players like Kellogg's, General Mills, Post Holdings, and Quaker Oats, along with their popular cereal brands. The article also highlights the importance of consumer preferences and the emergence of smaller, specialty brands in the market. Market share data for the year 2020 is provided by Nielsen, but the article notes that market shares can fluctuate due to various factors.

Methodology

Through a relationship with NielsenIQ, the Kilts Center at the University of Chicago Booth School of Business provides multiple consumer datasets to academic researchers around the world.

Columbia has an agreement with the Kilts Center. Authorized faculty, graduate students, and research staff can apply to access this dataset.

Annual funding of the dataset is shared between the Program for Economic Research and the Libraries.

Funding for data analysis using the Columbia Data Platform is provided by the Program for Economic Research.

Usage

The Consumer Panel Data comprise a representative panel of households that continually provide information about their purchases in a longitudinal study in which panelists stay on as long as they continue to meet NielsenIQ's criteria. NielsenIQ consumer panelists use in-home scanners to record all of their purchases (from any outlet) intended for personal, in-home use. Consumers provide information about their households and what products they buy, as well as when and where they make purchases.

Years Available: Starting with 2004 and including annual updates.

Panel Size: 40,000–60,000 active panelists (varies by year), projectable to the total United States using household projection factors.

Panelists: Household demographic, geographic, and product ownership variables are included, as well as select demographics for the heads of household and other members.

• Demographic variables include household income range, size, composition, presence and age of children, marital status, type of residence, race, and Hispanic origin. Male and female heads of household also report age range, birth date, hours employed, education, and occupation. For other family members, birth date, employment, and relationship/sex are reported.
• Geographic variables include panelist zip code, FIPS state and county codes, region (East, Central, South, West), and Scantrack Market code (assigned by NielsenIQ, and called Syndicated Major Markets (SMM) starting in 2021).
• Product Ownership variables include kitchen appliances, TV items, and internet connection.

%3C!-- --%3E

Products: From 2004 to 2020, all 10 NielsenIQ food and nonfood Departments (~1.4 million UPC codes). These Departments are dry grocery, frozen foods, dairy, deli, packaged meat, fresh produce, nonfood grocery, alcohol, general merchandise, and health and beauty aids.

Starting in 2021 data, NielsenIQ implemented a new Product Hierarchy structure. The original Product Hierarchy of Departments, Product Groups, and Product Modules has been phased out. For now, Product Module Codes will still be available to make the transition smoother.

Product Characteristics: All products include UPC code and description, brand, multipack, and size, as well as NielsenIQ codes for Department, Product Group, and Product Module. Some products contain additional characteristics (e.g., flavor). Starting in 2021 data, NielsenIQ expanded the number of additional product characteristics.

**Purchases: **Each shopping trip contains the date, retail chain code, retail channel, first three digits of store zip code, and total amount spent. For each product purchased, the UPC code, quantity, price, and any deals/coupons are recorded. Note that retailer names are not available.

Geographies: Entire United States, divided into 62 major markets.

Retail Channels: All retail channels—grocery, drug, mass merchandise, superstores, club stores, convenience, health, and others.

The TV Analytics market is booming, projected to reach [estimated 2033 value] by 2033, fueled by OTT growth and advanced audience measurement. Discover key trends, leading companies (Nielsen, SambaTV, Google), and regional insights in this comprehensive market analysis.

In 2020, Nielsen concentrated nearly ** percent of market share in the market research industry in Colombia. It was followed Kantar IBOPE with * percent of market share. Furthermore, the overall net sales of Colombia's market research sector have been increasing recently.

Market research companies have benefited from research and development (R&D) expenditure growth as companies develop new products to satisfy consumer demand. Downstream companies continue to rely on market research to create new products and campaigns that fit evolving consumer preferences. As companies strive to enhance consumer-centric strategies amid increased consumer spending, demand for tailored market research solutions has surged. A 10.7% surge in corporate profit over the past five years enabled businesses to outsource more of their research operations to professional market researchers. The digital shift has further transformed the landscape, with companies pioneering new research tools to tap into the vast potential of big data to enhance accessibility and participation. These trends have led to revenue growing at a CAGR of 3.8% to an estimated $36.4 billion over the past five years, including an estimated 2.1% boost in 2025 alone. Consumers' and advertisers' growing reliance on the internet has led to new metrics market researchers can use to better understand consumers. These have allowed new companies to enter the industry and driven providers to adjust services and implement new technologies. The rising use of social media to advertise and market new products across platforms like TikTok and Instagram also contributed to the growing demand for market research. These technological advancements improved data collection and analysis methods, offering actionable insights that helped companies refine marketing strategies and develop better products. New opportunities continue to drive revenue growth, but expansions to services and onboarding of new technology cut researchers’ profitability. Moving forward, the industry will benefit from acceleration in R&D budgets and technological and a data procurement evolution. Companies will strengthen their R&D budgets as economic conditions improve, further driving demand for advanced market research tools. The proliferation of online commerce and smart technologies will give researchers unprecedented access to consumer data. Technological developments, such as artificial intelligence (AI), are poised to create new metrics based on human reactions, which companies can leverage to better understand consumer behavior and preferences. Access to these metrics, however, will lead to tightening data privacy regulations, which may result in higher compliance costs that eat into profitability. Finally, growing emphasis on ethical practices, transparency and data security will shape consumer trust and research standards, creating new opportunities and challenges in a rapidly evolving marketplace. Revenue is poised to grow at a CAGR of 2.4% to an estimated $41.0 billion through the end of 2030.

Discover the booming neuromarketing market, projected to reach [estimated 2033 value based on CAGR] by 2033. Explore market drivers, trends, and key players shaping this innovative field of consumer research using neuroimaging and AI. Learn how BFSI and retail sectors are leveraging this data for targeted marketing campaigns. Recent developments include: Apr 2023: Cadwell Industries Inc. announced the US launch of Voyager for remote wireless access to in-home EEG monitoring with video. Now that Arc Apollo+ has EEG data collection with automatic data backfill, doctors and technologists can remotely access real-time EEG data and video from patients operating in-home. This feature is designed to enable thorough real-time analysis with a complete data set for daily reporting., Jul 2022: Tobii was selected by Sony Interactive Entertainment to be the eye-tracking technology provider for PlayStation VR2. The partnership with Sony Interactive Entertainment (SIE) is further evidence of Tobii's ability to provide cutting-edge solutions at a mass market scale using its world-leading technology. PlayStation VR2 sets a new standard for immersive virtual reality (VR) entertainment and will allow millions of users to experience the power of eye tracking globally.. Key drivers for this market are: Increasing Need for Advanced Marketing Tools, Increasing Penetration of Smartphones and High-speed Internet. Potential restraints include: Design complexity and distractions caused by earbuds. Notable trends are: BFSI End-User Vertical to Grow at a Significant Rate.

The global audience measurement systems market is booming, reaching $9045.1 million in 2025 and projected to grow at a CAGR of 15.4% until 2033. Learn about key drivers, market trends, and leading companies shaping this dynamic sector, including Nielsen, Kantar, and more. Discover insights into digital, TV, and cross-media measurement solutions.

Includes individual firm market share data for U.S. grocery retailers in 2010. Market areas consist of 361 Census Metropolitan Statistical Areas (MSAs), and 209 Nielsen Designated Market Areas (DMAs). The market share data include supermarkets and supercenters with annual sales greater than $2 million. For each market area, the name of the retail firm name, number of stores operated, total sales, and market share are reported.

Discover the booming spectator sports market analysis (2019-2033)! Explore key trends, regional insights, major players (Dallas Cowboys, Bayern Munich, Star Sports), and projected CAGR >5%. Learn how digital platforms and evolving fan engagement are reshaping this multi-billion dollar industry. Recent developments include: May 2023: FuboTV Inc., the foremost sports-oriented live TV streaming platform in the United States, announced its partnership with the Cleveland Guardians. This collaboration grants Guardians' enthusiasts the exciting opportunity to access Fubo's premier sports, news, and entertainment programming through an extended free trial. FuboTV boasts an impressive collection of over 175 live sports, news, and entertainment networks, making it the sole live TV streaming platform to feature every Nielsen-rated sports channel.February 2023: The sports streaming and e-commerce platform Fancode entered into a strategic partnership with Google Cloud. This collaboration aims to bolster its services with a data-driven approach, thereby enhancing fan engagement and optimizing the distribution of mainstream sports content. By doing so, Fancode is committed to strengthening its rapport with sports aficionados and fostering more immersive fan experiences.. Key drivers for this market are: Increase in Number of Sports Events Organized Globally, Increasing digital platforms raising sport spectators. Potential restraints include: Increase in Number of Sports Events Organized Globally, Increasing digital platforms raising sport spectators. Notable trends are: Rising In Global Sports Events.

Discover the booming Market Analytics Service market! This comprehensive analysis reveals a $150 billion (2025) market with a 15% CAGR, driven by AI, big data, and the need for data-driven decisions. Explore key trends, restraints, leading companies, and regional breakdowns. Get insights to optimize your business strategy.

The booming UX consulting market is projected to reach $250 billion by 2033, driven by increasing digital adoption and demand for user-centric design. Learn about market trends, key players (like IDEO, Nielsen Norman Group), and regional growth in our comprehensive analysis.

The neuromarketing market is booming, projected to reach $3.18 billion by 2033 with an 8.89% CAGR. Discover key trends, leading companies, and regional insights in this comprehensive market analysis. Learn how businesses use neuroscience to understand consumer behavior and boost marketing ROI. Recent developments include: Apr 2023: Cadwell Industries Inc. announced the US launch of Voyager for remote wireless access to in-home EEG monitoring with video. Now that Arc Apollo+ has EEG data collection with automatic data backfill, doctors and technologists can remotely access real-time EEG data and video from patients operating in-home. This feature is designed to enable thorough real-time analysis with a complete data set for daily reporting., Jul 2022: Tobii was selected by Sony Interactive Entertainment to be the eye-tracking technology provider for PlayStation VR2. The partnership with Sony Interactive Entertainment (SIE) is further evidence of Tobii's ability to provide cutting-edge solutions at a mass market scale using its world-leading technology. PlayStation VR2 sets a new standard for immersive virtual reality (VR) entertainment and will allow millions of users to experience the power of eye tracking globally.. Key drivers for this market are: Increasing Need for Advanced Marketing Tools, Increasing Penetration of Smartphones and High-speed Internet. Potential restraints include: Increasing Need for Advanced Marketing Tools, Increasing Penetration of Smartphones and High-speed Internet. Notable trends are: BFSI End-User Vertical to Grow at a Significant Rate.

Market researchers investigate clients' target markets' behaviour, values and opinions, providing insights that allow them to tailor their products, services and marketing. Researchers rely on hefty European research and development expenditure to fuel demand for market research. The surge in digitalisation has opened new doors for market research providers while intensifying competition. Artificial intelligence is increasingly important in analysing, identifying and generating research insights from social media posts using a flood of data. Meanwhile, digital surveys have allowed research companies to expand their outreach, save resources and costs and often attain more accurate and comprehensive insights for clients. Over the five years through 2025, industry revenue is expected to contract at a compound annual rate of 1.1% to reach €25.2 billion. The high inflationary environment in recent years has taken a toll on market research budgets. A sharp contraction in business sentiment squeezed corporate profit in 2022, discouraging companies from investing in research and development activities and negatively affecting professional research providers. A greater availability of data and alternative research methods means that researchers are competing more and more with in-house research departments. In 2025, industry revenue is expected to drop by 0.3% as consumers are finding their research needs met by AI tools such as ChatGPT, however, this trend is expected to be short-lived as research companies will strive to prove their value to clients. Over the five years through 2030, industry revenue is forecast to swell at a compound annual rate of 3.7% to reach €30.3 billion. Over the coming years, market research companies will face higher external competition from technology specialists leveraging insights internally, constraining revenue growth. Nonetheless, researchers will benefit from expanding online advertising activity. Those incorporating advanced data analytics systems and digital market research technology will remain competitive and benefit from greater digitalisation. Smart mobile surveys will also become an invaluable tool for consumer research companies.