Abstract

The Consumer price surveys primarily provide the following: Data on CPI in Palestine covering the West Bank, Gaza Strip and Jerusalem J1 for major and sub groups of expenditure. Statistics needed for decision-makers, planners and those who are interested in the national economy. Contribution to the preparation of quarterly and annual national accounts data.

Consumer Prices and indices are used for a wide range of purposes, the most important of which are as follows: Adjustment of wages, government subsidies and social security benefits to compensate in part or in full for the changes in living costs. To provide an index to measure the price inflation of the entire household sector, which is used to eliminate the inflation impact of the components of the final consumption expenditure of households in national accounts and to dispose of the impact of price changes from income and national groups. Price index numbers are widely used to measure inflation rates and economic recession. Price indices are used by the public as a guide for the family with regard to its budget and its constituent items. Price indices are used to monitor changes in the prices of the goods traded in the market and the consequent position of price trends, market conditions and living costs. However, the price index does not reflect other factors affecting the cost of living, e.g. the quality and quantity of purchased goods. Therefore, it is only one of many indicators used to assess living costs. It is used as a direct method to identify the purchasing power of money, where the purchasing power of money is inversely proportional to the price index.

Geographic coverage

Palestine West Bank Gaza Strip Jerusalem

Analysis unit

The target population for the CPI survey is the shops and retail markets such as grocery stores, supermarkets, clothing shops, restaurants, public service institutions, private schools and doctors.

Universe

The target population for the CPI survey is the shops and retail markets such as grocery stores, supermarkets, clothing shops, restaurants, public service institutions, private schools and doctors.

Kind of data

Sample survey data [ssd]

Sampling procedure

A non-probability purposive sample of sources from which the prices of different goods and services are collected was updated based on the establishment census 2017, in a manner that achieves full coverage of all goods and services that fall within the Palestinian consumer system. These sources were selected based on the availability of the goods within them. It is worth mentioning that the sample of sources was selected from the main cities inside Palestine: Jenin, Tulkarm, Nablus, Qalqiliya, Ramallah, Al-Bireh, Jericho, Jerusalem, Bethlehem, Hebron, Gaza, Jabalia, Dier Al-Balah, Nusseirat, Khan Yunis and Rafah. The selection of these sources was considered to be representative of the variation that can occur in the prices collected from the various sources. The number of goods and services included in the CPI is approximately 730 commodities, whose prices were collected from 3,200 sources. (COICOP) classification is used for consumer data as recommended by the United Nations System of National Accounts (SNA-2008).

Sampling deviation

Not apply

Mode of data collection

Computer Assisted Personal Interview [capi]

Research instrument

A tablet-supported electronic form was designed for price surveys to be used by the field teams in collecting data from different governorates, with the exception of Jerusalem J1. The electronic form is supported with GIS, and GPS mapping technique that allow the field workers to locate the outlets exactly on the map and the administrative staff to manage the field remotely. The electronic questionnaire is divided into a number of screens, namely: First screen: shows the metadata for the data source, governorate name, governorate code, source code, source name, full source address, and phone number. Second screen: shows the source interview result, which is either completed, temporarily paused or permanently closed. It also shows the change activity as incomplete or rejected with the explanation for the reason of rejection. Third screen: shows the item code, item name, item unit, item price, product availability, and reason for unavailability. Fourth screen: checks the price data of the related source and verifies their validity through the auditing rules, which was designed specifically for the price programs. Fifth screen: saves and sends data through (VPN-Connection) and (WI-FI technology).

In case of the Jerusalem J1 Governorate, a paper form has been designed to collect the price data so that the form in the top part contains the metadata of the data source and in the lower section contains the price data for the source collected. After that, the data are entered into the price program database.

Cleaning operations

The price survey forms were already encoded by the project management depending on the specific international statistical classification of each survey. After the researcher collected the price data and sent them electronically, the data was reviewed and audited by the project management. Achievement reports were reviewed on a daily and weekly basis. Also, the detailed price reports at data source levels were checked and reviewed on a daily basis by the project management. If there were any notes, the researcher was consulted in order to verify the data and call the owner in order to correct or confirm the information.

At the end of the data collection process in all governorates, the data will be edited using the following process: Logical revision of prices by comparing the prices of goods and services with others from different sources and other governorates. Whenever a mistake is detected, it should be returned to the field for correction. Mathematical revision of the average prices for items in governorates and the general average in all governorates. Field revision of prices through selecting a sample of the prices collected from the items.

Response rate

Not apply

Sampling error estimates

The findings of the survey may be affected by sampling errors due to the use of samples in conducting the survey rather than total enumeration of the units of the target population, which increases the chances of variances between the actual values we expect to obtain from the data if we had conducted the survey using total enumeration. The computation of differences between the most important key goods showed that the variation of these goods differs due to the specialty of each survey. For example, for the CPI, the variation between its goods was very low, except in some cases such as banana, tomato, and cucumber goods that had a high coefficient of variation during 2019 due to the high oscillation in their prices. The variance of the key goods in the computed and disseminated CPI survey that was carried out on the Palestine level was for reasons related to sample design and variance calculation of different indicators since there was a difficulty in the dissemination of results by governorates due to lack of weights. Non-sampling errors are probable at all stages of data collection or data entry. Non-sampling errors include: Non-response errors: the selected sources demonstrated a significant cooperation with interviewers; so, there wasn't any case of non-response reported during 2019. Response errors (respondent), interviewing errors (interviewer), and data entry errors: to avoid these types of errors and reduce their effect to a minimum, project managers adopted a number of procedures, including the following: More than one visit was made to every source to explain the objectives of the survey and emphasize the confidentiality of the data. The visits to data sources contributed to empowering relations, cooperation, and the verification of data accuracy. Interviewer errors: a number of procedures were taken to ensure data accuracy throughout the process of field data compilation: Interviewers were selected based on educational qualification, competence, and assessment. Interviewers were trained theoretically and practically on the questionnaire. Meetings were held to remind interviewers of instructions. In addition, explanatory notes were supplied with the surveys. A number of procedures were taken to verify data quality and consistency and ensure data accuracy for the data collected by a questioner throughout processing and data entry (knowing that data collected through paper questionnaires did not exceed 5%): Data entry staff was selected from among specialists in computer programming and were fully trained on the entry programs. Data verification was carried out for 10% of the entered questionnaires to ensure that data entry staff had entered data correctly and in accordance with the provisions of the questionnaire. The result of the verification was consistent with the original data to a degree of 100%. The files of the entered data were received, examined, and reviewed by project managers before findings were extracted. Project managers carried out many checks on data logic and coherence, such as comparing the data of the current month with that of the previous month, and comparing the data of sources and between governorates. Data collected by tablet devices were checked for consistency and accuracy by applying rules at item level to be checked.

Data appraisal

Other technical procedures to improve data quality: Seasonal adjustment processes

Average weekly earnings for the whole economy, for total and regular pay, in real terms (adjusted for consumer price inflation), UK, monthly, seasonally adjusted.

Philippines Consumer Price Index (CPI): BIH: AOMM: Weights: NF: OE: Other Personal Effects n.e.c. data was reported at 0.325 % in Feb 2025. This stayed constant from the previous number of 0.325 % for Jan 2025. Philippines Consumer Price Index (CPI): BIH: AOMM: Weights: NF: OE: Other Personal Effects n.e.c. data is updated monthly, averaging 0.325 % from Jan 2018 (Median) to Feb 2025, with 86 observations. The data reached an all-time high of 0.325 % in Feb 2025 and a record low of 0.325 % in Feb 2025. Philippines Consumer Price Index (CPI): BIH: AOMM: Weights: NF: OE: Other Personal Effects n.e.c. data remains active status in CEIC and is reported by Philippine Statistics Authority. The data is categorized under Global Database’s Philippines – Table.PH.I077: Consumer Price Index: 2018=100: Bottom 30% Income Households: Area Outside Metro Manila: Weights.

This dataset explores the consumer price index (CPI) by province for 2005. * 2002 = 0 A consumer price index (CPI) is an index number measuring the average price of consumer goods and services purchased by households. It is one of several price indices calculated by national statistical agencies. The percent change in the CPI is a measure of inflation. The CPI can be used to index (i.e., adjust for the effects of inflation) wages, salaries, pensions, or regulated or contracted prices. The CPI is, along with the population census and the National Income and Product Accounts, one of the most closely watched national economic statistics. Note: Annual average indexes are obtained by averaging the indexes for the 12 months of the calendar year. Source: Statistics Canada, CANSIM, table (for fee) 326-0021 and Catalogue nos. 62-001-X and 62-010-X. Last modified: 2008-04-22.

This analysis presents a rigorous exploration of financial data, incorporating a diverse range of statistical features. By providing a robust foundation, it facilitates advanced research and innovative modeling techniques within the field of finance.

What happens to gold if CPI increases?

Financial data:

• Historical daily stock prices (open, high, low, close, volume)

• Fundamental data (e.g., market capitalization, price to earnings P/E ratio, dividend yield, earnings per share EPS, price to earnings growth, debt-to-equity ratio, price-to-book ratio, current ratio, free cash flow, projected earnings growth, return on equity, dividend payout ratio, price to sales ratio, credit rating)

• Technical indicators (e.g., moving averages, RSI, MACD, average directional index, aroon oscillator, stochastic oscillator, on-balance volume, accumulation/distribution A/D line, parabolic SAR indicator, bollinger bands indicators, fibonacci, williams percent range, commodity channel index)

Machine learning features:

• Feature engineering based on financial data and technical indicators

• Sentiment analysis data from social media and news articles

• Macroeconomic data (e.g., GDP, unemployment rate, interest rates, consumer spending, building permits, consumer confidence, inflation, producer price index, money supply, home sales, retail sales, bond yields)

Potential Applications:

• Stock price prediction

• Portfolio optimization

• Algorithmic trading

• Market sentiment analysis

• Risk management

Use Cases:

• Researchers investigating the effectiveness of machine learning in stock market prediction

• Analysts developing quantitative trading Buy/Sell strategies

• Individuals interested in building their own stock market prediction models

• Students learning about machine learning and financial applications

Additional Notes:

• The dataset may include different levels of granularity (e.g., daily, hourly)

• Data cleaning and preprocessing are essential before model training

• Regular updates are recommended to maintain the accuracy and relevance of the data

Colombia Consumer Price Index (CPI): Mid Income: Other Personal Effects data was reported at 100.060 Dec2018=100 in Jan 2019. Colombia Consumer Price Index (CPI): Mid Income: Other Personal Effects data is updated monthly, averaging 100.060 Dec2018=100 from Jan 2019 (Median) to Jan 2019, with 1 observations. Colombia Consumer Price Index (CPI): Mid Income: Other Personal Effects data remains active status in CEIC and is reported by National Statistics Administrative Department. The data is categorized under Global Database’s Colombia – Table CO.I013: Consumer Price Index: COICOP: Dec2018=100: by Class of Good and Services.

When inflation occurs in a country, the value of the currency decreases. That means that the purchasing power consumers have with a fixed amount of money decreases. Wages, especially lower and middle class wages, usually increase at a MUCH slower rate than prices of consumer goods; so consumers are likely to make the same wage, but are not able to buy the same amount of goods and services. Consumers in countries with hyperinflation suffer greatly because of this economic phenomenon.

Data was downloaded from: Link

For notes/metadata regarding the definition, measurement, or data collection for a certain country or group can be found by downloading the excel file from the linked webpage.

Original data provider: International Monetary Fund, World Development Indicators. License : CC BY-4.0.

INDICATOR_CODE: FP.CPI.TOTL.ZG

INDICATOR_NAME: Inflation, consumer prices (annual %)

SOURCE_NOTE: Inflation as measured by the consumer price index reflects the annual percentage change in the cost to the average consumer of acquiring a basket of goods and services that may be fixed or changed at specified intervals, such as yearly.
The Laspeyres formula is generally used.

Years included: 1960-2016

The following countries have no values for any year:

• Somalia

• Puerto Rico

• Guam

• US Virgin Islands

The dataset also conains some records that refer to groups of countries, which may be useful for those with no recorded values. Some of those groups are:

• Fragile and conflict affected situations

• Heavily indebted poor countries (HIPC)

• Caribbean small states

• Latin America & Caribbean (excluding high income)

• Latin America & the Caribbean (IDA & IBRD countries)

• East Asia & Pacific (excluding high income)

• East Asia & Pacific (IDA & IBRD countries)

• Least developed countries: UN classification

• Middle East & North Africa (IDA & IBRD countries)

If this data is being used for the Kiva Crowdfunding Data Science for Good event; The following countries (as they are named in this dataset), are named slightly differently in the Kiva dataset (to the best of my knowledge). For example, West Bank in Gaza is referred to as Palestine in the Kiva Dataset.

• Congo, Dem. Rep.

• Congo, Rep.

• Kyrgyz Republic

• Lao PDR

• Myanmar

• West Bank and Gaza

• St. Vincent and the Grenadines

• Virgin Islands (U.S.)

• Yemen, Rep.

Singapore Consumer Price Index (CPI): IL: Middle 60%: Miscellaneous G&S: Personal Effects data was reported at 96.784 2019=100 in Dec 2024. This records a decrease from the previous number of 99.175 2019=100 for Jun 2024. Singapore Consumer Price Index (CPI): IL: Middle 60%: Miscellaneous G&S: Personal Effects data is updated semiannually, averaging 98.672 2019=100 from Jun 2014 (Median) to Dec 2024, with 22 observations. The data reached an all-time high of 101.796 2019=100 in Dec 2017 and a record low of 92.475 2019=100 in Dec 2020. Singapore Consumer Price Index (CPI): IL: Middle 60%: Miscellaneous G&S: Personal Effects data remains active status in CEIC and is reported by Singapore Department of Statistics. The data is categorized under Global Database’s Singapore – Table SG.I022: Consumer Price Index: By Income Levels: 2019=100.

Singapore Consumer Price Index (CPI): IL: Lower 20%: Miscellaneous G&S: Personal Effects data was reported at 95.677 2019=100 in Dec 2024. This records a decrease from the previous number of 98.611 2019=100 for Jun 2024. Singapore Consumer Price Index (CPI): IL: Lower 20%: Miscellaneous G&S: Personal Effects data is updated semiannually, averaging 97.570 2019=100 from Jun 2014 (Median) to Dec 2024, with 22 observations. The data reached an all-time high of 101.859 2019=100 in Jun 2018 and a record low of 94.703 2019=100 in Dec 2020. Singapore Consumer Price Index (CPI): IL: Lower 20%: Miscellaneous G&S: Personal Effects data remains active status in CEIC and is reported by Singapore Department of Statistics. The data is categorized under Global Database’s Singapore – Table SG.I022: Consumer Price Index: By Income Levels: 2019=100.

About this dataset

Context

The dataset illustrates the median household income in Sharon town, spanning the years from 2010 to 2021, with all figures adjusted to 2022 inflation-adjusted dollars. Based on the latest 2017-2021 5-Year Estimates from the American Community Survey, it displays how income varied over the last decade. The dataset can be utilized to gain insights into median household income trends and explore income variations.

Key observations:

From 2010 to 2021, the median household income for Sharon town decreased by $31 (0.04%), as per the American Community Survey estimates. In comparison, median household income for the United States increased by $4,559 (6.51%) between 2010 and 2021.

Analyzing the trend in median household income between the years 2010 and 2021, spanning 11 annual cycles, we observed that median household income, when adjusted for 2022 inflation using the Consumer Price Index retroactive series (R-CPI-U-RS), experienced growth year by year for 5 years and declined for 6 years.

https://i.neilsberg.com/ch/sharon-town-walworth-county-wi-median-household-income-trend.jpeg" alt="Sharon Town, Walworth County, Wisconsin median household income trend (2010-2021, in 2022 inflation-adjusted dollars)">

Content

When available, the data consists of estimates from the U.S. Census Bureau American Community Survey (ACS) 2017-2021 5-Year Estimates. All incomes have been adjusting for inflation and are presented in 2022-inflation-adjusted dollars.

Years for which data is available:

• 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017, 2018, 2019, 2020, 2021

Variables / Data Columns

• Year: This column presents the data year from 2010 to 2021
• Median Household Income: Median household income, in 2022 inflation-adjusted dollars for the specific year
• YOY Change($): Change in median household income between the current and the previous year, in 2022 inflation-adjusted dollars
• YOY Change(%): Percent change in median household income between current and the previous year

Good to know

Margin of Error

Data in the dataset are based on the estimates and are subject to sampling variability and thus a margin of error. Neilsberg Research recommends using caution when presening these estimates in your research.

Custom data

If you do need custom data for any of your research project, report or presentation, you can contact our research staff at research@neilsberg.com for a feasibility of a custom tabulation on a fee-for-service basis.

Inspiration

Neilsberg Research Team curates, analyze and publishes demographics and economic data from a variety of public and proprietary sources, each of which often includes multiple surveys and programs. The large majority of Neilsberg Research aggregated datasets and insights is made available for free download at https://www.neilsberg.com/research/.

Recommended for further research

This dataset is a part of the main dataset for Sharon town median household income. You can refer the same here

VITAL SIGNS INDICATOR
Income (EC4)

FULL MEASURE NAME
Household income by place of residence

LAST UPDATED
January 2023

DESCRIPTION
Income reflects the median earnings of individuals and households from employment, as well as the income distribution by quintile. Income data highlight how employees are being compensated for their work on an inflation-adjusted basis.

DATA SOURCE
U.S. Census Bureau: Decennial Census - https://nhgis.org
Count 4Pb (1970)
Form STF3 (1980-1990)
Form SF3a (2000)

U.S. Census Bureau: American Community Survey - https://data.census.gov/
Form B19001 (2005-2021; household income by place of residence)
Form B19013 (2005-2021; median household income by place of residence)
Form B08521 (2005-2021; median worker earnings by place of employment)

Bureau of Labor Statistics: Consumer Price Index - https://www.bls.gov/data/
1970-2021

CONTACT INFORMATION
vitalsigns.info@bayareametro.gov

METHODOLOGY NOTES (across all datasets for this indicator)
Income derived from the decennial Census data reflects the income earned in the prior calendar year, whereas income derived from the American Community Survey (ACS) data reflects the prior 12 month period; note that this inconsistency has a minor effect on historical comparisons (see Income and Earnings Data section of the ACS General Handbook - https://www.census.gov/content/dam/Census/library/publications/2020/acs/acs_general_handbook_2020_ch09.pdf). ACS 1-year data is used for larger geographies – Bay counties and most metropolitan area counties – while smaller geographies rely upon 5-year rolling average data due to their smaller sample sizes. Note that 2020 data uses the 5-year estimates because the ACS did not collect 1-year data for 2020.

Quintile income for 1970-2000 is imputed from decennial Census data using methodology from the California Department of Finance. Bay Area income is the population weighted average of county-level income.

Income has been inflated using the Consumer Price Index (CPI) for 2021 specific to each metro area; however, some metro areas lack metro-specific CPI data back to 1970 and therefore adjusted data uses national CPI for 1970. Note that current MSA boundaries were used for historical comparison by identifying counties included in today’s metro areas.

Philippines Consumer Price Index (CPI): BIH: MM: NF: PC: Other Personal Effects data was reported at 110.900 2018=100 in Mar 2025. This records an increase from the previous number of 110.800 2018=100 for Feb 2025. Philippines Consumer Price Index (CPI): BIH: MM: NF: PC: Other Personal Effects data is updated monthly, averaging 104.600 2018=100 from Jan 2018 (Median) to Mar 2025, with 87 observations. The data reached an all-time high of 110.900 2018=100 in Mar 2025 and a record low of 98.400 2018=100 in Feb 2018. Philippines Consumer Price Index (CPI): BIH: MM: NF: PC: Other Personal Effects data remains active status in CEIC and is reported by Philippine Statistics Authority. The data is categorized under Global Database’s Philippines – Table.PH.I071: Consumer Price Index: 2018=100: Bottom 30% Income Households: Metro Manila.

The main purpose of the Household Income Expenditure Survey (HIES) 2016 was to offer high quality and nationwide representative household data that provided information on incomes and expenditure in order to update the Consumer Price Index (CPI), improve National Accounts statistics, provide agricultural data and measure poverty as well as other socio-economic indicators. These statistics were urgently required for evidence-based policy making and monitoring of implementation results supported by the Poverty Reduction Strategy (I & II), the AfT and the Liberia National Vision 2030. The survey was implemented by the Liberia Institute of Statistics and Geo-Information Services (LISGIS) over a 12-month period, starting from January 2016 and was completed in January 2017. LISGIS completed a total of 8,350 interviews, thus providing sufficient observations to make the data statistically significant at the county level. The data captured the effects of seasonality, making it the first of its kind in Liberia. Support for the survey was offered by the Government of Liberia, the World Bank, the European Union, the Swedish International Development Corporation Agency, the United States Agency for International Development and the African Development Bank. The objectives of the 2016 HIES were: 1. Update the Consumer Price Index (CPI): To obtain a new set of weights for the basket of goods and services that upgrade the Monrovia Consumer Price Index (MCPI) and the National Consumer Price Index (NCPI) and to revise the CPI basket of goods and services in Liberia to reflect the current consumption pattern of residence. 2. Improve National Accounts Statistics: To get information on annual household expenditure patterns in order to update the household component of the National Accounts. 3. Measure Poverty: To prepare robust poverty indices that enable the understanding of poverty dynamics across the country and of the factors influencing them. 4. Improve Agricultural Statistics: To obtain nationally representative and policy relevant agricultural statistics in order to undertake in-depth analysis of agricultural households. 5. Capture Socio-economic Impact of Ebola Virus Disease (EVD): To obtain a post-EVD dataset which allows for an in-depth analysis of the socioeconomic impact of EVD on households. 6. Benchmark Agenda for Transformation Indicators: To provide an update on selected socioeconomic indicators used to benchmark the government’s policies embedded within the Agenda for Transformation. 7. Develop Statistical Capacity: Emphasize capacity building and development of sustainable statistical systems through every stage of the project to produce accurate and timely information about Liberia.

Abstract

The main purpose of the Household Income Expenditure Survey (HIES) 2016 was to offer high quality and nationwide representative household data that provided information on incomes and expenditure in order to update the Consumer Price Index (CPI), improve National Accounts statistics, provide agricultural data and measure poverty as well as other socio-economic indicators. These statistics were urgently required for evidence-based policy making and monitoring of implementation results supported by the Poverty Reduction Strategy (I & II), the AfT and the Liberia National Vision 2030. The survey was implemented by the Liberia Institute of Statistics and Geo-Information Services (LISGIS) over a 12-month period, starting from January 2016 and was completed in January 2017. LISGIS completed a total of 8,350 interviews, thus providing sufficient observations to make the data statistically significant at the county level. The data captured the effects of seasonality, making it the first of its kind in Liberia. Support for the survey was offered by the Government of Liberia, the World Bank, the European Union, the Swedish International Development Corporation Agency, the United States Agency for International Development and the African Development Bank. The objectives of the 2016 HIES were:

1. Update the Consumer Price Index (CPI): To obtain a new set of weights for the basket of goods and services that upgrade the Monrovia Consumer Price Index (MCPI) and the National Consumer Price Index (NCPI) and to revise the CPI basket of goods and services in Liberia to reflect the current consumption pattern of residence.
2. Improve National Accounts Statistics: To get information on annual household expenditure patterns in order to update the household component of the National Accounts.
3. Measure Poverty: To prepare robust poverty indices that enable the understanding of poverty dynamics across the country and of the factors influencing them.
4. Improve Agricultural Statistics: To obtain nationally representative and policy relevant agricultural statistics in order to undertake in-depth analysis of agricultural households.
5. Capture Socio-economic Impact of Ebola Virus Disease (EVD): To obtain a post-EVD dataset which allows for an in-depth analysis of the socioeconomic impact of EVD on households.
6. Benchmark Agenda for Transformation Indicators: To provide an update on selected socioeconomic indicators used to benchmark the government’s policies embedded within the Agenda for Transformation.
7. Develop Statistical Capacity: Emphasize capacity building and development of sustainable statistical systems through every stage of the project to produce accurate and timely information about Liberia.

Geographic coverage

National

Analysis unit

• Households
• Individuals

Kind of data

Sample survey data [ssd]

Sampling procedure

The original sample design for the HIES exploited two-phased clustered sampling methods, encompassing a nationally representative sample of households in every quarter and was obtained using the 2008 National Housing and Population Census sampling frame. The procedures used for each sampling stage are as follows:
i. First stage
Selection of sample EAs. The sample EAs for the 2016 HIES were selected within each stratum systematically with Probability Proportional to Size from the ordered list of EAs in the sampling frame. They are selected separately for each county by urban/rural stratum. The measure of size for each EA was based on the number of households from the sampling frame of EAs based on the 2008 Liberia Census. Within each stratum the EAs were ordered geographically by district, clan and EA codes. This provided implicit geographic stratification of the sampling frame.

ii. Second stage
Selection of sample households within a sample EA. A random systematic sample of 10 households were selected from the listing for each sample EA. Using this type of table, the supervisor only has to look up the total number of households listed, and a specific systematic sample of households is identified in the corresponding row of the table.

Mode of data collection

Face-to-face [f2f]

Research instrument

There were three questionnaires administered for this survey: 1. Household and Individual Questionnaire 2. Market Price Questionnaire 3. Agricultural Recall Questionnaire

Cleaning operations

The data entry clerk for each team, using data entry software called CSPro, entered data for each household in the field. For each household, an error report was generated on-site, which identified key problems with the data collected (outliers, incorrect entries, inconsistencies with skip patterns, basic filters for age and gender specific questions etc.). The Supervisor along with the Data Entry Clerk and the Enumerator that collected the data reviewed these errors. Callbacks were made to households if necessary to verify information and rectify the errors while in that EA.

Once the data were collected in each EA, they were sent to LISGIS headquarters for further processing along with EA reports for each area visited. The HIES Technical committee converted the data into STATA and ran several consistency checks to manage overall data quality and prepared reports to identify key problems with the data set and called the field teams to update them about the same. Monthly reports were prepared by summarizing observations from data received from the field alongside statistics on data collection status to share with the field teams and LISGIS Management.

This dataset provides information about earnings of employees who are working in an area, who are on adult rates and whose pay for the survey pay-period was not affected by absence. Tables provided here include total gross weekly earnings, and full time weekly earnings with breakdowns by gender, and annual median, mean and lower quartile earnings by borough and UK region. These are provided both in nominal and real terms. Real earnings figures are on sheets labelled "real", are in 2016 prices, and calculated by applying ONS’s annual CPI index series for April to ASHE data. Annual Survey of Hours and Earnings (ASHE) is based on a sample of employee jobs taken from HM Revenue & Customs PAYE records. Information on earnings and hours is obtained in confidence from employers. ASHE does not cover the self-employed nor does it cover employees not paid during the reference period. The earnings information presented relates to gross pay before tax, National Insurance or other deductions, and excludes payments in kind. The confidence figure is the coefficient of variation (CV) of that estimate. The CV is the ratio of the standard error of an estimate to the estimate itself and is expressed as a percentage. The smaller the coefficient of variation the greater the accuracy of the estimate. The true value is likely to lie within +/- twice the CV. Results for 2003 and earlier exclude supplementary surveys. In 2006 there were a number of methodological changes made. For further details goto : http://www.nomisweb.co.uk/articles/341.aspx. The headline statistics for ASHE are based on the median rather than the mean. The median is the value below which 50 per cent of employees fall. It is ONS's preferred measure of average earnings as it is less affected by a relatively small number of very high earners and the skewed distribution of earnings. It therefore gives a better indication of typical pay than the mean. Survey data from a sample frame, use caution if using for performance measurement and trend analysis '#' These figures are suppressed as statistically unreliable. ! Estimate and confidence interval not available since the group sample size is zero or disclosive (0-2). Furthermore, data from Abstract of Regional Statistics, New Earnings Survey and ASHE have been combined to create long run historical series of full-time weekly earnings data for London and Great Britain, stretching back to 1965, and is broken down by sex.

VITAL SIGNS INDICATOR Income (EC5)

FULL MEASURE NAME Worker income by workplace (earnings)

LAST UPDATED October 2016

DESCRIPTION Income reflects the median earnings of individuals and households from employment, as well as the income distribution by quintile. Income data highlight how employees are being compensated for their work on an inflation-adjusted basis.

DATA SOURCE U.S. Census Bureau: Decennial Census Count 4Pb (1970) Form STF3 (1980-1990) Form SF3a (2000) https://nhgis.org

U.S. Census Bureau: American Community Survey Form B08521 (2006-2015; place of employment) http://api.census.gov

Bureau of Labor Statistics: Consumer Price Index All Urban Consumers Data Table (1970-2015; specific to each metro area) http://data.bls.gov

CONTACT INFORMATION vitalsigns.info@mtc.ca.gov

METHODOLOGY NOTES (across all datasets for this indicator) Income data reported in a given year reflects the income earned in the prior year (decennial Census) or in the prior 12 months (American Community Survey); note that this inconsistency has a minor effect on historical comparisons (for more information, go to: http://www.census.gov/acs/www/Downloads/methodology/ASA_nelson.pdf). American Community Survey 1-year data is used for larger geographies – metropolitan areas and counties – while smaller geographies rely upon 5-year rolling average data due to their smaller sample sizes. Quintile income for 1970-2000 is imputed from Decennial Census data using methodology from the California Department of Finance (for more information, go to: http://www.dof.ca.gov/Forecasting/Demographics/Census_Data_Center_Network/documents/How_to_Recalculate_a_Median.pdf). Bay Area income is the population weighted average of county-level income.

Income has been inflated using the Consumer Price Index specific to each metro area; however, some metro areas lack metro-specific CPI data back to 1970 and therefore adjusted data is unavailable for some historical data points. Note that current MSA boundaries were used for historical comparison by identifying counties included in today’s metro areas.

VITAL SIGNS INDICATOR
Income (EC4)

FULL MEASURE NAME
Household income by place of residence

LAST UPDATED
January 2023

DESCRIPTION
Income reflects the median earnings of individuals and households from employment, as well as the income distribution by quintile. Income data highlight how employees are being compensated for their work on an inflation-adjusted basis.

DATA SOURCE
U.S. Census Bureau: Decennial Census - https://nhgis.org
Count 4Pb (1970)
Form STF3 (1980-1990)
Form SF3a (2000)

U.S. Census Bureau: American Community Survey - https://data.census.gov/
Form B19001 (2005-2021; household income by place of residence)
Form B19013 (2005-2021; median household income by place of residence)
Form B08521 (2005-2021; median worker earnings by place of employment)

Bureau of Labor Statistics: Consumer Price Index - https://www.bls.gov/data/
1970-2021

CONTACT INFORMATION
vitalsigns.info@bayareametro.gov

METHODOLOGY NOTES (across all datasets for this indicator)
Income derived from the decennial Census data reflects the income earned in the prior calendar year, whereas income derived from the American Community Survey (ACS) data reflects the prior 12 month period; note that this inconsistency has a minor effect on historical comparisons (see Income and Earnings Data section of the ACS General Handbook - https://www.census.gov/content/dam/Census/library/publications/2020/acs/acs_general_handbook_2020_ch09.pdf). ACS 1-year data is used for larger geographies – Bay counties and most metropolitan area counties – while smaller geographies rely upon 5-year rolling average data due to their smaller sample sizes. Note that 2020 data uses the 5-year estimates because the ACS did not collect 1-year data for 2020.

Quintile income for 1970-2000 is imputed from decennial Census data using methodology from the California Department of Finance. Bay Area income is the population weighted average of county-level income.

Income has been inflated using the Consumer Price Index (CPI) for 2021 specific to each metro area; however, some metro areas lack metro-specific CPI data back to 1970 and therefore adjusted data uses national CPI for 1970. Note that current MSA boundaries were used for historical comparison by identifying counties included in today’s metro areas.

This dataset explores the Consumer Price Index, alcoholic beverages and tobacco products, by province for 2003 in Canada. Note: Annual average indexes are obtained by averaging the indexes for the 12 months of the calendar year. Source: Statistics Canada, CANSIM, table (for fee) 326-0021 and Catalogue nos. 62-001-X and 62-010-X. Last modified: 2008-04-22.

Low-income cut-offs, after tax (LICO-AT) - The Low-income cut-offs, after tax refers to an income threshold, defined using 1992 expenditure data, below which economic families or persons not in economic families would likely have devoted a larger share of their after-tax income than average to the necessities of food, shelter and clothing. More specifically, the thresholds represented income levels at which these families or persons were expected to spend 20 percentage points or more of their after-tax income than average on food, shelter and clothing. These thresholds have been adjusted to current dollars using the all-items Consumer Price Index (CPI).The LICO-AT has 35 cut-offs varying by seven family sizes and five different sizes of area of residence to account for economies of scale and potential differences in cost of living in communities of different sizes. These thresholds are presented in Table 4.3 Low-income cut-offs, after tax (LICO-AT - 1992 base) for economic families and persons not in economic families, 2015, Dictionary, Census of Population, 2016.When the after-tax income of an economic family member or a person not in an economic family falls below the threshold applicable to the person, the person is considered to be in low income according to LICO-AT. Since the LICO-AT threshold and family income are unique within each economic family, low-income status based on LICO-AT can also be reported for economic families.Return to footnote1referrerFootnote 2Users should be aware that the estimates associated with this variable are more affected than most by the incomplete enumeration of certain Indian reserves and Indian settlements in the Census of Population.For more information on Aboriginal variables, including information on their classifications, the questions from which they are derived, data quality and their comparability with other sources of data, please refer to the Aboriginal Peoples Reference Guide, Census of Population, 2016 and the Aboriginal Peoples Technical Report, Census of Population, 2016.Return to footnote2referrerFootnote 3Low-income status - The income situation of the statistical unit in relation to a specific low-income line in a reference year. Statistical units with income that is below the low-income line are considered to be in low income.For the 2016 Census, the reference period is the calendar year 2015 for all income variables.Return to footnote3referrerFootnote 4The low-income concepts are not applied in the territories and in certain areas based on census subdivision type (such as Indian reserves). The existence of substantial in-kind transfers (such as subsidized housing and First Nations band housing) and sizeable barter economies or consumption from own production (such as product from hunting, farming or fishing) could make the interpretation of low-income statistics more difficult in these situations.Return to footnote4referrerFootnote 5Prevalence of low income - The proportion or percentage of units whose income falls below a specified low-income line.Return to footnote5referrerFootnote 6Users should be aware that the estimates associated with this variable are more affected than most by the incomplete enumeration of certain Indian reserves and Indian settlements in the 2016 Census of Population. For more information on Aboriginal variables, including information on their classifications, the questions from which they are derived, data quality and their comparability with other sources of data, refer to the Aboriginal Peoples Reference Guide, Census of Population, 2016 and the Aboriginal Peoples Technical Report, Census of Population, 2016.Return to footnote6referrerFootnote 7'Aboriginal identity' includes persons who are First Nations (North American Indian), Métis or Inuk (Inuit) and/or those who are Registered or Treaty Indians (that is, registered under the Indian Act of Canada) and/or those who have membership in a First Nation or Indian band. Aboriginal peoples of Canada are defined in the Constitution Act, 1982, section 35 (2) as including the Indian, Inuit and Métis peoples of Canada.Return to footnote7referrerFootnote 8'Single Aboriginal responses' includes persons who are in only one Aboriginal group, that is First Nations (North American Indian), Métis or Inuk (Inuit).Return to footnote8referrerFootnote 9Users should be aware that the estimates associated with this variable are more affected than most by the incomplete enumeration of certain Indian reserves and Indian settlements in the 2016 Census of Population. For additional information, refer to the Aboriginal Peoples Reference Guide, Census of Population, 2016.Return to footnote9referrerFootnote 10'Multiple Aboriginal responses' includes persons who are any two or all three of the following: First Nations (North American Indian), Métis or Inuk (Inuit).Return to footnote10referrerFootnote 11'Aboriginal responses not included elsewhere' includes persons who are not First Nations (North American Indian), Métis or Inuk (Inuit), but who have Registered or Treaty Indian status and/or Membership in a First Nation or Indian band.

Abstract

The main objectives of the 2018/19 NLSS are: i) to provide critical information for production of a wide range of socio-economic and demographic indicators, including for benchmarking and monitoring of SDGs; ii) to monitor progress in population’s welfare; iii) to provide statistical evidence and measure the impact on households of current and anticipated government policies. In addition, the 2018/19 NLSS could be utilized to improve other non-survey statistical information, e.g. to determine and calibrate the contribution of final consumption expenditures of households to GDP; to update the weights and determine the basket for the national Consumer Price Index (CPI); to improve the methodology and dissemination of micro-economic and welfare statistics in Nigeria.

The 2018/19 NLSS collected a comprehensive and diverse set of socio-economic and demographic data pertaining to the basic needs and conditions under which households live on a day to day basis. The 2018/19 NLSS questionnaire includes wide-ranging modules, covering demographic indicators, education, health, labour, expenditures on food and non-food goods, non-farm enterprises, household assets and durables, access to safety nets, housing conditions, economic shocks, exposure to crime and farm production indicators.

Geographic coverage

National coverage

Analysis unit

• Households
• Individuals
• Communities

Universe

The survey covered all de jure households excluding prisons, hospitals, military barracks, and school dormitories.

Kind of data

Sample survey data [ssd]

Sampling procedure

The 2018/19 NLSS sample is designed to provide representative estimates for the 36 states and the Federal Capital Territory (FCT), Abuja. By extension. The sample is also representative at the national and zonal levels. Although the sample is not explicitly stratified by urban and rural areas, it is possible to obtain urban and rural estimates from the NLSS data at the national level. At all stages, the relative proportion of urban and rural EAs as has been maintained.

Before designing the sample for the 2018/19 NLSS, the results from the 2009/10 HNLSS were analysed to extract the sampling properties (variance, design effect, etc.) and estimate the required sample size to reach a desired precision for poverty estimates in the 2018/19 NLSS.

EA SELECTION: The sampling frame for the 2018/19 NLSS was based on the national master sample developed by the NBS, referred to as the NISH2 (Nigeria Integrated Survey of Households 2). This master sample was based on the enumeration areas (EAs) defined for the 2006 Nigeria Census Housing and Population conducted by National Population Commission (NPopC). The NISH2 was developed by the NBS to use as a frame for surveys with state-level domains. NISH2 EAs were drawn from another master sample that NBS developed for surveys with LGA-level domains (referred to as the “LGA master sample”). The NISH2 contains 200 EAs per state composed of 20 replicates of 10 sample EAs for each state, selected systematically from the full LGA master sample. Since the 2018/19 NLSS required domains at the state-level, the NISH2 served as the sampling frame for the survey.

Since the NISH2 is composed of state-level replicates of 10 sample EAs, a total of 6 replicates were selected from the NISH2 for each state to provide a total sample of 60 EAs per state. The 6 replicates selected for the 2018/19 NLSS in each state were selected using random systematic sampling. This sampling procedure provides a similar distribution of the sample EAs within each state as if one systematic sample of 60 EAs had been selected directly from the census frame of EAs.

A fresh listing of households was conducted in the EAs selected for the 2018/19 NLSS. Throughout the course of the listing, 139 of the selected EAs (or about 6%) were not able to be listed by the field teams. The primary reason the teams were not able to conduct the listing in these EAs was due to security issues in the country. The fieldwork period of the 2018/19 NLSS saw events related to the insurgency in the north east of the country, clashes between farmers and herdsman, and roving groups of bandits. These events made it impossible for the interviewers to visit the EAs in the villages and areas affected by these conflict events. In addition to security issues, some EAs had been demolished or abandoned since the 2006 census was conducted. In order to not compromise the sample size and thus the statistical power of the estimates, it was decided to replace these 139 EAs. Additional EAs from the same state and sector were randomly selected from the remaining NISH2 EAs to replace each EA that could not be listed by the field teams. This necessary exclusion of conflict affected areas implies that the sample is representative of areas of Nigeria that were accessible during the 2018/19 NLSS fieldwork period. The sample will not reflect conditions in areas that were undergoing conflict at that time. This compromise was necessary to ensure the safety of interviewers.

HOUSEHOLD SELECTION: Following the listing, the 10 households to be interviewed were selected from the listed households. These households were selected systemically after sorting by the order in which the households were listed. This systematic sampling helped to ensure that the selected households were well dispersed across the EA and thereby limit the potential for clustering of the selected households within an EA.

Occasionally, interviewers would encounter selected households that were not able to be interviewed (e.g. due to migration, refusal, etc.). In order to preserve the sample size and statistical power, households that could not be interviewed were replaced with an additional randomly selected household from the EA. Replacement households had to be requested by the field teams on a case-by-case basis and the replacement household was sent by the CAPI managers from NBS headquarters. Interviewers were required to submit a record for each household that was replaced, and justification given for their replacement. These replaced households are included in the disseminated data. However, replacements were relatively rare with only 2% of sampled households not able to be interviewed and replaced.

Sampling deviation

Although a sample was initially drawn for Borno state, the ongoing insurgency in the state presented severe challenges in conducting the survey there. The situation in the state made it impossible for the field teams to reach large areas of the state without compromising their safety. Given this limitation it was clear that a representative sample for Borno was not possible. However, it was decided to proceed with conducting the survey in areas that the teams could access in order to collect some information on the parts of the state that were accessible.

The limited area that field staff could safely operate in in Borno necessitated an alternative sample selection process from the other states. The EA selection occurred in several stages. Initially, an attempt was made to limit the frame to selected LGAs that were considered accessible. However, after selection of the EAs from the identified LGAs, it was reported by the NBS listing teams that a large share of the selected EAs were not safe for them to visit. Therefore, an alternative approach was adopted that would better ensure the safety of the field team but compromise further the representativeness of the sample. First, the list of 788 EAs in the LGA master sample for Borno were reviewed by NBS staff in Borno and the EAs they deemed accessible were identified. The team identified 359 EAs (46%) that were accessible. These 359 EAs served as the frame for the Borno sample and 60 EAs were randomly selected from this frame. However, throughout the course of the NLSS fieldwork, additional insurgency related events occurred which resulted in 7 of the 60 EAs being inaccessible when they were to be visited. Unlike for the main sample, these EAs were not replaced. Therefore, 53 EAs were ultimately covered from the Borno sample. The listing and household selection process that followed was the same as for the rest of the states.

Mode of data collection

Computer Assisted Personal Interview [capi]

Research instrument

Two sets of questionnaires – household and community – were used to collect information in the NLSS2018/19. The Household Questionnaire was administered to all households in the sample. The Community Questionnaire was administered to the community to collect information on the socio-economic indicators of the enumeration areas where the sample households reside.

Household Questionnaire: The Household Questionnaire provides information on demographics; education; health; labour; food and non-food expenditure; household nonfarm income-generating activities; food security and shocks; safety nets; housing conditions; assets; information and communication technology; agriculture and land tenure; and other sources of household income.

Community Questionnaire: The Community Questionnaire solicits information on access to transported and infrastructure; community organizations; resource management; changes in the community; key events; community needs, actions and achievements; and local retail price information.

Cleaning operations

CAPI: The 2018/19 NLSS was conducted using the Survey Solutions Computer Assisted Person Interview (CAPI) platform. The Survey Solutions software was developed and maintained by the Development Economics Data Group (DECDG) at the World Bank. Each interviewer and supervisor was given a tablet