Abstract

The Consumer price surveys primarily provide the following: Data on CPI in Palestine covering the West Bank, Gaza Strip and Jerusalem J1 for major and sub groups of expenditure. Statistics needed for decision-makers, planners and those who are interested in the national economy. Contribution to the preparation of quarterly and annual national accounts data.

Consumer Prices and indices are used for a wide range of purposes, the most important of which are as follows: Adjustment of wages, government subsidies and social security benefits to compensate in part or in full for the changes in living costs. To provide an index to measure the price inflation of the entire household sector, which is used to eliminate the inflation impact of the components of the final consumption expenditure of households in national accounts and to dispose of the impact of price changes from income and national groups. Price index numbers are widely used to measure inflation rates and economic recession. Price indices are used by the public as a guide for the family with regard to its budget and its constituent items. Price indices are used to monitor changes in the prices of the goods traded in the market and the consequent position of price trends, market conditions and living costs. However, the price index does not reflect other factors affecting the cost of living, e.g. the quality and quantity of purchased goods. Therefore, it is only one of many indicators used to assess living costs. It is used as a direct method to identify the purchasing power of money, where the purchasing power of money is inversely proportional to the price index.

Geographic coverage

Palestine West Bank Gaza Strip Jerusalem

Analysis unit

The target population for the CPI survey is the shops and retail markets such as grocery stores, supermarkets, clothing shops, restaurants, public service institutions, private schools and doctors.

Universe

The target population for the CPI survey is the shops and retail markets such as grocery stores, supermarkets, clothing shops, restaurants, public service institutions, private schools and doctors.

Kind of data

Sample survey data [ssd]

Sampling procedure

A non-probability purposive sample of sources from which the prices of different goods and services are collected was updated based on the establishment census 2017, in a manner that achieves full coverage of all goods and services that fall within the Palestinian consumer system. These sources were selected based on the availability of the goods within them. It is worth mentioning that the sample of sources was selected from the main cities inside Palestine: Jenin, Tulkarm, Nablus, Qalqiliya, Ramallah, Al-Bireh, Jericho, Jerusalem, Bethlehem, Hebron, Gaza, Jabalia, Dier Al-Balah, Nusseirat, Khan Yunis and Rafah. The selection of these sources was considered to be representative of the variation that can occur in the prices collected from the various sources. The number of goods and services included in the CPI is approximately 730 commodities, whose prices were collected from 3,200 sources. (COICOP) classification is used for consumer data as recommended by the United Nations System of National Accounts (SNA-2008).

Sampling deviation

Not apply

Mode of data collection

Computer Assisted Personal Interview [capi]

Research instrument

A tablet-supported electronic form was designed for price surveys to be used by the field teams in collecting data from different governorates, with the exception of Jerusalem J1. The electronic form is supported with GIS, and GPS mapping technique that allow the field workers to locate the outlets exactly on the map and the administrative staff to manage the field remotely. The electronic questionnaire is divided into a number of screens, namely: First screen: shows the metadata for the data source, governorate name, governorate code, source code, source name, full source address, and phone number. Second screen: shows the source interview result, which is either completed, temporarily paused or permanently closed. It also shows the change activity as incomplete or rejected with the explanation for the reason of rejection. Third screen: shows the item code, item name, item unit, item price, product availability, and reason for unavailability. Fourth screen: checks the price data of the related source and verifies their validity through the auditing rules, which was designed specifically for the price programs. Fifth screen: saves and sends data through (VPN-Connection) and (WI-FI technology).

In case of the Jerusalem J1 Governorate, a paper form has been designed to collect the price data so that the form in the top part contains the metadata of the data source and in the lower section contains the price data for the source collected. After that, the data are entered into the price program database.

Cleaning operations

The price survey forms were already encoded by the project management depending on the specific international statistical classification of each survey. After the researcher collected the price data and sent them electronically, the data was reviewed and audited by the project management. Achievement reports were reviewed on a daily and weekly basis. Also, the detailed price reports at data source levels were checked and reviewed on a daily basis by the project management. If there were any notes, the researcher was consulted in order to verify the data and call the owner in order to correct or confirm the information.

At the end of the data collection process in all governorates, the data will be edited using the following process: Logical revision of prices by comparing the prices of goods and services with others from different sources and other governorates. Whenever a mistake is detected, it should be returned to the field for correction. Mathematical revision of the average prices for items in governorates and the general average in all governorates. Field revision of prices through selecting a sample of the prices collected from the items.

Response rate

Not apply

Sampling error estimates

The findings of the survey may be affected by sampling errors due to the use of samples in conducting the survey rather than total enumeration of the units of the target population, which increases the chances of variances between the actual values we expect to obtain from the data if we had conducted the survey using total enumeration. The computation of differences between the most important key goods showed that the variation of these goods differs due to the specialty of each survey. For example, for the CPI, the variation between its goods was very low, except in some cases such as banana, tomato, and cucumber goods that had a high coefficient of variation during 2019 due to the high oscillation in their prices. The variance of the key goods in the computed and disseminated CPI survey that was carried out on the Palestine level was for reasons related to sample design and variance calculation of different indicators since there was a difficulty in the dissemination of results by governorates due to lack of weights. Non-sampling errors are probable at all stages of data collection or data entry. Non-sampling errors include: Non-response errors: the selected sources demonstrated a significant cooperation with interviewers; so, there wasn't any case of non-response reported during 2019. Response errors (respondent), interviewing errors (interviewer), and data entry errors: to avoid these types of errors and reduce their effect to a minimum, project managers adopted a number of procedures, including the following: More than one visit was made to every source to explain the objectives of the survey and emphasize the confidentiality of the data. The visits to data sources contributed to empowering relations, cooperation, and the verification of data accuracy. Interviewer errors: a number of procedures were taken to ensure data accuracy throughout the process of field data compilation: Interviewers were selected based on educational qualification, competence, and assessment. Interviewers were trained theoretically and practically on the questionnaire. Meetings were held to remind interviewers of instructions. In addition, explanatory notes were supplied with the surveys. A number of procedures were taken to verify data quality and consistency and ensure data accuracy for the data collected by a questioner throughout processing and data entry (knowing that data collected through paper questionnaires did not exceed 5%): Data entry staff was selected from among specialists in computer programming and were fully trained on the entry programs. Data verification was carried out for 10% of the entered questionnaires to ensure that data entry staff had entered data correctly and in accordance with the provisions of the questionnaire. The result of the verification was consistent with the original data to a degree of 100%. The files of the entered data were received, examined, and reviewed by project managers before findings were extracted. Project managers carried out many checks on data logic and coherence, such as comparing the data of the current month with that of the previous month, and comparing the data of sources and between governorates. Data collected by tablet devices were checked for consistency and accuracy by applying rules at item level to be checked.

Data appraisal

Other technical procedures to improve data quality: Seasonal adjustment processes

Index figures on production prices of dwellings and other buildings reflect the relation between the output value and the output volume and can be used to convert the value of construction output from current prices to fixed prices. The output price index is derived from the series "New dwellings; output indices 2000=100". From the 2nd quarter 2009 on, the figures of the series 2005 = 100 are used and linked to the series 2000 = 100. Statistics Netherlands publishes data on the value of construction output. The volume of construction output, however, cannot be deduced from the value, which is subject to price changes. The price index on the building costs of new dwellings eliminates the effect of price changes. The price index on construction output is calculated by distributing the value of the output (current prices) over the quarters essential to the price setting of the building project. Subsequently, the quarterly output is calculated in fixed prices by using the price index on the building costs of new dwellings. The index figure of the output price is the sum of the current prices divided by the sum of the fixed prices (*100).

Possibilities for selection: - Total construction - Total construction of new dwellings/buildings - New dwellings - New buildings in the private sector - New buildings in the non-commercial sector - Total other buildings - Other dwellings - Other buildings in the private sector - Other buildings in the non-commercial sector

Data available from 1st quarter 2000 till 4th quarter 2016 Frequency: discontinued

Status of the figures: The figures of 2016 are provisional. Since this table has been discontinued, the data will not become definitive.

Changes as of January 29 2018 None, this table is discontinued.

When will new figures become available? This table is succeeded by Production on buildings; price index 2015 = 100. See paragraph 3.

Linking recommendation If you want to compile long-term series with linked price indices on production of buildings, you can link the figures on price level 1995 with the figures on price level 2000. For that, the percentage change from the 2nd quarter 2005 with the 1st quarter 2005 must be calculated, as the price index for the 1st quarter 2005 is the last figure published on price level 1995. This change must then be adjusted to the figures for the 1st quarter 2005 of the series 1995. The 2nd quarter index of the linked series is calculated by calculating the difference between the 1st quarter 2005 and the 2nd quarter 2005 according to the series on price level 2000 and multiplying this by the index for the 1st quarter 2005 according to the series on price level 1995.

In the example: (119/120) x 148=147 (rounded). For the 3rd quarter 2005 the index is calculated analogously, where because of rounding problems the first quarter figures must be used for the link.

The Consumer Price Index (CPI) is a measure of the average change over time in the prices paid by urban consumers for a market basket of consumer goods and services. Indexes are available for the U.S. and various geographic areas. Average price data for select utility, automotive fuel, and food items are also available. Prices for the goods and services used to calculate the CPI are collected in 75 urban areas throughout the country and from about 23,000 retail and service establishments. Data on rents are collected from about 43,000 landlords or tenants. More information and details about the data provided can be found at http://www.bls.gov/cpi

The Consumer price index (CPI) all households, calculated by Statistics Netherlands, measures the average price changes of goods and services purchased by households. The index is an important criterion for inflation, frequently used by trade and industry, employers' organisations, trade unions and government. The index is for instance, used to make adjustments to wages, tax tablesand index-linked rent increases, annuities, etc.

Data available from: January 1996 till December 2015

Status of the figures: The figures in this table are final.

Changes as of 18 May 2016: None, this table is stopped.

Changes from 7 January 2016: New figures added.

Changes from 10 December 2015: On 1 October 2015, the points system for the pricing of rental homes was adjusted by the Dutch national government. As a direct consequence, rental prices of a limited number of dwellings were reduced, which had a downward effect on the average rental price. The effect of this decrease on the rental price indices and imputed rent value could not be determined in time because housing associations announced the impact of rent adjustments only in November. For this reason, the figures of the groups 04100 ‘Actual rentals for housing’ and 04200 ‘Imputed rent value’ over October 2015 have now been adjusted.

The figures of the groups 061100 ‘Pharmaceutical products’, 061200 ‘Other medical products, equipment’, 072200 ‘Fuels and lubricants’ and 083000 ‘Telephone and internet services’ over the months June through September 2015 have been corrected. This has no impact on the headline indices.

The derived CPI decreased by 0.01 index point over August 2015.

When will new figures be published? Not applicable. This table is succeeded by Consumer prices; price index 2015=100. See paragraph 3.

This table shows the price indices, quarterly and yearly changes in prices of services that companies provide. The figures are broken down by type of services according to the Classification of Products by Activity (CPA 2015 version 2.1). For some services, a further breakdown has been made on the basis of market data that differ from the CPA. This breakdown is indicated with a letter after the CPA-code.

The base year for all Services producer price indices is 2021. The year average, quarterly and yearly changes are calculated with unrounded figures.

Data available from: 4th quarter 2002.

Status of the figures: The figures for the most recent quarter are provisional. These figures are made definite in the publication for the subsequent quarter.

Changes as of November 14 2025: The provisional figures of the 3rd quarter 2025 are published for approximately half of the branches. All previous figures are made definite. For all other branches the figures of the 3rd quarter 2025 are available at a later date.

When will new figures be published? New figures are available twice per quarter. Halfway each quarter, the results of the pricing method Model pricing (around half of the branches) are published and the other branches with the Unit value method follow at the end of the quarter. This concerns the price development of the previous quarter. The Services producer price index of the total commercial services is also calculated and published at the end of each quarter.

The Services producer price indices publication schedule can be downloaded as an Excel file under section: 3 Relevant articles. More information about the pricing method can be found in the video under section: 3 Relevant articles.

This table provides information on price developments in the construction industry. Data were calculated by Statistic Netherlands (CBS) and are based on building permits with a value of 50 thousand euros or more issued by municipal authorities, and the reported construction costs as stated in the permits. On the basis of these building permits and the construction time, construction output is calculated by means of average waiting times prior to the start of the construction activities. Price indices listed in the table are used to eliminate the effect of price changes on the construction output. Therefore, the price index can be used to as a deflator to calculate volume developments in the building sector. Price indices are calculated for two sections (Construction of new buildings and Other buildings) and three sectors (dwellings, buildings for the private sector and buildings for the (semi-)public or non-commercial sector).

Data available from: 1st quarter 2015

Status of the figures: Price index figures up to and including the 3rd quarter 2024 are final.

Changes since 30 October 2025: The figures of the 3rd quarter 2025 have been added to the table.

When will new figures become available? Provisional figures for the 4th quarter of 2025 will be released in January 2026.

Here 3 DataSet for a complete overview of the economy of the country you are interested in.

Big Mac Index, Inflation forecast and Average Salary

https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F9770082%2F647d322e2641c1d6775c0ff85e5c25c4%2FFrame%205464.jpg?generation=1672569268052034&alt=media" alt="">

Big Mac Index

The Big Mac index was invented by The Economist in 1986 as a lighthearted guide to whether currencies are at their “correct” level. It is based on the theory of purchasing-power parity (PPP). By diverting the average national Big Mac prices to U.S. dollars, the same goods can be informally compared. So when the price of a burger is considered, the economic value of all these factors is accounted for. Thus, comparing the prices of similar burgers in two countries reflects a region’s cost of living and affordability. This is the theory behind Burgernomics.

https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F9770082%2F53d7d4b1424ab7a612441c1e34c7981a%2Fimage%20189.jpg?generation=1672580570370966&alt=media" alt="">

Inflation forecast

Inflation forecast is measured in terms of the consumer price index (CPI) or harmonised index of consumer prices (HICP) for euro area countries, the euro area aggregate and the United Kingdom. Inflation measures the general evolution of prices. It is defined as the change in the prices of a basket of goods and services that are typically purchased by households. Projections are based on an assessment of the economic climate in individual countries and the world economy, using a combination of model-based analyses and expert judgement. The indicator is expressed in annual growth rates.

https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F9770082%2Fae643f12918f0d2483aee5d18e218f69%2Fimage%20190.jpg?generation=1672582503068978&alt=media" alt="">

Average Salary (income)

The average salary is calculated based on reported salaries of respondents. The average salary definition is to add the salaries in the sample together, then divide by the number of respondents. The result is the average salary for everyone surveyed.

Consumer Price Index CPI in the United States increased to 324.80 points in September from 323.98 points in August of 2025. This dataset provides the latest reported value for - United States Consumer Price Index (CPI) - plus previous releases, historical high and low, short-term forecast and long-term prediction, economic calendar, survey consensus and news.

The historical series 'New dwellings; input price indices of building costs 2000 = 100, from 1990' shows the development of the costs (wages and materials) involved in building new dwellings in the Netherlands, and has become available by linking series which were calculated separately in the past. An input price index is based on price changes in several cost components involved in realising a product, in this case a new dwelling. Changes in other cost components such as building equipment (tools and machines), general costs, profits and risk are not included in the index. Other cost components, such as energy and transport, are also not taken into account as their influence on the final cost price is relatively modest. Land costs are also not included in the index.

From 1990 to December 1994 only figures of the materials are available. From 1995 onwards this series also includes wage figures. Also from 1995, figures are also available on total building costs by weighted aggregetion of these two series.

Data available from: - Materials: January 1990 - Wages: January 1995 - Total building costs: January 1995

Status of the figures: The price index figures for wages and the total construction costs are final until 2024. The figures for building materials are final until May 2025.

Changes as of November 28th, 2025: Figures of October 2025 have been added. Due to an improvement in the calculation method, some index figures are revised by a maximum of 0.4 index point. The improvement relates to the aggregation of sub series.

Changes as of November 29th, 2024: Since this publication, a switch has been made to a different rounding strategy, whereby the changes are calculated on unrounded index figures and annual figures are calculated from rounded and published figures. With this switch there is more consistency with other statistics on Statline and statistics from Eurostat. As a result, mutations have changed across the entire series.

When will new figures be published? New figures are published about 30 days after the month under review.

This dataset includes soil wet aggregate stability measurements from the Upper Mississippi River Basin LTAR site in Ames, Iowa. Samples were collected in 2021 from this long-term tillage and cover crop trial in a corn-based agroecosystem. We measured wet aggregate stability using digital photography to quantify disintegration (slaking) of submerged aggregates over time, similar to the technique described by Fajardo et al. (2016) and Rieke et al. (2021). However, we adapted the technique to larger sample numbers by using a multi-well tray to submerge 20-36 aggregates simultaneously. We used this approach to measure slaking index of 160 soil samples (2120 aggregates). This dataset includes slaking index calculated for each aggregates, and also summarized by samples. There were usually 10-12 aggregates measured per sample. We focused primarily on methodological issues, assessing the statistical power of slaking index, needed replication, sensitivity to cultural practices, and sensitivity to sample collection date. We found that small numbers of highly unstable aggregates lead to skewed distributions for slaking index. We concluded at least 20 aggregates per sample were preferred to provide confidence in measurement precision. However, the experiment had high statistical power with only 10-12 replicates per sample. Slaking index was not sensitive to the initial size of dry aggregates (3 to 10 mm diameter); therefore, pre-sieving soils was not necessary. The field trial showed greater aggregate stability under no-till than chisel plow practice, and changing stability over a growing season. These results will be useful to researchers and agricultural practitioners who want a simple, fast, low-cost method for measuring wet aggregate stability on many samples.

This table includes figures on year-on-year developments of expenditure categories of the Harmonised consumer price index (HICP). This table also contains the weighting coefficient. The weighting coefficient shows how many consumers in the Netherlands spend on a product group in relation to their total expenditure.

Furthermore, the table shows the contribution and impact of HICP categories. The contributions of the separate groups add up to the total annual rate of change and show the share of price increases. The impact, on the other hand, answers the question how much higher or lower the annual rate of change would have been, if a specific category would not have been taken into account in calculation. These figures are shown for 139 product groups. Furthermore, 34 combinations of product groups (special aggregates) are displayed.

HICP figures are published every month. In addition, an annual figure is published at the end of the year. The HICP of a calendar year is calculated as the average of the indices of the twelve months of that year.

Data available from: January 2016.

Status of the figures: The HICP figures in this table are in most cases final immediately upon publication. The figures of the HICP are only marked as provisional in the second publication if it is already known at the time of publication that data are still incomplete, a revision is expected in a later month, or in special circumstances such as the corona crisis.

In most cases, all requested price information is known to Statistics Netherlands when the results are published and no adjustment is made later. However, sometimes certain price information is not available in time and the outcome can be adjusted later. HICP results can then always be revised together with the CPI results, even if they were not published as provisional in the previous month. CPI results are marked as provisional when the index figures are first published, the figures are final the following month.

Changes compared with previous version: Data on the most recent period have been added and/or adjustments have been implemented.

Changes as of 9 June 2022: The unit of the contribution to annual rate of change and the impact on the annual rate of change has been adjusted to 'percentage point'. Previously, the unit was incorrectly referred to as 'percent' in the table.

When will new figures be published? New figures will usually be published between the first and second Thursday of the month following on the reporting month.

All CPI and HICP publications are announced on the publication calendar.

This table includes all price index numbers calculated according to the Harmonised consumer price index (HICP) for the Netherlands, the Euro area and the European Union (EU). In all member states of the EU, these indices are compiled in a similar manner to facilitate comparison between the various EU countries.

The table also includes the harmonised consumer price index for the Euro area. This index figure reflects the average price increase/decrease in the countries which have adopted the euro as their currency. The table also includes the European consumer price index, i.e. the harmonised consumer price index for the member states of the European Union.

HICP figures are published every month. In addition, an annual figure is published at the end of the year. The HICP of a calendar year is calculated as the average of the indices of the twelve months of that year.

Data available from: January 1996.

Status of the figures: The HICP results for the Netherlands in this table are in most cases final immediately upon publication. At that time, the results for the euro area are still based on the flash estimate and are characterized as provisional. A month later, these figures become final.

The results of the HICP are only marked as provisional if it is already known at the time of publication that data are still incomplete, a revision is expected in a later month, or in special circumstances such as the corona crisis.

In most cases, all requested price information is known to Statistics Netherlands when the results are published and no adjustment is made later. However, sometimes certain price information is not available in time and the outcome can be adjusted later. HICP results can then always be revised together with the CPI results, even if they were not published as provisional in the previous month. CPI results are marked as provisional when the index figures are first published, the figures are final the following month.

Changes compared with previous version: Data on the most recent period have been added and/or adjustments have been implemented.

When will new figures be published? New figures will usually be published between the first and second Thursday of the month following on the reporting month.

All CPI and HICP publications are announced on the publication calendar.

The price index for existing own dwellings (in Dutch PBK) aims to reflect the changes in prices of the sold existing own dwellings. The dwelling must be located on Dutch territory and sold to a private person. In addition, figures on the number of transactions, the average selling price, and the total value of the selling prices of the sold homes are also available. The price index figures for existing homes are based on a comprehensive registration of home sales transactions by the Kadaster and the WOZ values of all homes in the Netherlands. Index series can fluctuate. It is advisable to use the long-term trends of the price index figures. The average selling price may show a different trend than the price index for existing homes. The development of the average selling price is not an indicator of the price development of existing homes.

Data available from: January 1995

Status of the figures: The figures in this table are immediately definitive. The calculation of these figures is based on the number of notary transactions that are registered every month by the Dutch Land Registry Office (Kadaster). A revision of the figures is exceptional and occurs specifically if an error significantly exceeds the acceptable statistical margins. The numbers of existing owner-occupied sold homes can be recalculated by Kadaster at a later date. These figures are usually the same as the publication on Statline, but in some periods they differ. Kadaster calculates the average purchasing prices based on the most recent data. These may have changed since the first publication. Statistics Netherlands uses figures from the first publication in accordance with the revision policy described above.

Changes as of 21 November 2025: New figures for October 2025 are added.

When will new figures be published? New figures are published about 22 days after the period under review.

Description

Dataset consists of data in categories walking, running, biking, skiing, and roller skiing (5). Sport activities have been recorded by an individual active (non-competitive) athlete. Data is pre-processed, standardized and splitted in four parts (each dimension in its own file): * HR-DATA_std_1140x69 (heart rate signals) * SPD-DATA_std_1140x69 (speed signals) * ALT-DATA_std_1140x69 (altitude signals) * META-DATA_1140x4 (labels and details)

NOTE: Signal order between the separate files must not be confused when processing the data. Signal order is critical; first index in each of the file comes from the same activity which label corresponds to first index in the target data file, and so on. So, data should be constructed and files combined into the same table while reading the files, ideally using nested data structure. Something like in the picture below:

You may check the related TSC projects in GitHub: - "https://github.com/JABE22/MasterProject">Sport Activity Classification Using Classical Machine Learning and Time Series Methods - Symbolic Representation of Multivariate Time Series Signals in Sport Activity Classification - Kaggle Project

https://mediauploads.data.world/e1ccd4d36522e04c0061d12d05a87407bec80716f6fe7301991eaaccd577baa8_mts_data.png" alt="Nested data structure for multivariate time series classifiers">

In the following picture one can see five signal samples for each dimension (Heart Rate, Speed, Altitude) in standard feature value format. So, each figure contains signal from five different random activities (can be same or different category). However, for example, signal indexes number 1 in each three figure are from the same activity. Figures just visualizes what kind of signals dataset consists. They do not have any particular meaning.

https://mediauploads.data.world/162b7086448d8dbd202d282014bcf12bd95bd3174b41c770aa1044bab22ad655_signal_samples.png" alt="Signals from sport activities (Heart Rate, Speed, and Altitude)">

Dataset size and construction procedure

The original amount of sport activities is 228. From each of them, starting from the index 100 (seconds), have been picked 5 x 69 second consecutive segments, that is expressed as a formula below:

https://mediauploads.data.world/68ce83092ec65f6fbaee90e5de6e12df40498e08fa6725c111f1205835c1a842_segment_equation.png" alt="Data segmentation and augmentation formula">

where 𝐷 = 𝑜𝑟𝑖𝑔𝑖𝑛𝑎𝑙 𝑓𝑖𝑙𝑡𝑒𝑟𝑒𝑑 𝑑𝑎𝑡𝑎 ,𝑁 = 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑎𝑐𝑡𝑖𝑣𝑖𝑡𝑖𝑒𝑠 , 𝑠 = 𝑠𝑒𝑔𝑚𝑒𝑛𝑡 𝑠𝑡𝑎𝑟𝑡 𝑖𝑛𝑑𝑒𝑥 , 𝑙 = 𝑠𝑒𝑔𝑚𝑒𝑛𝑡 𝑙𝑒𝑛𝑔𝑡ℎ, and 𝑛 = 𝑡ℎ𝑒 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑠𝑒𝑔𝑚𝑒𝑛𝑡𝑠 from a single original sequence 𝐷𝑖 , resulting the new set of equal length segments 𝐷𝑠𝑒𝑔. And in this certain case the equation takes the form of:

https://mediauploads.data.world/63dd87bf3d0010923ad05a8286224526e241b17bbbce790133030d8e73f3d3a7_data_segmentation_formula.png" alt="Data segmentation and augmentation formula with values">

Thus, dataset has dimesions of 1140 x 69 x 3.

Additional information

Data has been recorded without knowing it will be used in research, therefore it represents well real-world application of data source and can provide excellent tool to test algorithms in real data.

Recording devices

Data has been recorded using two type of Garmin devices. Models are Forerunner 920XT and vivosport. Vivosport is activity tracker and measures heart rate from the wrist using optical sensor, whereas 920XT requires external sensor belt (hear rate + inertial) installed under chest when doing exercises. Otherwise devices are not essentially different, they uses GPS location to measure speed and inertial barometer to measure elevation changes.

Device manuals - Garmin FR-920XT - Garmin Vivosport

Person profile

Age: 30-31, Weight: 82, Length: 181, Active athlete (non-competitive)

"We believe that by accounting for the inherent uncertainty in the system during each measurement, the relationship between cause and effect can be assessed more accurately, potentially reducing the duration of research."

Short description

This dataset was created as part of a research project investigating the efficiency and learning mechanisms of a Bayesian adaptive search algorithm supported by the Imprecision Entropy Indicator (IEI) as a novel method. It includes detailed statistical results, posterior probability values, and the weighted averages of IEI across multiple simulations aimed at target localization within a defined spatial environment. Control experiments, including random search, random walk, and genetic algorithm-based approaches, were also performed to benchmark the system's performance and validate its reliability.

The task involved locating a target area centered at (100; 100) within a radius of 10 units (Research_area.png), inside a circular search space with a radius of 100 units. The search process continued until 1,000 successful target hits were achieved.

To benchmark the algorithm's performance and validate its reliability, control experiments were conducted using alternative search strategies, including random search, random walk, and genetic algorithm-based approaches. These control datasets serve as baselines, enabling comprehensive comparisons of efficiency, randomness, and convergence behavior across search methods, thereby demonstrating the effectiveness of our novel approach.

Uploaded files

The first dataset contains the average IEI values, generated by randomly simulating 300 x 1 hits for 10 bins per quadrant (4 quadrants in total) using the Python programming language, and calculating the corresponding IEI values. This resulted in a total of 4 x 10 x 300 x 1 = 12,000 data points. The summary of the IEI values by quadrant and bin is provided in the file results_1_300.csv. The calculation of IEI values for averages is based on likelihood, using an absolute difference-based approach for the likelihood probability computation. IEI_Likelihood_Based_Data.zip

The weighted IEI average values for likelihood calculation (Bayes formula) are provided in the file Weighted_IEI_Average_08_01_2025.xlsx

This dataset contains the results of a simulated target search experiment using Bayesian posterior updates and Imprecision Entropy Indicators (IEI). Each row represents a hit during the search process, including metrics such as Shannon entropy (H), Gini index (G), average distance, angular deviation, and calculated IEI values. The dataset also includes bin-specific posterior probability updates and likelihood calculations for each iteration. The simulation explores adaptive learning and posterior penalization strategies to optimize the search efficiency. Our Bayesian adaptive searching system source code (search algorithm, 1000 target searches): IEI_Self_Learning_08_01_2025.pyThis dataset contains the results of 1,000 iterations of a successful target search simulation. The simulation runs until the target is successfully located for each iteration. The dataset includes further three main outputs: a) Results files (results{iteration_number}.csv): Details of each hit during the search process, including entropy measures, Gini index, average distance and angle, Imprecision Entropy Indicators (IEI), coordinates, and the bin number of the hit. b) Posterior updates (Pbin_all_steps_{iter_number}.csv): Tracks the posterior probability updates for all bins during the search process acrosations multiple steps. c) Likelihoodanalysis(likelihood_analysis_{iteration_number}.csv): Contains the calculated likelihood values for each bin at every step, based on the difference between the measured IEI and pre-defined IE bin averages. IEI_Self_Learning_08_01_2025.py

Based on the mentioned Python source code (see point 3, Bayesian adaptive searching method with IEI values), we performed 1,000 successful target searches, and the outputs were saved in the:Self_learning_model_test_output.zip file.

Bayesian Search (IEI) from different quadrant. This dataset contains the results of Bayesian adaptive target search simulations, including various outputs that represent the performance and analysis of the search algorithm. The dataset includes: a) Heatmaps (Heatmap_I_Quadrant, Heatmap_II_Quadrant, Heatmap_III_Quadrant, Heatmap_IV_Quadrant): These heatmaps represent the search results and the paths taken from each quadrant during the simulations. They indicate how frequently the system selected each bin during the search process. b) Posterior Distributions (All_posteriors, Probability_distribution_posteriors_values, CDF_posteriors_values): Generated based on posterior values, these files track the posterior probability updates, including cumulative distribution functions (CDF) and probability distributions. c) Macro Summary (summary_csv_macro): This file aggregates metrics and key statistics from the simulation. It summarizes the results from the individual results.csv files. d) Heatmap Searching Method Documentation (Bayesian_Heatmap_Searching_Method_05_12_2024): This document visualizes the search algorithm's path, showing how frequently each bin was selected during the 1,000 successful target searches. e) One-Way ANOVA Analysis (Anova_analyze_dataset, One_way_Anova_analysis_results): This includes the database and SPSS calculations used to examine whether the starting quadrant influences the number of search steps required. The analysis was conducted at a 5% significance level, followed by a Games-Howell post hoc test [43] to identify which target-surrounding quadrants differed significantly in terms of the number of search steps. Results were saved in the Self_learning_model_test_results.zip

This dataset contains randomly generated sequences of bin selections (1-40) from a control search algorithm (random search) used to benchmark the performance of Bayesian-based methods. The process iteratively generates random numbers until a stopping condition is met (reaching target bins 1, 11, 21, or 31). This dataset serves as a baseline for analyzing the efficiency, randomness, and convergence of non-adaptive search strategies. The dataset includes the following: a) The Python source code of the random search algorithm. b) A file (summary_random_search.csv) containing the results of 1000 successful target hits. c) A heatmap visualizing the frequency of search steps for each bin, providing insight into the distribution of steps across the bins. Random_search.zip

This dataset contains the results of a random walk search algorithm, designed as a control mechanism to benchmark adaptive search strategies (Bayesian-based methods). The random walk operates within a defined space of 40 bins, where each bin has a set of neighboring bins. The search begins from a randomly chosen starting bin and proceeds iteratively, moving to a randomly selected neighboring bin, until one of the stopping conditions is met (bins 1, 11, 21, or 31). The dataset provides detailed records of 1,000 random walk iterations, with the following key components: a) Individual Iteration Results: Each iteration's search path is saved in a separate CSV file (random_walk_results_.csv), listing the sequence of steps taken and the corresponding bin at each step. b) Summary File: A combined summary of all iterations is available in random_walk_results_summary.csv, which aggregates the step-by-step data for all 1,000 random walks. c) Heatmap Visualization: A heatmap file is included to illustrate the frequency distribution of steps across bins, highlighting the relative visit frequencies of each bin during the random walks. d) Python Source Code: The Python script used to generate the random walk dataset is provided, allowing reproducibility and customization for further experiments. Random_walk.zip

This dataset contains the results of a genetic search algorithm implemented as a control method to benchmark adaptive Bayesian-based search strategies. The algorithm operates in a 40-bin search space with predefined target bins (1, 11, 21, 31) and evolves solutions through random initialization, selection, crossover, and mutation over 1000 successful runs. Dataset Components: a) Run Results: Individual run data is stored in separate files (genetic_algorithm_run_.csv), detailing: Generation: The generation number. Fitness: The fitness score of the solution. Steps: The path length in bins. Solution: The sequence of bins visited. b) Summary File: summary.csv consolidates the best solutions from all runs, including their fitness scores, path lengths, and sequences. c) All Steps File: summary_all_steps.csv records all bins visited during the runs for distribution analysis. d) A heatmap was also generated for the genetic search algorithm, illustrating the frequency of bins chosen during the search process as a representation of the search pathways.Genetic_search_algorithm.zip

Technical Information

The dataset files have been compressed into a standard ZIP archive using Total Commander (version 9.50). The ZIP format ensures compatibility across various operating systems and tools.

The XLSX files were created using Microsoft Excel Standard 2019 (Version 1808, Build 10416.20027)

The Python program was developed using Visual Studio Code (Version 1.96.2, user setup), with the following environment details: Commit fabd6a6b30b49f79a7aba0f2ad9df9b399473380f, built on 2024-12-19. The Electron version is 32.6, and the runtime environment includes Chromium 128.0.6263.186, Node.js 20.18.1, and V8 12.8.374.38-electron.0. The operating system is Windows NT x64 10.0.19045.

The statistical analysis included in this dataset was partially conducted using IBM SPSS Statistics, Version 29.0.1.0

The CSV files in this dataset were created following European standards, using a semicolon (;) as the delimiter instead of a comma, encoded in UTF-8 to ensure compatibility with a wide

This table shows the price-indices, the quarterly and the yearly price changes of services that companies provided. There is a breakdown by type of services according to the Coordinated European goods and services classification (CPA). The prices of services are observed in the sectors for which the supply of the service is the main activity.

Included in the producer price indices are: Section I, transport, storage and communication services; Section K, real estate, renting and business services

Not included in producer price indices are: Section G, wholesale and retail trade, repair of motor vehicles and motorcycles; Section H, hotels and restaurants; Section J, financial services.

The index reference year of all producer price indices is 2006. The year average, the quarterly and the yearly changes are calculated with unrounded figures.

Data available form: 2002 4th quarter Frequency: quarterly

Status of the figures: the figures for the most recent period are final.

When will new figures be published: This table is put a stop on 30-6-2012 and continued as the table Price indices services; index 2010 = 100'.

Changes in comparison with last versions From the third quarter of 2010 onwards, a new method is used to calculate Total renting services of automobiles, which falls under the aggregated Renting services of machinery and equipment without operator and of personal and household goods. This method corresponds to the current calculation method of the services price index.

The index relates to costs ruling on the first day of each month. NATIONAL HOUSE CONSTRUCTION COST INDEX; Up until October 2006 it was known as the National House Building Index Oct 2000 data; The index since October, 2000, includes the first phase of an agreement following a review of rates of pay and grading structures for the Construction Industry and the first phase increase under the PPF. April, May and June 2001; Figures revised in July 2001due to 2% PPF Revised Terms. March 2002; The drop in the March 2002 figure is due to a decrease in the rate of PRSI from 12% to 10¾% with effect from 1 March 2002. The index from April 2002 excludes the one-off lump sum payment equal to 1% of basic pay on 1 April 2002 under the PPF. April, May, June 2003; Figures revised in August'03 due to the backdated increase of 3% from 1April 2003 under the National Partnership Agreement 'Sustaining Progress'. The increases in April and October 2006 index are due to Social Partnership Agreement "Towards 2016". March 2011; The drop in the March 2011 figure is due to a 7.5% decrease in labour costs. Methodology in producing the Index Prior to October 2006: The index relates solely to labour and material costs which should normally not exceed 65% of the total price of a house. It does not include items such as overheads, profit, interest charges, land development etc. The House Building Cost Index monitors labour costs in the construction industry and the cost of building materials. It does not include items such as overheads, profit, interest charges or land development. The labour costs include insurance cover and the building material costs include V.A.T. Coverage: The type of construction covered is a typical 3 bed-roomed, 2 level local authority house and the index is applied on a national basis. Data Collection: The labour costs are based on agreed labour rates, allowances etc. The building material prices are collected at the beginning of each month from the same suppliers for the same representative basket. Calculation: Labour and material costs for the construction of a typical 3 bed-roomed house are weighted together to produce the index. Post October 2006: The name change from the House Building Cost Index to the House Construction Cost Index was introduced in October 2006 when the method of assessing the materials sub-index was changed from pricing a basket of materials (representative of a typical 2 storey 3 bedroomed local authority house) to the CSO Table 3 Wholesale Price Index. The new Index does maintains continuity with the old HBCI. The most current data is published on these sheets. Previously published data may be subject to revision. Any change from the originally published data will be highlighted by a comment on the cell in question. These comments will be maintained for at least a year after the date of the value change. Oct 2008 data; Decrease due to a fall in the Oct Wholesale Price Index. .hidden { display: none }

This dataset contains all data and code necessary to reproduce the analysis presented in the manuscript: Winzeler, H.E., Owens, P.R., Read Q.D.., Libohova, Z., Ashworth, A., Sauer, T. 2022. 2022. Topographic wetness index as a proxy for soil moisture in a hillslope catena: flow algorithms and map generalization. Land 11:2018. DOI: 10.3390/land11112018. There are several steps to this analysis. The relevant scripts for each are listed below. The first step is to use the raw digital elevation data (DEM) to produce different versions of the topographic wetness index (TWI) for the study region (Calculating TWI). Then, these TWI output files are processed, along with soil moisture (volumetric water content or VWC) time series data from a number of sensors located within the study region, to create analysis-ready data objects (Processing TWI and VWC). Next, models are fit relating TWI to soil moisture (Model fitting) and results are plotted (Visualizing main results). A number of additional analyses were also done (Additional analyses). Input data The DEM of the study region is archived in this dataset as SourceDem.zip. This contains the DEM of the study region (DEM1.sgrd) and associated auxiliary files all called DEM1.* with different extensions. In addition, the DEM is provided as a .tif file called USGS_one_meter_x39y400_AR_R6_WashingtonCO_2015.tif. The remaining data and code files are archived in the repository created with a GitHub release on 2022-10-11, twi-moisture-0.1.zip. The data are found in a subfolder called data.

2017_LoggerData_HEW.csv through 2021_HEW.csv: Soil moisture (VWC) logger data for each year 2017-2021 (5 files total). 2882174.csv: weather data from a nearby station. DryPeriods2017-2021.csv: starting and ending days for dry periods 2017-2021. LoggerLocations.csv: Geographic locations and metadata for each VWC logger. Logger_Locations_TWI_2017-2021.xlsx: 546 topographic wetness indexes calculated at each VWC logger location. note: This is intermediate input created in the first step of the pipeline.

Code pipeline To reproduce the analysis in the manuscript run these scripts in the following order. The scripts are all found in the root directory of the repository. See the manuscript for more details on the methods. Calculating TWI

TerrainAnalysis.R: Taking the DEM file as input, calculates 546 different topgraphic wetness indexes using a variety of different algorithms. Each algorithm is run multiple times with different input parameters, as described in more detail in the manuscript. After performing this step, it is necessary to use the SAGA-GIS GUI to extract the TWI values for each of the sensor locations. The output generated in this way is included in this repository as Logger_Locations_TWI_2017-2021.xlsx. Therefore it is not necessary to rerun this step of the analysis but the code is provided for completeness.

Processing TWI and VWC

read_process_data.R: Takes raw TWI and moisture data files and processes them into analysis-ready format, saving the results as CSV. qc_avg_moisture.R: Does additional quality control on the moisture data and averages it across different time periods.

Model fitting Models were fit regressing soil moisture (average VWC for a certain time period) against a TWI index, with and without soil depth as a covariate. In each case, for both the model without depth and the model with depth, prediction performance was calculated with and without spatially-blocked cross-validation. Where cross validation wasn't used, we simply used the predictions from the model fit to all the data.

fit_combos.R: Models were fit to each combination of soil moisture averaged over 57 months (all months from April 2017-December 2021) and 546 TWI indexes. In addition models were fit to soil moisture averaged over years, and to the grand mean across the full study period. fit_dryperiods.R: Models were fit to soil moisture averaged over previously identified dry periods within the study period (each 1 or 2 weeks in length), again for each of the 546 indexes. fit_summer.R: Models were fit to the soil moisture average for the months of June-September for each of the five years, again for each of the 546 indexes.

Visualizing main results Preliminary visualization of results was done in a series of RMarkdown notebooks. All the notebooks follow the same general format, plotting model performance (observed-predicted correlation) across different combinations of time period and characteristics of the TWI indexes being compared. The indexes are grouped by SWI versus TWI, DEM filter used, flow algorithm, and any other parameters that varied. The notebooks show the model performance metrics with and without the soil depth covariate, and with and without spatially-blocked cross-validation. Crossing those two factors, there are four values for model performance for each combination of time period and TWI index presented.

performance_plots_bymonth.Rmd: Using the results from the models fit to each month of data separately, prediction performance was averaged by month across the five years of data to show within-year trends. performance_plots_byyear.Rmd: Using the results from the models fit to each month of data separately, prediction performance was averaged by year to show trends across multiple years. performance_plots_dry_periods.Rmd: Prediction performance was presented for the models fit to the previously identified dry periods. performance_plots_summer.Rmd: Prediction performance was presented for the models fit to the June-September moisture averages.

Additional analyses Some additional analyses were done that may not be published in the final manuscript but which are included here for completeness.

2019dryperiod.Rmd: analysis, done separately for each day, of a specific dry period in 2019. alldryperiodsbyday.Rmd: analysis, done separately for each day, of the same dry periods discussed above. best_indices.R: after fitting models, this script was used to quickly identify some of the best-performing indexes for closer scrutiny. wateryearfigs.R: exploratory figures showing median and quantile interval of VWC for sensors in low and high TWI locations for each water year. Resources in this dataset:Resource Title: Digital elevation model of study region. File Name: SourceDEM.zipResource Description: .zip archive containing digital elevation model files for the study region. See dataset description for more details.Resource Title: twi-moisture-0.1: Archived git repository containing all other necessary data and code . File Name: twi-moisture-0.1.zipResource Description: .zip archive containing all data and code, other than the digital elevation model archived as a separate file. This file was generated by a GitHub release made on 2022-10-11 of the git repository hosted at https://github.com/qdread/twi-moisture (private repository). See dataset description and README file contained within this archive for more details.