STIR Challenge 2024 Dataset

This is the STIR Challenge 2024 (STIRC2024) dataset for evaluating tracking and reconstruction methods. This a new, previously unreleased, dataset that was used in the STIR Challenge 2024 at MICCAI's EndoVis. This data has the same format as the larger STIR training and validation dataset (STIROrig). Dataset info for STIRC2024 is in the 2024 Challenge arxiv paper
The STIR training and validation dataset (STIROrig) details are available in the dataset curation and creation arxiv paper. A download link for STIROrig can be found here: https://dx.doi.org/10.21227/w8g4-g548

Challenge Paper Link:

https://arxiv.org/abs/2503.24306

Data Description

This dataset includes multiple collections (folders). Each collection includes multiple clips with stereo videos.
Under each of 'left' and 'right' folders are:
seq** folders (seq00-seq14, for example). Each 'seq' folder corresponds to an action.
For example, left/seq01 corresponds to the same recording as right/seq01 for the right camera. All images and videos are stereo rectified, and camera calibration is also provided in `calib.json`.

Each 'seq**' folder contains:
- frames (a folder containing visible light video as a mp4)
- segmentation (contains start and end binary segmentation pngs)
- icgstartseg.png (start segmentation)
- icgendseg.png (finish segmentation)
-

Quantification

Use the STIRMetrics repo to assist with quantification, we use the TAP-Vid metric of average accuracy, δx, over thresholds. The 2D metric is averaged over accuracy thresholds of [4, 8, 16, 32, 64] pixels. The 3D metric is averaged over accuracy thresholds of [2, 4, 8, 16, 32] millimetres.

Refer to the challenge paper for additional analysis.

Terms

By using this dataset, you agree to cite the 2024 challenge paper:

@misc{schmidtpointtrackingsurgerythe2024,
title={Point Tracking in Surgery--The 2024 Surgical Tattoos in Infrared (STIR) Challenge},
author={Adam Schmidt and Mert Asim Karaoglu and Soham Sinha and Mingang Jang and Ho-Gun Ha and Kyungmin Jung and Kyeongmo Gu and Ihsan Ullah and Hyunki Lee and Jonáš Šerých and Michal Neoral and Jiří Matas and Rulin Zhou and Wenlong He and An Wang and Hongliang Ren and Bruno Silva and Sandro Queirós and Estêvão Lima and João L. Vilaça and Shunsuke Kikuchi and Atsushi Kouno and Hiroki Matsuzaki and Tongtong Li and Yulu Chen and Ling Li and Xiang Ma and Xiaojian Li and Mona Sheikh Zeinoddin and Xu Wang and Zafer Tandogdu and Greg Shaw and Evangelos Mazomenos and Danail Stoyanov and Yuxin Chen and Zijian Wu and Alexander Ladikos and Simon DiMaio and Septimiu E. Salcudean and Omid Mohareri},
year={2025},
eprint={2503.24306},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2503.24306},
}

And the initial dataset paper:

@article{schmidt2024surgical,
title={Surgical Tattoos in Infrared: A Dataset for Quantifying Tissue Tracking and Mapping},
author={Schmidt, Adam and Mohareri, Omid and DiMaio, Simon and Salcudean, Septimiu E},
journal={IEEE Transactions on Medical Imaging},
year={2024},
publisher={IEEE}
}

The global home smart stir-frying machine market is experiencing robust growth, driven by increasing consumer demand for convenient and healthy cooking solutions. The rising adoption of smart home appliances, coupled with the growing popularity of stir-frying as a quick and nutritious cooking method, is fueling market expansion. Technological advancements, such as improved automation features, precise temperature control, and smartphone integration, are enhancing the user experience and driving product adoption. The market is segmented by application (online and offline sales) and type (semi-automatic and fully-automatic), with fully automatic models experiencing faster growth due to their ease of use and time-saving benefits. Key players like DadCooker, FanLai, and Joyoung are investing heavily in research and development to introduce innovative features and expand their market share. Geographic growth is particularly strong in Asia-Pacific, driven by high population density and rising disposable incomes, especially in countries like China and India. While the North American and European markets exhibit steady growth, their market share is relatively smaller compared to the Asia-Pacific region. Challenges include the relatively high initial cost of smart stir-frying machines compared to traditional models and potential consumer concerns regarding technological complexity and maintenance. However, the long-term outlook remains positive, with a projected continued strong Compound Annual Growth Rate (CAGR) throughout the forecast period (2025-2033). The market's growth trajectory is influenced by several factors. The increasing prevalence of busy lifestyles and dual-income households is driving the demand for time-saving kitchen appliances. Furthermore, consumers are increasingly prioritizing healthy eating habits, leading to a preference for cooking methods that preserve nutrients and minimize oil usage. The incorporation of smart features, such as recipe suggestions, pre-programmed cooking settings, and remote control capabilities, adds significant value to these appliances and contributes to increased consumer appeal. Competition is likely to intensify as more players enter the market, leading to innovation and price reductions. This competitive landscape will ultimately benefit consumers, providing a wider range of options at increasingly competitive price points. Future market success will depend on manufacturers' ability to innovate, adapt to changing consumer preferences, and effectively address challenges related to pricing and consumer education.