ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use

Note: Data viewer is not configured because the large size of the images will trigger loading errors.

  Data Details

Category Abbr. ApplicationEdition & Version OS Icons Texts

Development and Programming

VSC Visual Studio Code 1.95 macOS 22 33

PyC PyCharm 2023.3 macOS 38 40

AS Android Studio 2022.2 macOS 44 36

Qrs Quartus II 13.0… See the full description on the dataset page: https://huggingface.co/datasets/likaixin/ScreenSpot-Pro.

Dataset Card for ScreenSpot-Pro

This is a FiftyOne dataset with 1581 samples.

  Installation

If you haven't already, install FiftyOne: pip install -U fiftyone

  Usage

import fiftyone as fo from fiftyone.utils.huggingface import load_from_hub

Load the dataset

Note: other available arguments include 'max_samples', etc

dataset = load_from_hub("Voxel51/ScreenSpot-Pro")

Launch the App

session = fo.launch_app(dataset)

  Dataset Details… See the full description on the dataset page: https://huggingface.co/datasets/Voxel51/ScreenSpot-Pro.

lmms-lab/ScreenSpot-Pro dataset hosted on Hugging Face and contributed by the HF Datasets community

HongxinLi/ScreenSpot-Pro dataset hosted on Hugging Face and contributed by the HF Datasets community

mikaelnias/screenspot-pro dataset hosted on Hugging Face and contributed by the HF Datasets community

jdubkim/ScreenSpot-Pro dataset hosted on Hugging Face and contributed by the HF Datasets community

pbcong/screenspot-pro-test dataset hosted on Hugging Face and contributed by the HF Datasets community