Open X-Embodiment: Robotic learning datasets and RT-X models

Open X-embodiment Datasset Slice

content:

Berkeley MVP Data Berkeley RPT Data LSMO Dataset CMU Franka Pick-Insert Data

  citation

@misc{open_x_embodiment_rt_x_2023, title={Open {X-E}mbodiment: Robotic Learning Datasets and {RT-X} Models}, author = {Open X-Embodiment Collaboration and Abby O'Neill and Abdul Rehman and Abhinav Gupta and Abhiram Maddukuri and Abhishek Gupta and Abhishek Padalkar and Abraham Lee and Acorn Pooley and Agrim Gupta and Ajay Mandlekar and Ajinkya… See the full description on the dataset page: https://huggingface.co/datasets/xxxxxyang/OXE-slice1-jiahe.

Open X-embodiment Datasset Slice

content:

Robonet DLR Wheelchair Shared Control Stanford Robocook ETH Agent Affordances

  citation

@misc{open_x_embodiment_rt_x_2023, title={Open {X-E}mbodiment: Robotic Learning Datasets and {RT-X} Models}, author = {Open X-Embodiment Collaboration and Abby O'Neill and Abdul Rehman and Abhinav Gupta and Abhiram Maddukuri and Abhishek Gupta and Abhishek Padalkar and Abraham Lee and Acorn Pooley and Agrim Gupta and Ajay Mandlekar and Ajinkya… See the full description on the dataset page: https://huggingface.co/datasets/xxxxxyang/OXE-slice3-jiahe.

Open X-embodiment Datasset Slice

content:

KAIST Nonprehensile Objects Stanford MaskVIT Data DLR Sara Pour Dataset DLR Sara Grid Clamp Dataset ASU TableTop Manipulation Imperial Wrist Cam

  citation

@misc{open_x_embodiment_rt_x_2023, title={Open {X-E}mbodiment: Robotic Learning Datasets and {RT-X} Models}, author = {Open X-Embodiment Collaboration and Abby O'Neill and Abdul Rehman and Abhinav Gupta and Abhiram Maddukuri and Abhishek Gupta and Abhishek Padalkar and Abraham… See the full description on the dataset page: https://huggingface.co/datasets/xxxxxyang/OXE-slice2-jiahe.

RoVI-Book Dataset

🎉 CVPR 2025 🎉 Official dataset for Robotic Visual Instruction

This is an example to demonstrate the RoVI Book dataset, adapted from the Open-X Embodiments dataset. The bottom displays the proportion of each task type. Paper:Robotic Visual Instruction Project Page: https://robotic-visual-instruction.github.io/ Code: https://github.com/RoboticsVisualInstruction/RoVI-Book

  Introduction

The RoVI-Book dataset is introduced alongside Robotic… See the full description on the dataset page: https://huggingface.co/datasets/yanbang/rovibook.

What is this?

This is an example RLDS dataset builder adapted from https://github.com/kpertsch/rlds_dataset_builder for training Interleave-VLAs. This repo aims to illustrate the data format of Interleave-VLA.

  How to use?

We assume interleave Open X-Embodiment data is first extracted and stored in pickles. The folder to pickles should be set in config.py. Next, select dataset_name in openx_interleave.py to your desired dataset. Finally, run tfds build --overwrite

in this… See the full description on the dataset page: https://huggingface.co/datasets/Interleave-VLA/rlds_dataset_builder_interleave.

This dataset was created using LeRobot.

  Dataset Structure

meta/info.json: { "codebase_version": "v2.1", "robot_type": "franka", "total_episodes": 8612, "total_frames": 1137459, "total_tasks": 24, "total_videos": 34448, "total_chunks": 9, "chunks_size": 1000, "fps": 10, "splits": { "train": "0:8612" }, "data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet", "video_path":… See the full description on the dataset page: https://huggingface.co/datasets/IPEC-COMMUNITY/fmb_dataset_lerobot.