CLARU
Kuoskylercc-by-4.0

SwiftPlan Isaac Sim Dataset

Isaac Sim observation images for frame-level high-level action selection in robotic task planning, containing RGB images paired with task instructions and action labels.

Downloads471
Likes2

Technical Profile

Modalities
rgblanguage
Environment
simulation
Task Types
task_planningmanipulation
Data Format
jsonl with PNG images
License
cc-by-4.0
Part of the SwiftPlan Isaac Sim Dataset family

Community Signals

Top 50% by downloads

Access

View on HuggingFace

Need custom rgb data?

Claru builds purpose-built datasets for simulation applications with dense human annotations and quality assurance.

Request a Sample Pack

Related Datasets

ABC-130k

The largest open-source robot teleoperation dataset containing bimanual manipulation trajectories collected on two-arm YAM stations with 130,822 episodes across 3,555 hours of data.

rgbproprioception
642K downloadsJul 2026apache-2.0

Hy-Embodied-0.5-VLA-Data

A large-scale bimanual manipulation dataset with 2,163 hours of high-fidelity demonstrations collected via custom fingertip UMI device with optical motion-capture, spanning 70+ manipulation tasks for training Vision-Language-Action foundation models.

rgbproprioceptionlanguage
206K downloadsJul 2026cc-by-4.0

T-Rex Dataset

A large-scale, tactile-reactive bimanual manipulation dataset collected via teleoperation on a Dexmate Vega-1 robot with two Sharpa Wave dexterous hands, featuring 5,464 episodes with tactile, RGB, and proprioceptive observations.

rgbtactileforce_torqueproprioception
154K downloadsJun 2026MIT

Xperience-10M

A large-scale egocentric multimodal dataset of human experience containing 10 million interactions and 10,000 hours of synchronized first-person recordings with six video streams, audio, stereo depth, camera pose, hand mocap, full-body mocap, IMU, and hierarchical language annotations for embodied AI, robotics, and world modeling research.

rgbaudiodepthproprioception+3
81K downloadsApr 2026other

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes with cross-modal contextual instructions derived from spoken dialogue, environmental sounds, and visual cues rather than explicit commands.

rgbaudiolanguage
79K downloadsMar 2026cc-by-nc-4.0

OmniAction

A large-scale multimodal dataset for proactive robot manipulation with 141,162 episodes covering contextual instruction following through spoken dialogue, environmental sounds, and visual cues. The dataset includes 5,096 distinct speaker timbres, 2,482 non-verbal sound events, and 640 environmental backgrounds across six categories of contextual instructions.

rgbaudiolanguage
78K downloadsApr 2026cc-by-nc-4.0