CLARU
paulpacaudapache-2.0

Guardian: RLBench-Fail

Annotated robotic manipulation failure dataset generated in RLBench simulator for training Vision-Language Models on failure detection tasks, with planning and execution failures categorized with fine-grained annotations and reasoning traces.

Downloads931

Technical Profile

Modalities
rgblanguage
Robot Embodiments
robotic_arm_with_gripper
Environment
simulation
Task Types
manipulationgraspingpick_and_placevisual-question-answering
Data Format
JSONL
License
apache-2.0
Part of the Guardian: RLBench-Fail family

Community Signals

Top 50% by downloads

Access

View on HuggingFace

Need custom rgb data?

Claru builds purpose-built datasets for simulation applications with dense human annotations and quality assurance.

Request a Sample Pack

Related Datasets

Guardian: RLBench-Fail

A dataset of annotated robotic manipulation failures from the RLBench simulator, containing 12,358 execution failure samples and 5,808 planning failure samples across 52 tasks, designed for training Vision-Language Models on failure detection.

rgblanguage
681 downloadsFeb 2026apache-2.0

Guardian: RLBench-Fail

Annotated robotic manipulation failure dataset generated in RLBench simulator for training Vision-Language Models on failure detection in planning and execution tasks. Contains 52 manipulation tasks with procedurally generated planning and execution failures.

rgblanguage
96 downloadsFeb 2026apache-2.0

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes with cross-modal contextual instructions derived from spoken dialogue, environmental sounds, and visual cues rather than explicit commands.

rgbaudiolanguage
114K downloadsMar 2026cc-by-nc-4.0

Xperience-10M

A large-scale egocentric multimodal dataset of human experience containing 10 million interactions and 10,000 hours of synchronized first-person recordings with six video streams, audio, stereo depth, camera pose, hand mocap, full-body mocap, IMU, and hierarchical language annotations for embodied AI, robotics, and world modeling research.

rgbaudiodepthproprioception+3
111K downloadsApr 2026other

OmniAction

A large-scale multimodal dataset for proactive robot manipulation with 141,162 episodes covering contextual instruction following through spoken dialogue, environmental sounds, and visual cues. The dataset includes 5,096 distinct speaker timbres, 2,482 non-verbal sound events, and 640 environmental backgrounds across six categories of contextual instructions.

rgbaudiolanguage
101K downloadsApr 2026cc-by-nc-4.0

OmniAction

A large-scale multimodal dataset for proactive robot manipulation with 141,162 episodes covering contextual instruction following through spoken dialogue, environmental sounds, and visual cues.

rgbaudiolanguage
100K downloadsApr 2026cc-by-nc-4.0