CLARU
paulpacaudapache-2.0

Guardian: RLBench-Fail

A dataset of annotated robotic manipulation failures from the RLBench simulator, containing 12,358 execution failure samples and 5,808 planning failure samples across 52 tasks, designed for training Vision-Language Models on failure detection.

Downloads803

Technical Profile

Modalities
rgblanguage
Robot Embodiments
robot arm with gripper
Environment
simulation
Task Types
manipulationgraspingpick_and_placefailure_detection
Data Format
JSONL
License
apache-2.0
Part of the Guardian: RLBench-Fail family

Community Signals

Top 50% by downloads

Access

View on HuggingFace

Need custom rgb data?

Claru builds purpose-built datasets for simulation applications with dense human annotations and quality assurance.

Request a Sample Pack

Related Datasets

Guardian: RLBench-Fail

Annotated robotic manipulation failure dataset generated in RLBench simulator for training Vision-Language Models on failure detection tasks, with planning and execution failures categorized with fine-grained annotations and reasoning traces.

rgblanguage
1K downloadsFeb 2026apache-2.0

Guardian: RLBench-Fail

Annotated robotic manipulation failure dataset generated in RLBench simulator for training Vision-Language Models on failure detection in planning and execution tasks. Contains 52 manipulation tasks with procedurally generated planning and execution failures.

rgblanguage
96 downloadsFeb 2026apache-2.0

LingBot-Depth Dataset

Self-curated RGB-D dataset for training masked depth modeling approaches, containing real-world indoor scenes, VLA robot manipulation tasks, and simulated data across multiple camera types and robot platforms.

rgbdepth
167K downloadsApr 2026CC BY-NC-SA 4.0

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes across 112 skills and 748 objects, enriched with audio, visual, and contextual instruction data for cross-modal intention recognition.

rgbaudiolanguage
145K downloadsMar 2026cc-by-nc-4.0

Xperience-10M

A large-scale egocentric multimodal dataset of human experience containing 10 million interactions and 10,000 hours of synchronized first-person recordings with six video streams, audio, stereo depth, camera pose, hand mocap, full-body mocap, IMU, and hierarchical language annotations for embodied AI, robotics, and world modeling research.

rgbaudiodepthproprioception+3
127K downloadsApr 2026other

Egocentric-100K

The largest dataset of manual labor with 100,405 hours of egocentric video from head-mounted fisheye cameras, featuring state-of-the-art hand visibility and active manipulation density.

rgbvideo
74K downloadsFeb 2026apache-2.0