paulpacaudapache-2.0
Guardian: RLBench-Fail
A dataset of annotated robotic manipulation failures from the RLBench simulator, containing 12,358 execution failure samples and 5,808 planning failure samples across 52 tasks, designed for training Vision-Language Models on failure detection.
Downloads189
Episodes12,358 execution (train) + 5,808 planning (train)
Why This Matters for Physical AI
This dataset enables Vision-Language Models to detect and classify robotic execution and planning failures with fine-grained reasoning traces, advancing robust failure detection capabilities essential for safe autonomous manipulation in real-world deployments.
Technical Profile
- Modalities
- rgblanguage
- Robot Embodiments
- robot arm with gripper
- Environment
- simulation
- Task Types
- manipulationgraspingpick_and_placefailure_detection
- Episodes
- 12,358 execution (train) + 5,808 planning (train)
- Data Format
- JSONL
- Annotation Types
- language_instructionsfailure_labelsfailure_categorieschain_of_thought_reasoningaction_labelsobject_labels
- License
- apache-2.0
Community Signals
Top 50% by downloads
Access
Need custom rgb data?
Claru builds purpose-built datasets for simulation applications with dense human annotations and quality assurance.
Request a Sample Pack