CLARU
Lennittusmit

DESPITE: Deterministic Evaluation of Safe Planning In embodied Task Execution

A benchmark for evaluating large language models on embodied safe task planning, derived from multiple sources including ALFRED, BDDL, VirtualHome, NormBank, and NEISS.

Downloads76
Episodes12,729
Likes4

Why This Matters for Physical AI

This dataset is critical for evaluating the safety risks of using LLMs for embodied task planning in robotic systems, addressing systematic safety concerns in AI-driven robot control.

Technical Profile

Modalities
language
Action Space
language
Environment
simulation
Task Types
task-planningmanipulation
Episodes
12,729
Annotation Types
language_instructionspddl
License
mit
Part of the DESPITE: Deterministic Evaluation of Safe Planning In embodied Task Execution family

Access

View on HuggingFace

Need custom language data?

Claru builds purpose-built datasets for simulation applications with dense human annotations and quality assurance.

Request a Sample Pack

Related Datasets

Xperience-10M

A large-scale egocentric multimodal dataset of human experience containing 10 million interactions and 10,000 hours of synchronized first-person recordings with six video streams, audio, stereo depth, camera pose, hand mocap, full-body mocap, IMU, and hierarchical language annotations for embodied AI, robotics, and world modeling research.

rgbaudiodepthproprioception+3
2.3M downloadsother

ManiTwin-100K: Manipulation-Ready Digital Object Twins

A large-scale dataset of 100K manipulation-ready digital object twins with simulation-ready 3D meshes, physical properties, functional point annotations, grasp configurations, and language descriptions validated through physics-based simulation.

3d_meshlanguage
45K downloads2026cc-by-nc-4.0

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes with cross-modal contextual instructions derived from spoken dialogue, environmental sounds, and visual cues rather than explicit commands.

rgbaudiolanguage
45K downloads2025cc-by-nc-4.0

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes across 112 skills and 748 objects, enriched with audio, visual, and contextual instruction data for cross-modal intention recognition.

rgbaudiolanguage
42K downloads2025cc-by-nc-4.0

Galaxea Open-World Dataset

A large-scale real-world mobile manipulation dataset containing 500+ hours of dual-arm robot data collected across residential, kitchen, retail, and office environments with fine-grained language annotations.

rgbdepthproprioceptionlanguage
23K downloads2025cc-by-nc-sa-4.0

BEHAVIOR-1K Asset Database (Patch)

Complete metadata and visualizations for 8662 object assets from the BEHAVIOR-1K dataset, including VLM-generated descriptions, articulation metadata, and multi-view renderings.

rgblanguage
17K downloadsMIT