CLARU
ProcessBench-2026other

RoboProcessBench

A process-aware benchmark for vision-language robotic manipulation understanding that evaluates whether VLMs can infer how manipulation execution unfolds across phases, contact, motion, coordination, and primitives. Contains 57,892 QA rows across 12 task families and 260 manipulation tasks derived from GM-100, RH20T, REASSEMBLE, and AIST-Bimanual.

Downloads498

Technical Profile

Modalities
rgblanguage
Robot Embodiments
bimanual_manipulator
Environment
lab
Task Types
manipulationvisual-question-answeringprocess-understanding
Data Format
parquet
License
other
Part of the RoboProcessBench family

Community Signals

Top 50% by downloads

Access

View on HuggingFace

Need custom rgb data?

Claru builds purpose-built datasets for lab applications with dense human annotations and quality assurance.

Request a Sample Pack

Related Datasets

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes across 112 skills and 748 objects, enriched with audio, visual, and contextual instruction data for cross-modal intention recognition.

rgbaudiolanguage
155K downloadsMar 2026cc-by-nc-4.0

Xperience-10M

A large-scale egocentric multimodal dataset of human experience containing 10 million interactions and 10,000 hours of synchronized first-person recordings with six video streams, audio, stereo depth, camera pose, hand mocap, full-body mocap, IMU, and hierarchical language annotations for embodied AI, robotics, and world modeling research.

rgbaudiodepthproprioception+3
115K downloadsApr 2026other

LingBot-Depth Dataset

Self-curated RGB-D dataset for training masked depth modeling approaches, containing real-world indoor scenes, VLA robot manipulation tasks, and simulated data across multiple camera types and robot platforms.

rgbdepth
101K downloadsApr 2026CC BY-NC-SA 4.0

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes with cross-modal contextual instructions derived from spoken dialogue, environmental sounds, and visual cues rather than explicit commands.

rgbaudiolanguage
87K downloadsMar 2026cc-by-nc-4.0

Egocentric-100K

The largest dataset of manual labor with 100,405 hours of egocentric video from head-mounted fisheye cameras, featuring state-of-the-art hand visibility and active manipulation density.

rgbvideo
79K downloadsFeb 2026apache-2.0

Open-H-Embodiment

A community-driven, multi-embodiment dataset of paired kinematics and video for training and evaluating AI autonomy models in surgical robotics and ultrasound applications, including tabletop exercises, clinical procedures, and healthcare robotics simulations.

rgbproprioception
71K downloadsMay 2026cc-by-4.0