CLARU
nvidiacc-by-4.0

Video to Data: Robot Dexterity Task Library and Dataset

A dataset containing human demonstrations on manipulation tasks retargeted to bimanual Sharpa robot hands and episodes of robot executions that mimic the original human demonstrations, derived from the TACO bimanual hand-object interaction dataset.

Downloads26K
Likes8

Technical Profile

Modalities
videomotion_trajectoriesrobot_actions
Robot Embodiments
Sharpa robot handsbimanual
Environment
simulation
Task Types
manipulationbimanualhand-object_interaction
Data Format
Parquet, LeRobotv3
License
cc-by-4.0
Part of the Video to Data: Robot Dexterity Task Library and Dataset family

Community Signals

Top 5% by downloads

Access

View on HuggingFace

Need custom video data?

Claru builds purpose-built datasets for simulation applications with dense human annotations and quality assurance.

Request a Sample Pack

Related Datasets

Egocentric-100K

The largest dataset of manual labor with 100,405 hours of egocentric video from head-mounted fisheye cameras, featuring state-of-the-art hand visibility and active manipulation density.

rgbvideo
159K downloadsFeb 2026apache-2.0

BEHAVIOR-1K 2026 Challenge Demos

BEHAVIOR-1K 2026 challenge demonstration trajectories in LeRobotDataset v3 format containing 20,000 episodes across 100 tasks collected in simulation.

rgbvideo
102K downloadsAug 2026MIT

Example Retargeted Motion and Simulated Robot Execution Derived from TACO

A dataset containing human demonstrations on manipulation tasks retargeted to bimanual Sharpa robot hands and episodes of robot executions mimicking the original human demonstrations, derived from the TACO dataset using the Video to Data pipeline.

videomotion_trajectoriesrobot_actions
26K downloadsAug 2026cc-by-4.0

HOIGen Filtered Videos Dataset

A filtered subset of 28,562 videos from the HOIGen-1M dataset selected based on quality and relevance criteria, organized for human-object interaction and action recognition research.

rgbvideo
18K downloadsOct 2025MIT

Time-Lapse-Artifacts

A 14-year continuous video archive (2012–present) documenting human physical endurance, biomechanics, and visual cognition through time-lapse and real-time footage, organized by spatial constraints and temporal pacing for machine learning and archival research.

rgbvideo
8K downloadsAug 2026cc-by-nc-4.0

Ego-Exo Manufacturing

A video dataset of real shoe manufacturing operations with temporally synchronized ego-centric (first-person) and exo-centric (overhead) video pairs, along with standalone sessions annotated with atomic action descriptions and expert commentary.

videotext
5K downloadsMar 2026apache-2.0gated