Training Data by Task

Browse our catalog of robotics training data organized by task category. Each page covers data requirements, compatible models, and how Claru delivers production-ready datasets.

Object Manipulation

Training data for object manipulation tasks: pick-and-place, stacking, and general-purpose grasping. Data requirements, formats, and model compatibility for robot learning.

RT-2OctoDiffusion Policy

Dexterous Manipulation

High-fidelity training data for dexterous robotic manipulation: multi-fingered grasping, in-hand reorientation, and precision tasks requiring fingertip control.

DexMVHORA / RotateItAnyTeleop

Grasping

Production-ready grasping datasets for robotic systems: parallel-jaw, suction, and multi-fingered grasps across 1000+ object categories with 6-DoF grasp annotations.

Contact-GraspNetAnyGraspGQ-CNN / Dex-Net

Teleoperation

Scalable teleoperation data collection for robot imitation learning: VR, leader-follower, exoskeleton interfaces with synchronized multi-modal recordings.

ACT/ALOHADiffusion PolicyOpenVLA

Kitchen Task

Training data for kitchen manipulation tasks: cooking, cleaning, organizing. Multi-step long-horizon demonstrations in real kitchen environments.

RT-2 (Google DeepMind)Diffusion PolicyACT / ALOHA

Navigation

Training data for robot navigation: indoor mapping, outdoor traversal, obstacle avoidance. Multi-sensor recordings with semantic maps and trajectory annotations.

ViNTNoMaDGNM

Locomotion

Training data for legged robot locomotion: walking, running, stair climbing, terrain traversal. Motion capture and proprioceptive recordings for quadrupeds and bipeds.

ANYmal perceptive locomotionAMP (Adversarial Motion Priors)Legged Gym / IsaacGym policies

Assembly Task

Training data for robotic assembly: part insertion, screw driving, connector mating. Precision manipulation demonstrations with force-guided assembly sequences.

Diffusion PolicyTAX-PoseIndustReal

Bin Picking

Training data for robotic bin picking: cluttered bin grasping, singulation, and sorting. Point cloud and RGB-D datasets with grasp annotations for warehouse automation.

GraspNet / GraspNet-1BillionContact-GraspNetAnyGrasp

Tool Use

Training data for robotic tool use: hammering, screwdriving, scooping, cutting. Demonstrations capturing tool-object interaction dynamics and affordance reasoning.

Diffusion PolicyACT/ALOHART-2

Bimanual Manipulation

Training data for bimanual robot manipulation: coordinated two-arm tasks, handovers, collaborative assembly. ALOHA-compatible demonstrations with synchronized dual-arm recordings.

ACT (Action Chunking with Transformers)ALOHA / Mobile ALOHAALOHA Unleashed

Agricultural Robotics

Training data for agricultural robots: crop picking, weeding, pruning, soil analysis. Outdoor field recordings with GPS, multispectral imaging, and manipulation data.

YOLO-based crop detectionSemantic segmentation (crop/weed/soil)Harvesting manipulation policies

Mobile Manipulation

Training data for mobile manipulation robots: navigating to objects, picking from shelves, and performing tasks while moving. Whole-body control demonstrations.

Mobile ALOHA / Diffusion PolicyNaVILASayCan

Surgical Manipulation

Training data for surgical robots: tissue manipulation, suturing, cutting. Sub-millimeter precision demonstrations with force feedback for autonomous surgical systems.

Surgical Diffusion PolicySurRoL RL policiesJIGSAWS gesture classifiers

Human-Robot Handover

Training data for human-robot handovers: giving and receiving objects, timing prediction, grasp adaptation. Multi-modal recordings of natural human-robot object exchange.

Handover timing prediction networksGrasp pose optimization for handoverSocial preference models (RLHF)

Door & Cabinet Manipulation

Training data for articulated object manipulation: doors, cabinets, drawers, refrigerators. Demonstrations capturing handle grasping, opening trajectories, and force profiles.

Where2ActFlowBot3DDiffusion Policy

Deformable Object Folding

Training data for deformable object manipulation: cloth folding, fabric handling, soft object manipulation. Demonstrations with state estimation for garments and textiles.

FlingBotSpeedFoldingClothFunnels

Liquid Pouring

Training data for robotic pouring: liquid transfer, measuring, dispensing. Demonstrations capturing fill levels, pour dynamics, and container handling for kitchen and lab robots.

Diffusion PolicyACT/ALOHANeural pouring controllers

Wrist Camera

Wrist-mounted camera data for robot manipulation: close-up hand-object views, in-hand sensing, and eye-in-hand visual servoing datasets for visuomotor policies.

OpenVLAOctoRT-2

Tactile Sensor

Tactile sensor data for robot manipulation: GelSight, DIGIT, and BioTac recordings with contact geometry, force distribution, and slip detection annotations.

Tactile-RLTouch-GSTactile Diffusion Policy

Warehouse Automation

Training data for warehouse robots: order picking, packing, palletizing, sorting. Multi-robot recordings with barcode scanning, bin management, and logistics workflow data.

Bin picking networks (suction + parallel jaw)Dex-Net / GraspNet variantsTransporter Networks for packing

Construction Robotics

Training data for construction robots: bricklaying, welding, rebar tying, site navigation. Outdoor recordings with heavy payload manipulation and structural assembly data.

Weld seam tracking networksBIM-based progress monitoringHeavy equipment imitation learning

Underwater Manipulation

Training data for underwater robots: subsea manipulation, pipeline inspection, marine sampling. ROV and AUV recordings with turbid water visual data and current compensation.

Underwater manipulation policiesSonar-based grasp plannersCurrent-compensated controllers

Aerial Manipulation

Training data for aerial manipulation: drone grasping, package delivery, inspection contact. UAV recordings with flight dynamics, wind compensation, and manipulation coordination.

Sim-pretrained aerial grasping RLCoordinated flight-grasp policiesContact inspection models

Food Preparation

Training data for food preparation robots: ingredient handling, cutting, mixing, plating. Multi-step cooking demonstrations with food state tracking and recipe grounding.

ACT/ALOHAMobile ALOHASayCan

Cleaning Task

Training data for cleaning robots: wiping surfaces, mopping floors, organizing clutter. Demonstrations with cleanliness assessment and coverage path planning data.

TidyBotMobile ALOHADiffusion Policy

Table Setting

Training data for table setting robots: placing plates, utensils, glasses in correct arrangements. Spatial reasoning demonstrations with placement precision and cultural variation.

Diffusion PolicySayCanTidyBot

Object Rearrangement

Training data for object rearrangement: scene organization, shelf stocking, desk tidying. Goal-conditioned demonstrations with spatial reasoning and efficiency metrics.

SayCanStructFormerDALL-E-Bot

Cable Routing

Training data for deformable linear object manipulation: cable routing, wire harness assembly, hose connection. Demonstrations capturing cable state estimation and path planning.

Diffusion PolicyACTTransporter Networks

Insertion Task

Training data for precision insertion: peg-in-hole, connector mating, key insertion. Sub-millimeter demonstrations with force-guided search strategies and compliance control.

Diffusion PolicyIndustRealTAX-Pose

Packing Task

Training data for robotic packing: box filling, item arrangement, and order fulfillment. Dense manipulation demonstrations with spatial reasoning and deformable packaging.

Packing Configuration Transformer (PCT)Diffusion PolicySpatialVLM

Stacking Task

Training data for robotic stacking: block towers, plate stacking, pallet layering. Stability-aware manipulation demonstrations with contact physics and balance reasoning.

PerActACT / ALOHADiffusion Policy

Pick-and-Place

Training data for robotic pick-and-place: object grasping, transport, and precise placement. Full manipulation trajectories with grasp and placement annotations for policy learning.

RT-1 / RT-2OpenVLADiffusion Policy

Pushing Task

Training data for robotic pushing: non-prehensile manipulation, object sliding, and planar rearrangement. Contact-dynamics demonstrations with friction modeling and push prediction.

Diffusion PolicyPushNetNeural push predictors

Surface Wiping

Training data for robotic surface wiping: cleaning, polishing, and decontamination. Compliance-controlled trajectories with force modulation and coverage planning annotations.

Impedance learning from demonstrationsDiffusion PolicyACT / ALOHA

Screw Driving

Training data for robotic screw driving: fastening, threading, and torque-controlled tightening. Force-guided demonstrations with torque profiles and cross-threading detection.

Diffusion PolicyFactory / IndustRealTorque profile classifiers

Peg Insertion Task

Training data for robotic peg insertion: tight-tolerance assembly, force-guided search, and clearance characterization. Precision manipulation demonstrations with sub-millimeter accuracy.

Diffusion PolicyIndustReal / FactoryTAX-Pose

Cloth Folding Task

Training data for robotic cloth folding: garment manipulation, towel folding, and fabric handling. Deformable object demonstrations with keypoint tracking and mesh state estimation.

FlingBotClothFunnelsDiffusion Policy for deformables

Drawer Manipulation Task

Training data for robotic drawer manipulation: opening, closing, and content access. Articulated object demonstrations with handle grasping and joint state tracking.

FlowBot3DWhere2ActDiffusion Policy

Button Pressing Task

Training data for robotic button pressing: mechanical buttons, toggles, and touchscreens. Precision contact demonstrations with force profiles and activation state detection.

Diffusion PolicyRT-1 / RT-2ACT / ALOHA

Valve Turning Task

Training data for robotic valve turning: handwheel rotation, ball valve operation, and lever manipulation. Torque-controlled demonstrations with angular tracking and regrasping strategies.

Diffusion PolicyDexterous manipulation policiesImpedance learning

Welding Task

Training data for robotic welding: seam tracking, torch control, and weld quality. Thermal-monitored demonstrations with bead geometry and parameter annotations for learned welding policies.

Seam tracking neural networksWeld parameter optimization modelsAdaptive welding controllers

Painting Task

Training data for robotic painting: spray control, coverage planning, and coating quality. Film thickness demonstrations with spray parameter annotations for learned painting policies.

Trajectory optimization for coatingCoverage path planning modelsSpray simulation (CFD-based)

Inspection Task

Training data for robotic inspection: visual defect detection, dimensional verification, and surface quality assessment. Multi-sensor demonstrations with defect annotations for learned inspection policies.

YOLO / Faster R-CNN for defect detectionAnomaly detection networks (PatchCore, DRAEM)Active viewpoint planning models

Palletizing Task

Training data for robotic palletizing: layer planning, mixed-case stacking, and load optimization. Stability-annotated demonstrations with weight distribution and packing efficiency for learned palletizing policies.

Pallet pattern optimization algorithmsMixed-integer programming solversRL-based palletizing policies

Need Data for a Different Task?

We collect custom datasets for any robotics task. Tell us what you need and we will scope a collection plan.

Get in Touch