Multi-View Manipulation Dataset

Synchronized multi-camera robot manipulation recordings — 3-5 calibrated viewpoints — with 3D annotations for training spatial manipulation policies.

Dataset at a Glance

40K+
Video clips
250+
Hours recorded
20+ setups
Environments
6+
Annotation layers

Comparison with Public Datasets

How Claru's dataset compares to publicly available alternatives.

DatasetClipsHoursModalitiesEnvironmentsAnnotations
RLBench100K~50RGB-D (sim)SimulatedActions, keypoints
ManiSkill2200K~100RGB-D (sim)SimulatedActions, rewards
Claru Multi-View40K+250+Multi-view RGB20+ real setups3D poses, actions, camera params

Use Cases

3D-Aware Policies

Policies that reason about full 3D geometry for robust grasping. Example models: PerAct, Act3D, 3D Diffusion Policy.

Neural Radiance Fields

Scene representations from multi-view captures for robotics. Example models: NeRF-RL, Ditto, F3RM.

Point Cloud Manipulation

Direct 3D processing for manipulation planning. Example models: PointNet++, Contact-GraspNet, VoxPoser.

Key References

  1. [1]Shridhar et al.. “Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation.” CoRL 2023, 2023. Link
  2. [2]Gervet et al.. “Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulation.” CoRL 2023, 2023. Link
  3. [3]Ze et al.. “3D Diffusion Policy.” RSS 2024, 2024. Link

How Claru Delivers This Data

Capture is RGB video. Monocular depth estimates may be provided as an annotation layer. Contact Claru to scope RGB capture and derived annotation requirements.

Frequently Asked Questions

Capture is RGB video. Monocular depth estimates may be provided as an annotation layer. Contact Claru to scope RGB capture and derived annotation requirements.

6-DoF object poses, 3D bounding boxes, registered point clouds, surface normals, and camera-to-world transformations.

Yes. Multi-view images with known camera parameters are directly usable for NeRF, 3D Gaussian Splatting, and other neural 3D methods.

Request a Sample Pack

Get a curated sample of multi-view manipulation data with full annotations to evaluate for your project.