Multi-View Manipulation Dataset

Synchronized multi-camera robot manipulation recordings — 3-5 calibrated viewpoints — with 3D annotations for training spatial manipulation policies.

Dataset at a Glance

40K+
Video clips
250+
Hours recorded
20+ setups
Environments
6+
Annotation layers

Comparison with Public Datasets

How Claru's dataset compares to publicly available alternatives.

DatasetClipsHoursModalitiesEnvironmentsAnnotations
RLBench100K~50RGB-D (sim)SimulatedActions, keypoints
ManiSkill2200K~100RGB-D (sim)SimulatedActions, rewards
Claru Multi-View40K+250+RGB, Depth, PC20+ real setups3D poses, actions, camera params

Use Cases

3D-Aware Policies

Policies that reason about full 3D geometry for robust grasping. Example models: PerAct, Act3D, 3D Diffusion Policy.

Neural Radiance Fields

Scene representations from multi-view captures for robotics. Example models: NeRF-RL, Ditto, F3RM.

Point Cloud Manipulation

Direct 3D processing for manipulation planning. Example models: PointNet++, Contact-GraspNet, VoxPoser.

Key References

  1. [1]Shridhar et al.. Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation.” CoRL 2023, 2023. Link
  2. [2]Gervet et al.. Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulation.” CoRL 2023, 2023. Link
  3. [3]Ze et al.. 3D Diffusion Policy.” RSS 2024, 2024. Link

How Claru Delivers This Data

Claru's multi-view rigs use 3-5 calibrated RGB-D cameras with precise calibration enabling registered point cloud reconstruction. This bridges the gap between simulation-heavy 3D datasets and real-world needs.

Frequently Asked Questions

3 to 5 calibrated RGB-D cameras with full extrinsic/intrinsic parameters per frame.

6-DoF object poses, 3D bounding boxes, registered point clouds, surface normals, and camera-to-world transformations.

Yes. Multi-view images with known camera parameters are directly usable for NeRF, 3D Gaussian Splatting, and other neural 3D methods.

Request a Sample Pack

Get a curated sample of multi-view manipulation data with full annotations to evaluate for your project.