haosulab2023apache-2.0

ManiSkill2 Data

Name: ManiSkill2 Data
Creator: haosulab
Published: 2023-01-01
License: apache-2.0
Keywords: rgb, depth, manipulation, grasping, pick_and_place, simulation

A unified benchmark for learning generalizable robotic manipulation skills featuring 20 task families with 2000+ diverse object models and 4M+ demonstration frames powered by SAPIEN.

Downloads666
Likes11

Why This Matters for Physical AI

ManiSkill2 provides a large-scale simulated benchmark with 4M+ demonstration frames across diverse manipulation tasks, enabling research in vision-based reinforcement learning and imitation learning for robotic manipulation skills.

Technical Profile

Modalities: rgbdepth
Robot Embodiments: Panda
Environment: simulation
Task Types: manipulationgraspingpick_and_place
Annotation Types: action_labels
License: apache-2.0

Part of the ManiSkill2 family

Community Signals

Top 25% by downloads

Academic Citations21

An Empirical Study on Temporal Difference Model Predictive Control for Fixed-Wing UAVs under Varying Wind Conditions2026 · SN Computer Science
Surgical embodied intelligence for generalized task autonomy in laparoscopic robot-assisted surgery2025 · Science Robotics
A Survey of Embodied Learning for Object-centric Robotic Manipulation2025 · Machine Intelligence Research

HuggingFace Discussions4

Access

View on HuggingFace Read Paper

Need custom rgb data?

Claru builds purpose-built datasets for simulation applications with dense human annotations and quality assurance.

Request a Sample Pack

Related Datasets

Xperience-10M

A large-scale egocentric multimodal dataset of human experience containing 10 million interactions and 10,000 hours of synchronized first-person recordings with six video streams, audio, stereo depth, camera pose, hand mocap, full-body mocap, IMU, and hierarchical language annotations for embodied AI, robotics, and world modeling research.

rgbaudiodepthproprioception+3

2.3M downloadsother

Open-H-Embodiment

A multi-embodiment community-driven dataset of paired kinematics and video for training AI autonomy models in surgical robotics and ultrasound applications. The dataset includes tabletop exercises, clinical procedures, and simulations of healthcare robotics tasks.

rgbproprioception

118K downloads2026cc-by-4.0

Open-H-Embodiment

A community-driven, multi-embodiment dataset of paired kinematics and video for training and evaluating AI autonomy models in surgical robotics and ultrasound applications, including tabletop exercises, clinical procedures, and healthcare robotics simulations.

rgbproprioception

76K downloads2026cc-by-4.0

LingBot-Depth Dataset

Self-curated RGB-D dataset for training masked depth modeling approaches, containing real-world indoor scenes, VLA robot manipulation tasks, and simulated data across multiple camera types and robot platforms.

rgbdepth

71K downloadsCC BY-NC-SA 4.0

PhysicalAI-Robotics-Manipulation-Kitchen-Demos

A large-scale dataset of 600 hours of human-teleoperated demonstrations across 316 different kitchen manipulation tasks, totalling 55k trajectories collected using a Franka Panda robot with an Omron mobile base.

rgbproprioception

57K downloads2025cc-by-4.0

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes with cross-modal contextual instructions derived from spoken dialogue, environmental sounds, and visual cues rather than explicit commands.

rgbaudiolanguage

45K downloads2025cc-by-nc-4.0