CLARU
cagataydev2026cc-by-4.0

VLM Robotics Voice Commands (Text)

50,000 curated natural language commands for Vision-Language-Model robot control, covering 10 categories of embodied interaction including pick-and-place, manipulation, navigation, and human-robot interaction.

Downloads26
Episodes50000

Why This Matters for Physical AI

This dataset enables training Vision-Language Models to understand diverse natural language commands for robot control, supporting research in embodied AI and human-robot interaction through text-based instruction understanding.

Technical Profile

Modalities
language
Action Space
language
Task Types
pick_and_placemanipulationnavigationmultistepobservationhousehold
Episodes
50000
Annotation Types
language_instructionstask_category_labelsdifficulty_labels
License
cc-by-4.0
Part of the VLM Robotics Voice Commands (Text) family

Access

View on HuggingFace

Need custom language data?

Claru builds purpose-built datasets for any environment applications with dense human annotations and quality assurance.

Request a Sample Pack

Related Datasets

Xperience-10M

A large-scale egocentric multimodal dataset of human experience containing 10 million interactions and 10,000 hours of synchronized first-person recordings with six video streams, audio, stereo depth, camera pose, hand mocap, full-body mocap, IMU, and hierarchical language annotations for embodied AI, robotics, and world modeling research.

rgbaudiodepthproprioception+3
2.3M downloadsother

ManiTwin-100K: Manipulation-Ready Digital Object Twins

A large-scale dataset of 100K manipulation-ready digital object twins with simulation-ready 3D meshes, physical properties, functional point annotations, grasp configurations, and language descriptions validated through physics-based simulation.

3d_meshlanguage
45K downloads2026cc-by-nc-4.0

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes with cross-modal contextual instructions derived from spoken dialogue, environmental sounds, and visual cues rather than explicit commands.

rgbaudiolanguage
45K downloads2025cc-by-nc-4.0

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes across 112 skills and 748 objects, enriched with audio, visual, and contextual instruction data for cross-modal intention recognition.

rgbaudiolanguage
42K downloads2025cc-by-nc-4.0

Galaxea Open-World Dataset

A large-scale real-world mobile manipulation dataset containing 500+ hours of dual-arm robot data collected across residential, kitchen, retail, and office environments with fine-grained language annotations.

rgbdepthproprioceptionlanguage
23K downloads2025cc-by-nc-sa-4.0

BEHAVIOR-1K Asset Database (Patch)

Complete metadata and visualizations for 8662 object assets from the BEHAVIOR-1K dataset, including VLM-generated descriptions, articulation metadata, and multi-view renderings.

rgblanguage
17K downloadsMIT