CLARU
cagataydev2026cc-by-4.0

VLM Robotics Voice Commands (Audio)

A dataset of 9,999 audio recordings of natural speech commands for controlling robots, covering tasks like pick & place, navigation, manipulation, and multi-step instructions across 10 command categories.

Downloads66
Episodes9999
Hours6.8

Why This Matters for Physical AI

This dataset enables training of omni-modal Vision-Language Models that can understand natural spoken commands for robot control, bridging the gap between human communication and embodied AI systems.

Technical Profile

Modalities
audio
Action Space
language
Task Types
pick_and_placemanipulationnavigationobservationmulti-step_tasksspatial_commandssafetyhousehold_choresconversational_feedback
Episodes
9999
Total Hours
6.8
Data Format
WAV
Annotation Types
language_instructionscategory_labelsdifficulty_labels
License
cc-by-4.0
Part of the VLM Robotics Voice Commands (Audio) family

Access

View on HuggingFace

Need custom audio data?

Claru builds purpose-built datasets for any environment applications with dense human annotations and quality assurance.

Request a Sample Pack

Related Datasets

Xperience-10M

A large-scale egocentric multimodal dataset of human experience containing 10 million interactions and 10,000 hours of synchronized first-person recordings with six video streams, audio, stereo depth, camera pose, hand mocap, full-body mocap, IMU, and hierarchical language annotations for embodied AI, robotics, and world modeling research.

rgbaudiodepthproprioception+3
2.3M downloadsother

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes with cross-modal contextual instructions derived from spoken dialogue, environmental sounds, and visual cues rather than explicit commands.

rgbaudiolanguage
45K downloads2025cc-by-nc-4.0

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes across 112 skills and 748 objects, enriched with audio, visual, and contextual instruction data for cross-modal intention recognition.

rgbaudiolanguage
42K downloads2025cc-by-nc-4.0

OmniAction

A large-scale multimodal dataset for proactive robot manipulation with 141,162 episodes covering contextual instruction following through spoken dialogue, environmental sounds, and visual cues.

rgbaudiolanguage
11K downloads2025cc-by-nc-4.0

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes with contextual instructions derived from spoken dialogue, environmental sounds, and visual cues rather than explicit commands.

rgbaudiolanguage
3K downloads2025cc-by-nc-4.0

FuSe

FuSe contains 26,866 trajectories collected on a WidowX robot with visual, tactile, sound, and action data across multiple environments, annotated with natural language instructions.

rgbtactileaudioproprioception
2K downloads2025mit