pyintelapache-2.0

PyIntel Vantage: Spatial & Perspective Mixture

Name: PyIntel Vantage: Spatial & Perspective Mixture
Creator: pyintel
License: https://www.apache.org/licenses/LICENSE-2.0
Keywords: language, vision, spatial_reasoning, perspective_taking, theory_of_mind, visual_question_answering, simulation

A curated multimodal instruction dataset designed to teach compact edge language and vision models advanced 3D spatial reasoning, camera perspective translations, and multi-agent Theory of Mind through harmonized conversation pairs.

Downloads26
Episodes7712
Likes1

Why This Matters for Physical AI

This dataset enables robotics systems to develop robust 3D spatial reasoning and perspective-taking capabilities essential for embodied AI agents to understand multi-agent scenes and navigate complex interactive environments.

Technical Profile

Modalities: languagevision
Environment: simulation
Task Types: spatial_reasoningperspective_takingtheory_of_mindvisual_question_answering
Episodes: 7712
Data Format: parquet
Annotation Types: language_instructionschain_of_thought_reasoning
License: apache-2.0

Part of the PyIntel Vantage family

Access

View on HuggingFace

Need custom language data?

Claru builds purpose-built datasets for simulation applications with dense human annotations and quality assurance.

Request a Sample Pack

Related Datasets

Robo-MLT: Medical Laboratory Manipulation Datasets

Real-robot teleoperated demonstrations for two long-horizon medical laboratory workflows (blood gas analysis and tube sorting) collected on an Agilex dual-arm Static-Aloha platform with vision-language-action supervision.

rgbproprioceptionlanguage

null downloadsJul 2026apache-2.0gated

ACE-Data-0

A human-centric ambient capture dataset recording real home environments with synchronized multi-modal streams including egocentric video, exocentric video, human motion, object state, audio, and tactile sensing for embodied AI research.

rgbdepthimuaudio+3

245K downloadsOct 2026ace-data-0-research-license

In-The-Wild Humanoid Dataset

A large-scale dataset of whole-body humanoid robot learning in natural home environments, capturing human teleoperation demonstrations on Unitree G1 across real homes in Southeast Asia with varying layouts, lighting, and clutter.

rgbstereo_irproprioceptionimu+2

149K downloadsSep 2026

In-The-Wild Humanoid Dataset

A large-scale dataset of 500+ hours and 23K+ episodes of whole-body humanoid robot learning captured through human teleoperation demonstrations on Unitree G1 across real homes in Southeast Asia. The dataset includes synchronized visual observations, robot states, actions, and metadata for research on mobile manipulation, bimanual interaction, and long-horizon household skills.

rgbinfraredproprioceptionimu+2

149K downloadsSep 2026

OmniAction

A large-scale multimodal dataset for proactive robot manipulation comprising 141,162 episodes across 112 skills and 748 objects, enriched with audio, visual, and contextual instruction data for cross-modal intention recognition.

rgbaudiolanguage

117K downloadsMar 2026cc-by-nc-4.0

HiFi-UMI-2K: High-Fidelity Robot-Free Manipulation Data

A large-scale dataset of 2,000 hours of high-fidelity bimanual human manipulation demonstrations collected robot-free using the HiFi-UMI capture system, designed for action-grounded supervision for manipulation policy pre-training and deployment without requiring a robot during data collection.

rgbimuproprioceptionlanguage

114K downloadsJul 2026cc-by-4.0