Robotics

Workplace Egocentric Video Data for General-Purpose Robotics

9.8K+ hoursAccepted workplace egocentric video hours
summary.md

Challenge:Robotics training datasets are overwhelmingly collected in controlled lab environments or staged settings that fail to represent real-world work conditions — cluttered spaces, time pressure, improvised tool use, and the contextual decision-making that workers perform unconsciously.

Solution:We embedded data capture directly into real-world business operations across multiple countries and 10 workplace categories.

Result:The program established a fundamentally new data source for robotics research: active workplaces as scalable, cost-efficient contributors of egocentric training data.

9.8K+ hoursAccepted workplace egocentric hours
17Workplace categories with 100+ accepted hours each
42 countriesCountries with accepted workplace capture
2,300+Approved workplace contributors
// THE CHALLENGE

Robotics training datasets are overwhelmingly collected in controlled lab environments or staged settings that fail to represent real-world work conditions — cluttered spaces, time pressure, improvised tool use, and the contextual decision-making that workers perform unconsciously. Existing egocentric video datasets capture household tasks performed by research participants, but the distribution gap between a researcher's kitchen and a commercial kitchen during service is enormous. The lab needed a partner who could embed data collection into actual business operations without disrupting workflows, while meeting the quality and diversity requirements of frontier robotics research across multiple industries and geographies.

// OUR APPROACH

We embedded data capture directly into real-world business operations across multiple countries and 10 workplace categories. Business owners and workers were onboarded as contributors through a lightweight side-revenue model that kept participation voluntary and minimally disruptive to normal workflow.

Workplace categories spanned food service (barista, cooking), skilled trades (carpentry, tailoring, screen printing), repair services (phone repair, tool repair), textile work (clothing shop, ironing), and assembly (furniture assembly, paper cutting). Tasks were designed for handheld smartphone recording at 4K 60fps — no specialized hardware required. Research-level specifications for camera angle, framing, and activity coverage were translated into practical instructions that respected workplace realities: space constraints, safety requirements, hygiene protocols, and varying levels of technical comfort.

Activity coverage and task diversity were tracked continuously through a real-time monitoring dashboard. We balanced collection across workplace types and across task complexity levels within each type. QA validation focused on the characteristics that distinguish genuine workplace data from staged alternatives: natural pacing, contextual tool selection, environmental adaptation, and multi-step task sequencing under real constraints.

01
PartnerOnboard businesses across 17 workplace categories as data sources
02
InstructTranslate research specs into smartphone task guides per category
03
CaptureWorkers record 4K/60fps egocentric video during normal workflow
04
ValidateQA on natural pacing, framing, and task coverage
05
DeliverFormatted datasets with workplace-type metadata and activity labels
// FOOTAGE

Workplace footage on Explore

Public clips from Claru Explore's work-activity folders, shown muted.

Welding metal pieces at a workshop bench
Guiding fabric through an industrial overlock machine
Handling wheel weights at a tire-balancing machine
Brushing egg wash onto proofed loaves
Browse Manufacturing on Explore
// QUALITY GATES
  1. Natural pacingWork happens at real speed under real time pressure, not slowed down for the camera.
  2. Contextual tool selectionWorkers pick and switch tools the way they do on the job.
  3. Environmental adaptationFootage shows work around clutter, space limits and safety constraints.
  4. Multi-step sequencingTasks run as connected steps under real constraints, not isolated motions.
  5. Coverage balanceCollection balanced across workplace types and task complexity, tracked on a live dashboard.
// RESULTS
9.8K+ hoursAccepted workplace egocentric hours
17Workplace categories with 100+ accepted hours each
42 countriesCountries with accepted workplace capture
2,300+Approved workplace contributors
// WHAT THE CUSTOMER RECEIVED

Formatted egocentric datasets per workplace category.

Smartphone egocentric video
Handheld 4K, 60 fps recordings made during normal workflow.
Workplace-type metadata
Each clip tied to its workplace category.
Activity labels
Per-clip labels for the work performed.
// IMPACT

The program established a fundamentally new data source for robotics research: active workplaces as scalable, cost-efficient contributors of egocentric training data. The first 10 workplace categories proved the model generalizes beyond food service; the program has since grown to 17 categories each carrying 100+ accepted hours — retail, construction, agriculture, personal care, restaurants, carpentry, textile, warehouse, and more — with accepted capture in 42 countries from 2,300+ approved contributors. The behaviors captured — improvisation under time pressure, adaptation to cluttered and constrained spaces, contextual tool selection — represent precisely the distribution that lab-collected datasets lack, and the operational model (side-revenue for businesses, smartphone capture, lightweight onboarding) remains economically viable for sustained collection at scale.

// WHY IT MATTERS

General-purpose robotics requires training data from the environments where robots will actually be deployed. The behaviors captured in active work environments — the improvisation, the physical constraints, the contextual decision-making — cannot be replicated in staged settings. This program showed that real workplaces across 17 categories are a scalable, cost-efficient dataset source without requiring specialized hardware or disrupting operations. For robotics labs, it opens a data collection channel that scales with the number of participating businesses rather than the number of available research facilities.

// DECISIONS WE MADE
Pay businesses, don't stage setswhyA side-revenue model keeps participation voluntary and the workflow real.
Phones, not specialized rigswhySmartphone capture removes hardware logistics and lowers the bar for workers to take part.
Rewrite research specs as shop-floor instructionswhyCamera angle, framing and coverage specs had to respect space, safety and hygiene rules.
// SAMPLE DATA

Representative record from the annotation pipeline.

workplace_video_sample.json
// VIDEO SAMPLE
// WORKPLACE CATEGORIES (10)
☕
BaristaFood Service

Espresso prep, milk steaming, order assembly

🍳
CookingFood Service

Ingredient prep, stove work, plating

🔨
CarpentrySkilled Trades

Sawing, sanding, joint assembly

✂️
TailoringSkilled Trades

Cutting, stitching, fitting

🎨
Screen PrintingSkilled Trades

Screen prep, ink application, drying

🔧
Phone RepairRepair Services

Disassembly, component swap, testing

⚙️
Tool RepairRepair Services

Diagnosis, part replacement, calibration

🧵
Clothing ShopTextile Work

Fabric handling, folding, display

👕
IroningTextile Work

Steam pressing, garment finishing

🪑
Furniture AssemblyAssembly

Part alignment, fastening, hardware install

// INDUSTRY GROUPS
Food Service(2)
Skilled Trades(3)
Repair Services(2)
Textile Work(2)
Assembly(1)
// CAPTURE SPECS
Resolution3840x2160
Frame Rate60 fps
HardwareSmartphone
PerspectiveEgocentric (1st person)
Session Length5-15 min
Onboarding<48 hours
// FAQ

Ready to build your next dataset?

Tell us about your project and we will scope a plan within 48 hours.