Data Engineer

San Francisco, CA

We are a small team with a shared belief in the future of Intelligence. At Verterra, you won't just be working on Intelligence — you'll be helping define its future.

About the role

We are looking for a Data Engineer to join our team. You will engineer and design the data pipeline for ingestion, storage, and analysis of our dataset.

What you'll work on

• Build and scale the data backbone for our Foundational World Model, ingesting 10 PB/month of multimodal Human Action Data from Insight Glasses, synthetic simulators and autonomous robots
• Design robust ETL/ELT pipelines for RGB-D video, IMU, LiDAR, language and control-signal streams; support both real-time (Kafka/Pulsar) and batch (Spark/Flink/Beam) processing
• Implement dataset versioning, quality metrics and auto-label/augmentation workflows that accelerate the sim-to-real loop and keep our training pipeline 10x faster & 40x cheaper than incumbents
• Optimize storage, compression and retrieval across on-prem GPU clusters and cloud object stores to keep petabytes of data query-able in seconds
• Partner with Research, Kernel and Infra teams to surface data insights, ship new sensors, and spin up novel data sources in hours—not weeks

What we're looking for

• 5+ years building large-scale, distributed data systems; deep knowledge of columnar formats (Parquet/Iceberg), streaming frameworks and orchestration tools
• Hands-on experience with video / depth / sensor pipelines or other high-bandwidth, multimodal data
• Strong coder in Python and at least one systems language (Rust/C++); comfortable profiling and tuning at the byte-level
• Familiarity with ML workflows (feature stores, dataset lineage, experiment tracking) and containerized cloud / on-prem hybrid infra
• Bonus: background in robotics, AV telemetry or reinforcement-learning data
• We hire for ability, not credentials — if you're obsessed with turning raw experience into intelligence, we want to hear from you

Compensation, benefits, and perks

• Annual salary: $260K
• 401(k) plan with 6% salary matching
• Generous health, dental and vision insurance for you and your dependents
• Unlimited paid time off
• Visa sponsorship and relocation stipend to bring you to SF, if possible
• A small, fast-paced, highly focused team