Genesis Jobs

Data Infrastructure

Genesis

Data Infrastructure

Posted 6 Days Ago

Be an Early Applicant

In-Office or Remote

Hiring Remotely in CA

Senior level

In-Office or Remote

Hiring Remotely in CA

Senior level

Design, build, and maintain petabyte-scale batch and streaming data pipelines and core data infrastructure for robotics foundation model training. Own data models, storage, ingestion, transformation, and orchestration. Standardize pipelines across teleoperation and simulation datasets and collaborate with cross-functional team to support Physical AI development.

The summary above was generated by AI

What You’ll Do

Design, build, and maintain large-scale data pipelines (batch and streaming) for robotics foundation model training and evaluation at petabyte scale
Own core data infrastructure: data model, storage systems, ingestion pipelines, transformation frameworks, and orchestration layers
Standardize data models and unify processing pipelines across real-world teleoperation and synthetic simulation datasets
Collaborate with a team of driven individuals committed to building general-purpose Physical AI

What You’ll Bring

Excellent software engineering skills (Python, Go, or similar)
Extensive experience designing, building, and maintaining large-scale data pipelines (8+ years)
Deep understanding of distributed systems (Spark, Kafka, or similar)
Extensive experience with data storage technologies (data lakes, warehouses, object stores like S3)
Experience running and maintaining production-grade infrastructure (Kubernetes, Terraform)
Bonus: Experience supporting AI systems, in particular embodied AI like self-driving

Similar Jobs

Kranz Consulting

Senior Director of Marketing

6 Days Ago

In-Office or Remote

Senior level

Financial Services

Lead and build the marketing function for a real-time data infrastructure company: set strategy and brand positioning, create messaging for developer and enterprise audiences, run high-priority campaigns and launches, manage a small team and vendors, own budget and KPIs, and partner closely with Sales, Product, Engineering, and executive leadership.

Top Skills: Data InfrastructureOpen-Source Developer ToolsStreaming

Veeda AI

Senior Machine Learning Engineer

Yesterday

Remote or Hybrid

Senior level

Artificial Intelligence • Computer Vision • Machine Learning • Robotics

Design, build, and operate large-scale crawling, ingestion, and ETL/ELT pipelines for petabyte-scale image and video datasets. Optimize distributed processing (Ray/Spark/Dask), ensure dataset provenance/versioning, reduce cost/latency, and collaborate with CV engineers and ML scientists. Provide technical leadership and mentor junior engineers.

Top Skills: AirflowAws S3CocoDagsterDaskDockerDvcGcp GcsKubernetesLakefsOpencvPandasPascal VocPillowPrefectPysparkPythonRayScikit-ImageSparkSQLYolo

ClickHouse

Infrastructure Engineer

22 Days Ago

Remote

Canada

Senior level

Database • Analytics

Design, build, and operate cloud-native, serverless ClickHouse database infrastructure. Develop and maintain Kubernetes operators, improve metrics pipelines, support data ingestion/transformation (Spark/Kafka), collaborate with core DB and data plane teams, and ensure scalable, highly available distributed systems with production on-call responsibilities.

Top Skills: AWSAzureC++ClickhouseEc2GCPGoJavaKafkaKubernetesKubernetes OperatorPagerdutySpark

What you need to know about the Calgary Tech Scene

Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.