FirstPrinciples Foundation Logo

FirstPrinciples Foundation

AI & HPC Infrastructure Engineer

Reposted 21 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in Ontario, ON, CAN
Senior level
Remote
Hiring Remotely in Ontario, ON, CAN
Senior level
Design, deploy, and operate Kubernetes, GPU, and HPC compute across bare metal and cloud. Manage scheduling (Slurm/K8s), CUDA and drivers, storage, observability, IaC, deployment workflows, and support researchers to ensure reliable, scalable inference and research infrastructure.
The summary above was generated by AI
About FirstPrinciples

FirstPrinciples is a research organization building AI infrastructure for discovery in fundamental science. Currently, our work focuses on building systems like Theo, the AI Physicist, which is a domain-specialized system for research in fundamental physics.

We’re a fast-growing, remote-first team of builders, researchers, engineers, and thinkers working across Canada, the US, the UK, and expanding globally. What brings us together is a shared curiosity about how the universe works, and a belief that we can build systems that help us explore it more effectively.

We spend our time working on questions that don’t have clear answers, like how to design AI that can reason through scientific problems, and how the scientific process as a whole might evolve. This is work that sits somewhere between creativity and rigorous thinking, and often requires comfort with ambiguity and iteration. If you’re someone who enjoys tackling big, abstract problems and building the infrastructure that makes ambitious research possible, you’ll likely find the work here interesting.

Why This Role Exists

We’re building the next generation of infrastructure for AI-driven scientific discovery, and we need someone who can help own the systems that make our research and inference workloads reliable, scalable, and fast.

This role is about building and operating the compute foundation behind our AI Physicist: Kubernetes clusters, Linux systems, GPU infrastructure, cloud environments, HPC-style compute, deployment workflows, monitoring, and automation. As our workloads grow, we need infrastructure that can support both experimentation and production-like inference across cloud, bare metal, and hybrid environments.

You’ll play a central role in shaping how we run compute at FirstPrinciples. That includes provisioning and managing clusters, improving reliability and observability, reducing operational toil, supporting researchers and engineers, and helping us make practical decisions about when to use managed cloud services, self-managed Kubernetes, Slurm-style systems, or owned hardware.

We’re looking for someone hands-on, systems-oriented, and comfortable working in a fast-moving research environment. You should have strong Kubernetes and Linux fundamentals, good operational instincts, and enough experience with cloud and HPC/GPU infrastructure to help us build toward a robust bare metal and multi-cloud inference platform.

What You’ll Do
  • Design, deploy, and operate Kubernetes infrastructure for AI inference, research, and engineering workloads

  • Set up and manage GPU and HPC-style compute environments, including scheduling, utilization, job management, and node-level troubleshooting

  • Work with systems such as Kubernetes, Slurm or similar schedulers, container runtimes, GPU drivers & libraries (ie; CUDA), storage systems, and observability tools

  • Build and manage Linux-based compute environments, including provisioning, networking, storage, monitoring, access control, and lifecycle management

  • Help architect bare metal, cloud, and hybrid infrastructure across AWS, GCP, Azure, or equivalent platforms

  • Own the reliability and operational health of infrastructure systems, including monitoring, alerting, incident response, capacity planning, and performance tuning

  • Improve deployment workflows, automation, configuration management, secrets management, and infrastructure-as-code practices

  • Partner with ML engineers, researchers, and software engineers to understand workload requirements and translate them into practical infrastructure designs

  • Evaluate tradeoffs between managed cloud services, self-managed Kubernetes, HPC schedulers, bare metal deployments, and multi-cloud architectures

  • Build tooling, documentation, runbooks, and operational practices that help the team move quickly without making infrastructure fragile or opaque

  • Balance speed and robustness, knowing when to prototype quickly and when to harden systems for long-term use

Who You Are
  • Strong infrastructure builder with experience operating production, research, cloud, or high-performance compute systems

  • Deeply comfortable with Linux administration, including debugging networking, storage, system services, permissions, performance issues, and node-level failures

  • Experienced with Kubernetes in real environments, including cluster operations, deployments, networking, observability, scaling, and troubleshooting

  • Comfortable working with cloud infrastructure on AWS, GCP, Azure, or equivalent platforms

  • Familiar with infrastructure automation and configuration tools such as Terraform, Ansible, Helm, ArgoCD, GitOps workflows, or similar systems

  • Experienced with GPU-heavy, compute-heavy, or HPC-style workloads, especially in environments involving AI, ML, research computing, or scientific workloads

  • Able to work across bare metal and cloud environments, and interested in the practical tradeoffs between the two

  • Comfortable reasoning about resource scheduling, cluster utilization, autoscaling, storage, networking, and observability for distributed workloads

  • Practical and ownership-oriented; you can take ambiguous infrastructure needs and turn them into working systems

  • Comfortable collaborating across disciplines, especially with researchers and engineers who may not think in infrastructure terms

  • Able to operate independently as a senior or strong intermediate contributor, while knowing when to bring others into important technical decisions

  • Motivated by building foundational systems that make ambitious technical and scientific work possible

Bonus
  • Hands-on experience with production-grade LLM inference and serving engines, such as vLLM, SGLang, or TensorRT

  • Experience working at an AI company, ML infrastructure team, research lab, university compute environment, HPC center, or scientific computing organization

  • Experience supporting model inference, model serving, distributed training, high-throughput batch workloads, or internal ML platforms

  • Hands-on experience with Slurm or similar HPC schedulers, including job scheduling, resource allocation, queue management, and cluster configuration

  • Experience operating GPU infrastructure, including NVIDIA drivers, CUDA, container runtimes, scheduling, utilization, and hardware failure modes

  • Experience with RDMA, InfiniBand, high-performance networking, distributed filesystems (ie. Lustre, BeeGFS), object storage, or storage systems for compute-heavy workloads

  • Experience with Kubernetes operators, custom controllers, CRDs, or platform tooling for AI/ML workloads

  • Experience with Prometheus, Grafana, Loki, OpenTelemetry, Datadog, or similar monitoring, logging, and observability tools

  • Experience with container registries, image optimization, CI/CD systems, deployment pipelines, and secure software delivery

  • Experience leading engineering operations or infrastructure efforts while remaining hands-on technically

  • Familiarity with security, access control, secrets management, and reliability practices in production or research environments

What You’ll Get
  • The opportunity to work on foundational problems at the intersection of AI and physics

  • A high-trust, low-bureaucracy environment with real ownership

  • Remote-first work with flexibility in how you structure your day

  • Exposure to cutting-edge ideas across AI, scientific discovery, infrastructure, and emerging technologies

  • A culture that values curiosity, depth of thinking, and first-principles reasoning

  • The chance to shape the compute and inference infrastructure behind advanced AI systems for scientific discovery

Similar Jobs

3 Hours Ago
Remote or Hybrid
CA
Senior level
Senior level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Lead cross-team iOS engineering for Neighborhoods across Cash App and Square: define architecture, stay hands-on with SwiftUI/Workflow codebases, deliver integrated loyalty/ordering features, mentor engineers, and adopt AI-native workflows to accelerate development and quality.
Top Skills: BazelClaude CodeCombineCursorGooseObjective-CProtocol BuffersSwiftSwift ConcurrencySwiftuiUikitWorkflow
3 Hours Ago
Remote or Hybrid
CA
Expert/Leader
Expert/Leader
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Lead technical direction and architecture for Neighborhoods mobile experiences across Cash App and Square. Drive cross-organizational mobile initiatives, stay hands-on in iOS development, partner with backend/web/Android teams, mentor engineers, and apply AI-assisted workflows to accelerate feature development and quality.
Top Skills: BazelClaude CodeCombineCursorGooseObjective-CProtocol BuffersSwiftSwift ConcurrencySwiftuiUikitWorkflow
13 Hours Ago
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Mid level
Mid level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Build and ship internal data and AI products to help Product and Engineering teams. Analyze large structured and unstructured datasets, convert analyses into repeatable tools and dashboards, and drive end-to-end projects from scoping to launch and iteration. Use AI-assisted development tools responsibly, translate findings into decision-ready recommendations, and embed feedback loops and documentation for long-term adoption.

What you need to know about the Calgary Tech Scene

Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account