Fastino Logo

Fastino

Staff SW Engineer

Posted 23 Days Ago
In-Office or Remote
Hiring Remotely in CA
Senior level
In-Office or Remote
Hiring Remotely in CA
Senior level
Define platform architecture, build agent runtimes and evaluation harnesses, scale AI training and inference pipelines, and deploy Fastino into customer-managed AWS environments. Develop secure sandboxed execution for agent workloads, ship full-stack features, partner with AI researchers, mentor engineers, guide AI coding agents, and translate customer feedback into product decisions.
The summary above was generated by AI

Staff Software Engineer

Full-time | San Francisco

Introduction:

  • Join us at Fastino as we build the next generation of LLMs. Our team, boasting alumni from Google Research, Apple, Stanford, and Cambridge, is on a mission to develop specialized, efficient AI.

  • Fastino's GLiNER family of open source models has been downloaded more than 50 million times and is used by companies such as NVIDIA, Meta, and Airbnb

  • Fastino has raised $25M (as featured in TechCrunch) through our seed round and is backed by leading investors including Microsoft, Khosla Ventures, Insight Partners, GitHub CEO Thomas Dohmke, Docker CEO Scott Johnston, and others.

What You’ll Work On:

  • Help define the technical direction for Fastino’s platform, contributing to the architecture decisions that let us scale without slowing down.

  • Design and build our agent harness, including the runtime loop, tool calling, context management, and error recovery, plus the eval harnesses that measure agent reliability.

  • Build and scale our AI training and inference pipelines, pushing on latency, throughput, and cost as usage grows.

  • Own deployment of the Fastino platform into customer-managed AWS VPCs using Kubernetes and Terraform, including install, upgrade, and observability paths that work in environments we don’t control.

  • Build secure sandboxed execution environments for agentic workloads on Modal Sandboxes.

  • Ship full-stack features end-to-end while owning the hardest, most ambiguous problems on the team.

  • Partner closely with AI researchers to take new models from research to production, including deployment, evaluation, and monitoring.

  • Raise the engineering bar through code reviews, mentorship, and setting practices the rest of the team builds on, including how we work with AI coding agents.

  • Talk to customers and turn their feedback into product decisions, fast.

What We’re Looking For:

  • Required: 8+ years of hands-on software engineering experience, including time as a tech lead or driving architecture across a team or product.

  • Required: Strong architectural skills, with a track record of designing and scaling production systems that handle real load.

  • Required: Production experience with agentic systems, AI training pipelines, or inference pipelines, ideally more than one.

  • Required: Hands-on experience deploying software on AWS with Kubernetes and Terraform, ideally into customer-managed or multi-tenant environments.

  • Required: Experience building and running sandboxed execution environments for agent workloads, ideally with Modal Sandboxes.

  • Required: Extensive experience building with AI coding agents, and a demonstrated ability to guide them to produce clean, production-quality code. You know how to scope tasks, review output critically, and catch what agents get wrong.

  • Required: You thrive in ambiguity, make good calls without a playbook, and know when to move fast versus when to build for the long term.

  • Optional: Experience building agent harnesses or frameworks used in production, including familiarity with MCP or similar tool protocols.

  • Optional: Experience with LangSmith or similar tooling for tracing, evaluating, and monitoring agents.

  • Optional: Hands-on experience with inference optimization, like batching, quantization, GPU utilization, or serving frameworks such as vLLM, SGLang, or Triton.

  • Optional: Deep experience with high-concurrency backend systems or low-latency API design.

  • Optional: Startup experience, ideally as an early engineer helping a team grow.

Similar Jobs

13 Hours Ago
Easy Apply
Remote or Hybrid
2 Locations
Easy Apply
Mid level
Mid level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage end-to-end implementation and adoption of Samsara’s IoT solutions for mid-market customers. Responsibilities include creating launch plans, tracking implementation progress and account health, delivering product training, demonstrating technology, resolving challenges, and coordinating with Sales, Support, Sales Engineering, and Product. The role requires strong customer communication, consultative implementation skills, technical product experience, stakeholder management, and fluency in English and French.
Top Skills: Equipment MonitoringIotSaaSSamsara Connected Operations CloudVehicle Telematics
15 Hours Ago
In-Office or Remote
Mid level
Mid level
Information Technology • Software • Travel
Build and maintain a mature SaaS platform across Rails backend, JSON APIs, MySQL, and Vue.js frontend. Develop travel features, partner integrations, AI-powered functionality, and document generation; optimize performance, write automated tests, upgrade dependencies, address security issues, investigate production incidents, review code, and document work. The role requires autonomous feature ownership, careful work in a large codebase, and collaboration through Git and pull requests.
Top Skills: Amazon CloudfrontAmazon S3Aws EcsAws LambdaCapybaraDockerFactorybotGitGithub ActionsJavaScriptJson ApisMySQLRspecRubyRuby On RailsSentryVueVuetify
Yesterday
Remote
Canada
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads complex, cross-functional technology programs and projects from initiation through delivery. Establishes governance, delivery plans, milestones, dependencies, risk frameworks, and stakeholder cadences. Partners with Product and Engineering leadership to translate strategic roadmaps into executable release plans, manages critical-path issues and escalations, and drives release readiness across multiple teams. The role also improves program execution, release governance, transparency, quality, and delivery velocity in a healthcare technology environment.
Top Skills: AgileAha!Hybrid Delivery ModelsJIRASoftware Development Lifecycle (Sdlc)

What you need to know about the Calgary Tech Scene

Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account