Train and operate production machine learning models on Amazon SageMaker using AWS Trainium. Optimize PyTorch code for Trainium compilation, memory, throughput, and distributed training; diagnose hardware, compiler, device, data, and code issues; build cost-aware end-to-end training pipelines; and collaborate directly with client and internal engineering teams to deliver production workloads.
Robots & Pencils is an AWS Partner building production AI systems for enterprise clients who need real engineering, not proofs of concept that never ship. We work forward-deployed, embedded directly with client teams, solving the problems that are too new or too specialized for a typical vendor relationship to handle.
The Role
We're looking for an engineer who can operate and train models on Amazon SageMaker running on AWS Trainium, AWS's custom silicon built specifically for large-scale model training. This isn't a role where you call an API and wait. You'll be walking up the stack: understanding what a training request actually looks like at the Trainium hardware and compiler level, then carrying that understanding all the way up through PyTorch training code and into a production SageMaker pipeline.
PyTorch is the backbone of this work. If you know the framework deeply and you're comfortable reasoning about how your code actually behaves on custom accelerator hardware rather than treating it as a black box, this role is built around that skill set specifically.
What You'll Do
- Train and operate models on Amazon SageMaker with AWS Trainium as the underlying compute
- Write and optimize PyTorch training code with a real understanding of how it compiles and executes on Trainium (NeuronCore architecture, compiler behavior, memory and throughput tradeoffs)
- Diagnose training run issues that show up specifically because of the hardware, not just the model, distinguishing a data or code problem from a compiler or device-level one
- Translate a request for "a Trainium job" into an actual working, cost-aware training pipeline, end to end
- Tune distributed training runs for throughput and cost on SageMaker's training infrastructure
- Work directly with client and internal engineering teams to scope and deliver real production training workloads, not experiments that stay in a notebook
What You'll Bring
- Strong, hands-on PyTorch experience, ideally including distributed or multi-device training
- Production experience with Amazon SageMaker for training and/or inference
- Comfort working close to the hardware layer: you understand device-specific compilation and can debug issues that are actually about the accelerator, not just the model
- AWS Trainium or Inferentia (Neuron SDK) experience is a strong plus; if you don't have it yet but have deep PyTorch and a track record of picking up new hardware targets fast, we want to talk to you
- Solid Python fundamentals and comfort operating in a client-facing, production engineering environment
Robots & Pencils Calgary, Alberta, CAN Office
1507 14 Ave SW, Calgary, Alberta, Canada, T3C 0W4
Similar Jobs
Big Data • Fintech • Mobile • Payments • Financial Services
Own the operational health of strategic merchant integrations through monitoring, troubleshooting, SLA delivery, root-cause analysis, and technical inquiry resolution. Design custom API integration solutions, lead cross-functional technical initiatives, influence product roadmaps, develop playbooks and runbooks, manage strategic accounts, and mentor other Technical Account Managers.
Top Skills:
ChronosphereHTMLHTTPJavaScriptJIRANotionPostmanPythonRestful ApisSnowflakeSQLWebhooks
Artificial Intelligence • Edtech • Machine Learning • Software
Own and scale QuillBot’s global affiliate program by recruiting and activating partners, managing contracts and commissions, optimizing performance, and improving CAC, ROAS, ROI, attribution, and revenue quality. The role analyzes partner data, runs incentive and conversion experiments, oversees tracking and fraud controls, manages budgets, and collaborates with Creative, Product, Data, Engineering, Finance, and Legal teams.
Top Skills:
ImpactPartnerstack
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Architect and own marketing data infrastructure, including Databricks pipelines, Gold Layer tables, semantic models, and trusted analytics foundations. Lead cross-functional data initiatives, translate ambiguous business needs into scalable solutions, improve reliability and quality, and mentor engineers. Build and monitor production LLM and agent systems, automate workflows with AI, and deliver high-quality Python and SQL while validating AI-generated code. Partner with Marketing, Sales, BI, Data Science, and R&D teams.
Top Skills:
Ai AgentsBigQueryClaude CodeCursorData WarehousesDatabricksDbtEtl/EltLakehousesLlmsMarketing AutomationMartechPythonSalesforceSemantic LayersSnowflakeSQLStreamlitWeb Analytics
What you need to know about the Calgary Tech Scene
Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.
