Astreya Logo

Astreya

Solutions Architect IV - AI

Posted 4 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in CA
Senior level
Remote
Hiring Remotely in CA
Senior level
Designs and leads production-grade generative AI and multi-agent platforms on AWS for regulated enterprise environments. Responsibilities include cloud architecture, RAG and document ingestion pipelines, agent orchestration, evaluation and observability frameworks, governance, UAT, and production readiness. The role partners with utility stakeholders, translates complex business workflows into AI solutions, leads cross-functional delivery, mentors engineers, and demonstrates measurable business impact through cost savings, efficiency, and operational improvements.
The summary above was generated by AI

What this Job Entails: 


We are seeking an experienced AI Solution Architect to design, build, and scale production-grade Generative AI and multi-agent platforms. Mirroring the delivery rigor required in regulated enterprise environments, this role bridges hands-on cloud AI engineering with consultative delivery leadership. You will architect shared, reusable AI platforms on AWS supporting high-stakes business domains—including regulatory compliance, energy contracts, finance, procurement, and operational quality—ensuring strict source grounding, cost efficiency, and measurable business return on investment (ROI).


Your Roles and Responsibilities:

Multi-Agent Platform & Cloud Architecture
  • Architect, deploy, and own production readiness for shared, multi-agent Generative AI platforms on AWS (Amazon Bedrock, AWS Lambda, Amazon ECS, Amazon OpenSearch, Terraform) that serve multiple business units from centralized enterprise knowledge bases.
  • Design multi-agent orchestration layers using frameworks such as LangGraph and LangChain, establishing reusable modular components and standardized design patterns that accelerate onboarding of new domain assistants.
  • Engineer advanced context-management strategies for long-running agent sessions—including on-demand skill and tool loading (progressive disclosure), Model Context Protocol (MCP) integrations, and prompt caching—to optimize latency and control token costs.
Enterprise Retrieval (RAG) & Ingestion Pipelines
  • Design and implement scalable document ingestion pipelines and hybrid retrieval architectures that combine semantic vector search, keyword search, and metadata filtering across large enterprise repositories (100+ GiB).
  • Establish chunking, reranking, and metadata strategies tailored to complex, heavily versioned utility documentation (such as regulatory filings, energy contract amendments, Standard Operating Procedures, and audit records).
  • Build strict guardrails for source grounding, citation traceability, and deterministic behavior within regulated quality and compliance workflows.
AI Evaluation, Observability & Governance
  • Develop rigorous, automated evaluation frameworks (including LLM-as-a-judge pipelines) that measure multi-dimensional answer quality, source recall and precision, and statistical confidence intervals across repeated runs.
  • Implement step-by-step agent observability and trace-based debugging using OpenTelemetry (OTel) and cloud evaluation tooling (such as AWS AgentCore Evaluations).
  • Design and execute structured User Acceptance Testing (UAT) protocols with business owners to validate traceability, accuracy, and compliance against business KPIs prior to production sign-off.
Technical & Delivery Leadership
  • Serve flexibly as Solution Architect, Tech Lead, or Delivery Lead depending on engagement needs—guiding cross-functional teams of data scientists and AI engineers through rapid prototyping, pilot validation, and full production rollout.
  • Partner directly with utility stakeholders across regulatory, legal/contracts, finance, and operations to translate complex workflows (such as tracing controlling language across contract amendments or automating regulatory filing quality checks) into high-ROI AI solutions.
  • Mentor junior engineers and developers on agentic design patterns, production software engineering best practices, and responsible AI governance.

Required Qualifications/Skills:

Required Qualifications
  • Experience: 8+ years of overall experience building enterprise data science, machine learning, and AI solutions, including 3+ years architecting and delivering production Generative AI and LLM applications.
  • Regulated Industry Delivery: Proven track record leading end-to-end AI delivery in regulated industries (Energy & Utilities strongly preferred; Financial Services, Telecommunications, Manufacturing, or Healthcare also relevant).
  • Production Impact: Demonstrated experience taking multi-agent or RAG platforms from prototype to active production adoption with measurable business impact (such as documented hours saved, cost reduction, or operational efficiency gains).
  • Cloud & Infrastructure (AWS): Hands-on architecture and deployment experience with Amazon Bedrock, OpenSearch, AWS Lambda, ECS, serverless and containerized AI patterns, cross-account environment promotion, and Infrastructure as Code (Terraform).
  • Agentic AI & Orchestration: Deep expertise in LangGraph, LangChain, prompt and context engineering, tool design, multi-agent workflows, prompt caching, and Model Context Protocol (MCP).
  • RAG & Evaluation: Practical mastery of hybrid search, metadata filtering, reranking, LLM-as-a-judge evaluation suites, grounding and citation verification, and OpenTelemetry trace debugging.
  • Programming & Data Engineering: Strong proficiency in Python, SQL, and FastAPI, with experience building scalable data and document ingestion and cleansing pipelines.
  • Education: Master’s or Bachelor’s degree in Information Systems, Data Science, Computer Science, Business Analytics, or a related quantitative discipline.
Preferred Qualifications
  • Prior technology or management consulting experience leading client-facing technical delivery, executive demonstrations, and UAT cycles.
  • Direct experience building AI assistants for energy contracts, regulatory filings, procurement, or quality and compliance workflows.
  • Familiarity with model fine-tuning and transfer learning, fairness metrics and bias mitigation frameworks (such as AIF360), and BI visualization tools (such as Power BI).
  • Relevant cloud or AI architecture certifications (such as AWS Certified Solutions Architect, AWS Certified Machine Learning, or Anthropic Certified Architect).

Physical Demand & Work Environment:

  • Must have the ability to perform office-related tasks which may include prolonged sitting or standing
  • Must have the ability to move from place to place within an office environment
  • Must be able to use a computer
  • Must have the ability to communicate effectively 
  • Some positions may require occasional repetitive motion or movements of the wrists, hands, and/or fingers

Salary Range

$114,000.00 - $180,000.00 USD (Salary)
  • Please note that the salary information provided herein is base pay only (gross); it does not include other forms of compensation which may or may not apply to this specific position, namely, performance-based bonuses, benefits-related payments, or other general incentives - none of which are guaranteed, may be subject to specific eligibility requirements, and are wholly within the discretion of Astreya to remit.
  • Further, the salary information noted above is a range that consists of a minimum and maximum rate of pay for this specific position. Where an applicant or employee is placed on this range will depend and be contingent on objective, documented work-related considerations like education, experience, certifications, licenses, preferred qualifications, among other factors.

Astreya offers comprehensive benefits to all Regular, Full-Time Employees, including:

  • Medical provided through UHC (PPO, HSA, Surest options) / Medical provided through Kaiser (HMO option only) for California employees only

  • Dental provided through UHC

  • Nationwide Vision provided by UHC

  • Flexible Spending Account for Health & Dependent Care

  • Pre-Tax Account for Commuter Benefit/Parking & Transit (location-specific)

  • Continuing Education and Professional Development via various integrated platforms, e.g. Udemy and Coursera

  • Corporate Wellness Program provided by Goomi Group

  • Employee Assistance Program

  • Wellness Days

    401k Plan

  • Basic and Supplemental Life Insurance

  • Short Term & Long Term Disability

  • Critical Illness, Critical Hospital, and Voluntary Accident Insurance

  • Tuition Reimbursement (available 6 months after start date, capped)

  • Paid Time Off (accrued and prorated, maximum of 120 hours annually)

  • Paid Holidays

  • Any other statutory leaves, paid time, or other ancillary benefits required under state and federal law

Similar Jobs

18 Hours Ago
Easy Apply
Remote or Hybrid
2 Locations
Easy Apply
Mid level
Mid level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage end-to-end implementation and adoption of Samsara’s IoT solutions for mid-market customers. Responsibilities include creating launch plans, tracking implementation progress and account health, delivering product training, demonstrating technology, resolving challenges, and coordinating with Sales, Support, Sales Engineering, and Product. The role requires strong customer communication, consultative implementation skills, technical product experience, stakeholder management, and fluency in English and French.
Top Skills: Equipment MonitoringIotSaaSSamsara Connected Operations CloudVehicle Telematics
20 Hours Ago
In-Office or Remote
Mid level
Mid level
Information Technology • Software • Travel
Build and maintain a mature SaaS platform across Rails backend, JSON APIs, MySQL, and Vue.js frontend. Develop travel features, partner integrations, AI-powered functionality, and document generation; optimize performance, write automated tests, upgrade dependencies, address security issues, investigate production incidents, review code, and document work. The role requires autonomous feature ownership, careful work in a large codebase, and collaboration through Git and pull requests.
Top Skills: Amazon CloudfrontAmazon S3Aws EcsAws LambdaCapybaraDockerFactorybotGitGithub ActionsJavaScriptJson ApisMySQLRspecRubyRuby On RailsSentryVueVuetify
Yesterday
Remote
Canada
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads complex, cross-functional technology programs and projects from initiation through delivery. Establishes governance, delivery plans, milestones, dependencies, risk frameworks, and stakeholder cadences. Partners with Product and Engineering leadership to translate strategic roadmaps into executable release plans, manages critical-path issues and escalations, and drives release readiness across multiple teams. The role also improves program execution, release governance, transparency, quality, and delivery velocity in a healthcare technology environment.
Top Skills: AgileAha!Hybrid Delivery ModelsJIRASoftware Development Lifecycle (Sdlc)

What you need to know about the Calgary Tech Scene

Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account