Cuesta Partners Logo

Cuesta Partners

Databricks Architect | Canada

Posted Yesterday
Be an Early Applicant
Remote
Hiring Remotely in Canada
Senior level
Remote
Hiring Remotely in Canada
Senior level
Lead design, build, and deployment of production-grade Databricks data platforms across AWS/Azure. Architect scalable ETL/ELT pipelines with Spark/PySpark, manage Delta Lake and Unity Catalog, implement CI/CD and IaC, provide client-facing technical leadership, and mentor engineering teams.
The summary above was generated by AI

About Cuesta Partners We are looking for a Databricks Architect to lead the delivery of data engineering solutions in a client-facing environment. This is a hands-on leadership role where you will work directly with clients — including C-level stakeholders — to design, build, and deploy production-grade Databricks platforms.

What You’ll Do

  • Design and architect scalable Databricks-based solutions for enterprise clients.

  • Lead end-to-end cloud data platform implementations across AWS and/or Azure.

  • Design and build production pipelines using Databricks Workflows and Spark Declarative Pipelines.

  • Design scalable ETL/ELT pipelines using Spark, PySpark, and Databricks Workflows.

  • Partner directly with client stakeholders to understand business needs and translate them into technical solutions.

  • Provide technical leadership and guidance to data engineering teams.

  • Implement CI/CD pipelines and infrastructure-as-code for Databricks resources.

  • Drive collaborative development through Git workflows, pull requests, and code reviews.

  • Collaborate cross-functionally with analytics, engineering, and business teams.

  • Serve as the primary technical point of contact for clients, including C-level executives.

What We’re Looking For

  • 6+ years of experience in Data Engineering, Cloud Architecture, or related roles.

  • 3+ years of hands-on experience with Databricks.

  • Strong proficiency in PySpark, Spark SQL, Python, and SQL.

  • Deep experience with Delta Lake, Unity Catalog, Delta Live Tables, and Databricks Jobs.

  • Proven experience delivering Databricks projects in a consulting or professional services environment.

  • Strong understanding of data lake concepts and formats (Delta, Iceberg, Parquet, etc.).

  • Experience designing and managing Unity Catalog for governance, access control, and lineage.

  • Familiarity with medallion architecture (bronze/silver/gold) patterns.

  • Hands-on experience with Git version control, pull requests, code reviews, and collaborative development workflows.

  • CI/CD and infrastructure-as-code for Databricks resources (Terraform, Asset Bundles, GitHub Actions).

  • MLflow experience: experiment tracking, model registry, deployment, and observability.

  • Cloud platform experience.

  • Experience working in client-facing, consulting, or cross-functional environments.

  • Experience leading technical projects or mentoring engineering teams.

Nice to Have

  • Databricks certifications (Data Engineer Associate or Professional, Machine Learning Associate or Professional, Data Engineer Associate or Professional or ML Engineer Associate or Professional).

  • Experience with agentic AI workflows, including agents, skills, and tools on the Databricks side (Agentbricks), as well as LangChain and Claude agentic workflows.

Benefits: What you’ll gain:

  • At Cuesta, we value entrepreneurship, humility, diversity, learning, speed, and balance. We provide our team members with:

  • Constant opportunities for exposure & learning

  • Flexible working location and enabling personal-life harmony with work

  • Agency and influence in the company’s total strategy and direction

  • Collaboration with a high-performing team

  • Competitive base salary (outlined in this listing) and target bonus of 20-25%

  • 401k, healthcare benefits, paid time-off, and more!

Similar Jobs

2 Hours Ago
Remote or Hybrid
Canada
Senior level
Senior level
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Lead design and rollout of a fit-for-purpose data governance program: manage data lifecycle, implement governance frameworks and tools, drive data catalogs/lineage, upskill stewards, define KPIs, and partner cross-functionally to improve data quality, compliance, and usability.
Top Skills: AIData CatalogsData Governance ToolsData LineageMetadata ManagementSQL
10 Hours Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Sell SaaS licenses and generate new business through account and territory planning, prospect research, and field sales. Build C-suite relationships, lead cross-functional account strategies, advise on IT roadmaps and AI integration, identify specialists to win deals, negotiate contracts, and meet sales targets. Role requires travel and collaboration with solutions, success, partners, and marketing teams.
Top Skills: AISaaSServicenow
10 Hours Ago
Easy Apply
Remote
Canada
Easy Apply
Senior level
Senior level
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Lead end-to-end COGS and gross margin analysis across hardware and software product lines. Build scenario models, quantify cost-saving opportunities, and present defensible recommendations to C-suite. Tackle ambiguous executive questions, partner with data engineering, finance, and product to establish reliable datasets, and drive analytical best practices and documentation. Operate autonomously with high ownership.
Top Skills: SQL

What you need to know about the Calgary Tech Scene

Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account