Cuesta Partners Logo

Cuesta Partners

Databricks Architect | Canada

Posted 3 Months Ago
Be an Early Applicant
Remote
Hiring Remotely in Canada
Senior level
Remote
Hiring Remotely in Canada
Senior level
Lead design, build, and deployment of production-grade Databricks data platforms across AWS/Azure. Architect scalable ETL/ELT pipelines with Spark/PySpark, manage Delta Lake and Unity Catalog, implement CI/CD and IaC, provide client-facing technical leadership, and mentor engineering teams.
The summary above was generated by AI

About Cuesta Partners We are looking for a Databricks Architect to lead the delivery of data engineering solutions in a client-facing environment. This is a hands-on leadership role where you will work directly with clients — including C-level stakeholders — to design, build, and deploy production-grade Databricks platforms.

What You’ll Do

  • Design and architect scalable Databricks-based solutions for enterprise clients.

  • Lead end-to-end cloud data platform implementations across AWS and/or Azure.

  • Design and build production pipelines using Databricks Workflows and Spark Declarative Pipelines.

  • Design scalable ETL/ELT pipelines using Spark, PySpark, and Databricks Workflows.

  • Partner directly with client stakeholders to understand business needs and translate them into technical solutions.

  • Provide technical leadership and guidance to data engineering teams.

  • Implement CI/CD pipelines and infrastructure-as-code for Databricks resources.

  • Drive collaborative development through Git workflows, pull requests, and code reviews.

  • Collaborate cross-functionally with analytics, engineering, and business teams.

  • Serve as the primary technical point of contact for clients, including C-level executives.

What We’re Looking For

  • 6+ years of experience in Data Engineering, Cloud Architecture, or related roles.

  • 3+ years of hands-on experience with Databricks.

  • Strong proficiency in PySpark, Spark SQL, Python, and SQL.

  • Deep experience with Delta Lake, Unity Catalog, Delta Live Tables, and Databricks Jobs.

  • Proven experience delivering Databricks projects in a consulting or professional services environment.

  • Strong understanding of data lake concepts and formats (Delta, Iceberg, Parquet, etc.).

  • Experience designing and managing Unity Catalog for governance, access control, and lineage.

  • Familiarity with medallion architecture (bronze/silver/gold) patterns.

  • Hands-on experience with Git version control, pull requests, code reviews, and collaborative development workflows.

  • CI/CD and infrastructure-as-code for Databricks resources (Terraform, Asset Bundles, GitHub Actions).

  • MLflow experience: experiment tracking, model registry, deployment, and observability.

  • Cloud platform experience.

  • Experience working in client-facing, consulting, or cross-functional environments.

  • Experience leading technical projects or mentoring engineering teams.

Nice to Have

  • Databricks certifications (Data Engineer Associate or Professional, Machine Learning Associate or Professional, Data Engineer Associate or Professional or ML Engineer Associate or Professional).

  • Experience with agentic AI workflows, including agents, skills, and tools on the Databricks side (Agentbricks), as well as LangChain and Claude agentic workflows.

Benefits: What you’ll gain:

  • At Cuesta, we value entrepreneurship, humility, diversity, learning, speed, and balance. We provide our team members with:

  • Constant opportunities for exposure & learning

  • Flexible working location and enabling personal-life harmony with work

  • Agency and influence in the company’s total strategy and direction

  • Collaboration with a high-performing team

  • Competitive base salary (outlined in this listing) and target bonus of 15-25%

  • 401k, healthcare benefits, paid time-off, and more!

Similar Jobs

13 Hours Ago
Easy Apply
Remote or Hybrid
2 Locations
Easy Apply
Mid level
Mid level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage end-to-end implementation and adoption of Samsara’s IoT solutions for mid-market customers. Responsibilities include creating launch plans, tracking implementation progress and account health, delivering product training, demonstrating technology, resolving challenges, and coordinating with Sales, Support, Sales Engineering, and Product. The role requires strong customer communication, consultative implementation skills, technical product experience, stakeholder management, and fluency in English and French.
Top Skills: Equipment MonitoringIotSaaSSamsara Connected Operations CloudVehicle Telematics
14 Hours Ago
In-Office or Remote
Mid level
Mid level
Information Technology • Software • Travel
Build and maintain a mature SaaS platform across Rails backend, JSON APIs, MySQL, and Vue.js frontend. Develop travel features, partner integrations, AI-powered functionality, and document generation; optimize performance, write automated tests, upgrade dependencies, address security issues, investigate production incidents, review code, and document work. The role requires autonomous feature ownership, careful work in a large codebase, and collaboration through Git and pull requests.
Top Skills: Amazon CloudfrontAmazon S3Aws EcsAws LambdaCapybaraDockerFactorybotGitGithub ActionsJavaScriptJson ApisMySQLRspecRubyRuby On RailsSentryVueVuetify
Yesterday
Remote
Canada
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads complex, cross-functional technology programs and projects from initiation through delivery. Establishes governance, delivery plans, milestones, dependencies, risk frameworks, and stakeholder cadences. Partners with Product and Engineering leadership to translate strategic roadmaps into executable release plans, manages critical-path issues and escalations, and drives release readiness across multiple teams. The role also improves program execution, release governance, transparency, quality, and delivery velocity in a healthcare technology environment.
Top Skills: AgileAha!Hybrid Delivery ModelsJIRASoftware Development Lifecycle (Sdlc)

What you need to know about the Calgary Tech Scene

Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account