Data Elephant Logo

Data Elephant

Databricks Engineer (Contract)

Posted 8 Days Ago
Be an Early Applicant
In-Office
Calgary, AB, CAN
Senior level
In-Office
Calgary, AB, CAN
Senior level
Designs, builds, migrates, and optimizes modern data platforms on Azure Databricks. Responsibilities include developing batch and streaming pipelines, implementing Delta Lake and Unity Catalog governance, integrating Azure services, improving performance and cost, supporting data migrations, and applying CI/CD, security, and data quality practices. The role involves architecture decisions, client collaboration, knowledge transfer, documentation, and hands-on delivery at client locations in Calgary.
The summary above was generated by AI

We are seeking an experienced Databricks Engineer to join our delivery team on a contract basis to design, build, and optimize modern data platforms on Azure Databricks. In this strategic role, you will work directly with both Data Elephant and client data and analytics teams, helping them migrate, modernize, and scale their data workloads while applying best practices in data engineering, security, ML, AI and data governance. This is a hands-on engineering role with strong exposure to architecture decisions, client interaction, and end-to-end delivery.


Responsibilities

  • Play an integral project team role in the implementation of modern data platforms and architectures on Databricks (including ETL, workload migrations, and Unity Catalog).
  • Design and implement data pipelines using Azure Databricks (PySpark, SQL)
  • Build and optimize batch and streaming data workloads
  • Migrate legacy data workloads to Azure + Databricks
  • Implement Delta Lake patterns (medallion architecture, CDC, data quality)
  • Integrate Databricks with Azure services such as ADLS, ADF, Azure Key Vault and DevOps/Github
  • Optimize performance and cost (cluster sizing, job orchestration, query tuning)
  • Collaborate with solution architects, analytics engineers, and client stakeholders
  • Contribute to reusable accelerators, standards, and internal best practices
  • Support client enablement through knowledge transfer and documentation
  • Provide hands-on solution delivery, including guiding and working closely with client engineers and ensuring best practices.
  • Implement governance models and Unity Catalog including data access, lineage, and security frameworks.

QUALIFICATIONS

  • 7+ years of experience in data engineering.
  • 4+ years of recent, hands-on experience building production solutions with Databricks, including advanced features such as Delta Lake, Unity Catalog, and MLflow.
  • Strong experience developing data pipelines using PySpark and SQL.
  • Proven experience leading large-scale data migrations, including ETL workloads and cloud platform migrations.
  • Strong expertise with Microsoft Azure and experience working with Azure data services, including ADLS, Azure Data Factory (ADF), Synapse Analytics, Azure Key Vault, and Azure DevOps.
  • Strong understanding of modern data architectures, including lakehouse, medallion architecture, and ELT/ETL.
  • Experience implementing CI/CD practices for data workloads.
  • Strong understanding of enterprise data governance, security, and compliance best practices.
  • Excellent communication skills with experience working directly with client teams.
  • Previous consulting or professional services experience is strongly preferred.
  • Databricks and Microsoft Azure certifications are considered an asset.

Be part of Canada’s leading boutique consulting firm focused on Databricks and modern data platforms.

  • Work on challenging, high-impact projects with mid-sized and enterprise clients across industries
  • Collaborate with a senior, high-performing team that values speed, pragmatism, and client success.

This role requires regular onsite work at a client location in Calgary. 

Similar Jobs

14 Hours Ago
Easy Apply
Remote or Hybrid
2 Locations
Easy Apply
Mid level
Mid level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage end-to-end implementation and adoption of Samsara’s IoT solutions for mid-market customers. Responsibilities include creating launch plans, tracking implementation progress and account health, delivering product training, demonstrating technology, resolving challenges, and coordinating with Sales, Support, Sales Engineering, and Product. The role requires strong customer communication, consultative implementation skills, technical product experience, stakeholder management, and fluency in English and French.
Top Skills: Equipment MonitoringIotSaaSSamsara Connected Operations CloudVehicle Telematics
Yesterday
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Mid level
Mid level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage strategic customer relationships after implementation, creating success plans, conducting executive business reviews, leading workshops, supporting French-speaking implementations, and advising customers on Samsara’s IoT platform. Collaborate with Sales, Support, Engineering, and Product to solve problems, drive adoption, remove barriers, and deliver measurable operational value. Mentor Customer Success and Support teams while promoting customer-focused company principles.
Top Skills: IotSaaSSamsara Connected Operations Cloud
Yesterday
Easy Apply
Remote or Hybrid
Canada
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Architect, develop, debug, test, deploy, and support customer-facing firmware features in C/C++ and Golang for cloud-connected hardware. Build observability and rollout metrics for more than 1.5 million devices, triage customer and QA issues, and collaborate across hardware, networking, product, support, and engineering teams to deliver reliable IoT vehicle intelligence products.
Top Skills: BuildkiteC++CanCan-UtilsDatabricksGoGraphQLIotLinuxLinux DriversLteUsbWi-Fi

What you need to know about the Calgary Tech Scene

Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account