BDO CANADA Logo

BDO CANADA

Senior Data Engineer (Databricks Focused)

Reposted 24 Days Ago
Be an Early Applicant
In-Office
Calgary, AB
Senior level
In-Office
Calgary, AB
Senior level
Lead data engineering efforts by designing and optimizing data pipelines using Databricks and Azure, mentor team members, and align data initiatives with business goals.
The summary above was generated by AI

Putting people first, every day
 

BDO is a firm built on a foundation of positive relationships with our people and our clients. Each day, our professionals provide exceptional service, helping clients with advice and insight they can trust. In turn, we offer an award-winning environment that fosters a people-first culture with a high priority on your personal and professional growth.

Your Opportunity

BDO Digital is seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services practice. This role blends technical leadership with hands-on data engineering, focusing on delivering scalable, secure, and production-grade data pipelines using Azure and Databricks. The successful candidate will also lead client engagements, aligning data initiatives with business objectives to create real-world impact.

Key Responsibilities
Data Engineering and Platform Development

  • Design, build, and optimize robust data pipelines using Databricks, Delta Lake, and Apache Spark.
  • Develop scalable ETL processes for structured and unstructured data, ensuring data quality and reliability.
  • Implement data integration solutions across cloud and on-premises sources, leveraging Databricks and Azure Data Lake.
  • Automate data ingestion, transformation, and validation workflows.
  • Monitor, troubleshoot, and enhance data pipeline performance and reliability.
  • Ensure compliance, security, and operational excellence across all data workflows.

Client and Team Leadership

  • Serve as a primary technical lead for client engagements focused on data engineering and analytics solution delivery.
  • Translate business requirements into scalable data architectures and operational plans.
  • Collaborate with cross-functional teams to integrate data solutions into production environments.
  • Mentor junior team members and promote adoption of best practices in data engineering and cloud analytics.

Data Application

  • Convert business requirements and analytics prototypes into robust, scalable data solutions.
  • Apply appropriate data modeling and transformation techniques to support analytics and machine learning initiatives.
  • Document data pipelines and contribute to internal knowledge sharing.

Qualifications
Required

  • Educational Background: A Bachelor’s or master’s degree in Computer Science, Data Engineering, Information Systems, or a closely related discipline. Strong foundation in data structures, algorithms, and distributed systems.
  • Professional Experience: A minimum of 5 years of hands-on experience in data engineering, including at least 3 years of direct experience with Databricks, Apache Spark, and cloud data platforms. Proven success in deploying and maintaining large-scale data solutions in production environments.
  • In-depth knowledge of the Microsoft Azure ecosystem, with demonstrated experience using services such as Azure Data Lake, Azure Databricks, Azure Synapse, and Azure DevOps.
  • Very strong proficiency with Databricks, including hands-on work with Delta Lake, Apache Spark, and data pipeline orchestration. Experience optimizing performance and reliability in production.
  • Advanced programming skills in Python and/or Scala, with practical experience using data engineering libraries and frameworks.
  • Solid understanding of CI/CD practices, with experience designing and maintaining pipelines using tools like GitHub Actions, Azure DevOps, or Jenkins. Familiarity with infrastructure-as-code tools such as Terraform or ARM templates for automating environment provisioning and deployment.
  • Excellent written and verbal communication skills, with the ability to effectively engage with a range of stakeholders, including data scientists, engineers, business partners, and executive leadership. Proven ability to explain technical concepts to non-technical audiences and influence decision-making.

Preferred

  • Certifications: Professional certifications such as Databricks Certified Data Engineer or Microsoft Certified, e.g. Azure Data Engineer Associate.
  • Experience with data governance, data security, and compliance frameworks.
  • Consulting experience and excellent communication and client management skills.


Why BDO?
Our people-first approach to talent has earned us a spot among Canada’s Top 100 Employers for 2025. This recognition is a milestone we’re thrilled to add to our collection of awards for both experienced and student talent experiences. 

Our firm is committed to providing an environment where you can be successful in the following ways: 

  • We enable you to engage with how we change and evolve, being a key contributor to the success and growth of BDO in Canada. 

  • We help you become a better professional within our services, industries, and markets with extensive opportunities for learning and development. 

  • We support your achievement of personal goals outside of the office and making an impact on your community.

Giving back adds up: Where company meets community. BDO is actively involved in our communities by supporting local charity initiatives. We support staff with local and national events where you will be given the opportunity to contribute to your community.


Total rewards that matter: We pay for performance with competitive total cash compensation that recognizes and rewards your contribution. We provide flexible benefits from day one, and a market leading personal time off policy. We are committed to supporting your overall wellness beyond working hours and provide reimbursement for wellness initiatives that fit your lifestyle.


Everyone counts: We believe every employee should have the opportunity to participate and succeed. Through leadership by our Diversity, Equity and Inclusion Leader, we are committed to a workplace culture of respect, inclusion, and diversity. We recognize and celebrate the valuable differences among each of us, including race, religious beliefs, physical or mental disabilities, age, place of origin, marital status, family status, gender or gender identity and sexual orientation. If you require accommodation to complete the application process, please contact us.

Flexibility: All BDO personnel are expected to spend some of their time working in the office, at the client site, and virtually unless accommodations or alternative work arrangements are in place.

Our model is a blended approach designed to support the flexible needs of our people, the firm and our clients. It’s about creating work experiences that meet everyone’s needs and providing flexibility to adjust when, where and how we work to meet the expectations of our role.

Code of Conduct: Our Code of Conduct sets clear standards for how we conduct business. It reflects our shared values and commitments and includes guiding principles to help us make ethical decisions and maintain trust with each other, our clients, and the public.

With your consent, BDO Canada may use AI technology (Microsoft Copilot) to transcribe during preliminary conversations, solely for the purpose of note-taking and not for other purposes, such as resume review, evaluation or selection of candidates.

More information on BDO Canada’s Privacy Policy can be found here: Privacy Policy | BDO Canada

Ready to make your mark at BDO? Click “Apply now” to send your up-to-date resume to one of our Talent Acquisition Specialists.

To explore other opportunities at BDO, check out our careers page

#LI-SA3

Top Skills

Spark
Arm Templates
Azure
Azure Data Lake
Azure Databricks
Azure Devops
Azure Synapse
Databricks
Delta Lake
Github Actions
Jenkins
Python
Scala
Terraform

BDO CANADA Calgary, Alberta, CAN Office

903 8 Ave SW, , Calgary, AB , Canada, T2P 0P7,

Similar Jobs

Yesterday
Easy Apply
Hybrid
7 Locations
Easy Apply
Senior level
Senior level
Big Data • Cloud • Software • Database
The Senior Software Engineer will develop a data migration suite, focusing on backend services, utilizing Java and streaming technologies, while collaborating with product teams.
Top Skills: DebeziumJavaKafkaMongoDBReactSpring BootSQL
Yesterday
In-Office or Remote
2 Locations
Senior level
Senior level
Productivity • Software • App development • Automation
Develop features for the Xodo platform, engage in all aspects of development, collaborate with other engineers, and research new projects.
Top Skills: AWSDockerJavaScriptMySQLNext.JsPostgresReactTypescript
Yesterday
Remote or Hybrid
7 Locations
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The Engineering Manager leads complex architectural design and development of cloud security systems, managing a team, and ensuring high-quality software delivery while balancing features and system resiliency.
Top Skills: AWSAzureGCPGoGrafanaJavaKafkaOpensearchPostgresPythonRedis

What you need to know about the Calgary Tech Scene

Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account