Ciklum is looking for a Senior Databricks Administrator to join our team full-time in Canada.
We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.
About the role:
As a Senior Databricks Administrator, you will be responsible for the setup, configuration, administration, and optimization of the Databricks Platform on AWS.
This role will play a critical part in managing secure, scalable, and high-performing Databricks environments, with a strong focus on:
- Platform governance
- User access management
- Cost optimization
- Security and compliance
- Platform operations and reliability
You will collaborate closely with engineering, infrastructure, InfoSec, and compliance teams to ensure that the Databricks platform meets enterprise data, security, and regulatory requirements.
Responsibilities:
1. Databricks Platform Administration — AWS:
- Provision, configure, and manage Databricks Workspaces across multiple environments, including Dev, UAT, and Production
- Define and enforce cluster policies, compute tagging, and usage controls to optimize cost and resource utilization
- Administer Unity Catalog
- Creation and management of catalogs and schemas
- Access control and permissions
- Data lineage
- Data governance
- Manage SCIM integrations for automated user and group provisioning with Identity Providers (IdPs) such as Okta and Azure/AWS SSO
- Configure and maintain CI/CD pipelines for notebook deployment and workflow promotion using GitHub, GitLab, or similar tools
2. Security, Governance & Compliance:
- Implement and enforce role-based access controls (RBAC) and fine-grained data permissions using Unity Catalog and AWS Lake Formation
- Ensure auditability and lineage tracking to support compliance with regulatory requirements, including Open Banking, GDPR, and PSD2
3. Monitoring, Support & Troubleshooting:
- Monitor workspace performance, cluster health, job execution, and user activity using Databricks native tools, AWS CloudWatch, and third-party integrations.
4. Automation & Platform Best Practices:
- Build and maintain Terraform/IaC scripts for environment provisioning and infrastructure consistency
Requirements:
- 6+ years of experience in Databricks administration across AWS or multi-cloud environments
- Databricks workspace architecture
- Unity Catalog
- Cluster configuration and optimization
- Databricks platform governance
- Strong experience with AWS IAM, IAM policies, SCIM integration, and access provisioning workflows
- Hands-on experience with monitoring, troubleshooting, cost optimization, and governance of large-scale Databricks deployments
- Hands-on experience with Infrastructure as Code (Terraform) and CI/CD pipelines
- Experience with ETL orchestration and collaboration with engineering teams using technologies such as
- Databricks Jobs and Workflows
- Apache Airflow
- Other workflow orchestration tools
- Strong understanding of enterprise security, access management, and platform operations.
Desirable:
- Delta Lake
- Lakehouse architecture
- Data governance patterns
- Experience with AWS Glue
- Experience with SQL and database technologies, including
- Amazon Aurora
- MongoDB
- DynamoDB
- Exposure to regulated industries such as banking, fintech, or healthcare.
- Incident response
- Audit logging
- Security remediation
- Compliance and security controls
- Experience working in large-scale enterprise data platforms
Preferred Certifications:
- Databricks Certified Data Engineer Associate / Professional
- Databricks Certified Platform Administrator
- AWS Certified Solutions Architect – Associate
What’s in it for you?
- Strong community: Work alongside top professionals in a friendly, open-door environment
- Growth focus: Take on large-scale projects with a global impact and expand your expertise
- Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications
- Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies
- Care: Healthcare, Basic Life Insurance, Short and Long-term disability insurance according to the Company’s Benefit Plans
About us:
At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress. Now expanding across Canada, we’re looking for talented professionals to strengthen our North American footprint. Join us to innovate at scale and deliver world-class solutions to global clients.
Explore, empower, engineer with Ciklum!
Interested already? We would love to get to know you! Submit your application. We can’t wait to see you at Ciklum.
#LI-VH1
Similar Jobs
