The Senior Software Data Engineer will design and optimize cloud-based data pipelines, utilizing Python and AWS services to deliver scalable data solutions, mentor junior engineers, and ensure compliance with security and quality standards.
Senior Software Data Engineer (Python)
We are looking for a Senior Software Data Engineer – Python-- to design, build, and optimize
cloud-based, serverless data pipelines and infrastructures. You will leverage your expertise in
Python, SQL, AWS, and Infrastructure as Code to deliver scalable and secure data solutions.
This role is ideal for someone with strong collaboration skills, a passion for innovation, and
proven experience working with large-scale, enterprise-level projects.
Key Responsibilities
- Design and implement serverless data pipelines using AWS services.
- Build and maintain data lakes, ETL/ELT workflows, and data catalogs.
- Develop and maintain automated CI/CD pipelines and Infrastructure as Code (AWS
- CDK/CloudFormation).
- Ensure compliance with data governance, security, and quality standards.
- Collaborate with data science teams to deliver accessible and reliable data solutions.
- Mentor junior engineers, promote knowledge sharing, and champion best practices.
Key Metrics of Success
- High client satisfaction and quality feedback.
- Scalable, secure, and high-performing data solutions delivered on time.
- Reduction in deployment errors and faster delivery cycles through automation.
- Active contribution to team knowledge-sharing and continuous learning.
Qualifications
Minimum Requirements _ PLEASE INDICATE YEARS OF EXPERIENCE IN YOUR RESUME
- 5+ years of development experience in Python.
- Strong expertise in AWS cloud services (Lambda, S3, Glue, Athena).
- Experience with Infrastructure as Code (AWS CDK/CloudFormation).
- Solid foundation in ETL/ELT processes, data modeling, and pipeline design.
- Excellent written and verbal English communication skills.
Preferred
- Experience with AWS Lake Formation, AWS Datazone, EventBridge, Step Functions.
- CI/CD pipeline implementation and API integration experience.
Soft Skills
- Strong problem-solving and analytical abilities.
- Effective communicator across technical and non-technical teams.
- Proactive, accountable, and adaptable in dynamic environments.
- Curiosity and passion for continuous learning and innovation.
Top Skills
AWS
Aws Cdk
CloudFormation
Elt
ETL
Python
SQL
Similar Jobs
Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Assist the Quality Manager with enforcing quality standards, support health and safety policies, and lead quality engineering initiatives in a manufacturing setting.
Top Skills:
Data AnalysisData CollectionIatfIsoSix SigmaVda
Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
The role involves overseeing automotive paint processes, ensuring safety compliance, supporting quality standards, and collaborating with various teams to improve production efficiency.
Top Skills:
Industrial ControlExcelMicrosoft ProjectMicrosoft WordPlc ProgrammingRobot Programming
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Manage UX design projects focused on Human-AI interaction, mentoring designers, promoting user-centric design, and leading strategic design initiatives.
Top Skills:
AIMlUser Interface DesignUx Design
What you need to know about the Calgary Tech Scene
Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.
