This Sr. Data Engineer role involves transforming on-premise Python applications to cloud-native implementations. You will work on strategic initiatives for a major financial client, focusing on data pipeline development in AWS environments while maintaining high standards of quality, security, and transparency.
You will be a key contributor on one of the major transformation projects for our top clinet, a Fortune 10 company. It is a key position and a great career opportunity. We work with the client on several strategic initiatives and set our bar high.
We are looking for top-notch performers as quality is everything for us.
We are looking for a Senior to Lead level individual contributor with solid experience transforming on-premise Python applications to cloud-native implementations. This role will be a key contributor to the project. Must be comfortable working in Financial regulated environments where correctness, security, and transparency are paramount.
Most required: SQL, EMR, AWS, Pyspark
Requirements
- 5+ years of experience in Python applications on AWS
- Ability to work East Coast hours
- Ability to think holistically about the system
- Adaptable communication skills to interact with technical and business stakeholders in large enterprise organizations
- Ability to build strong collaborative partnerships across functional lines and at all levels within the organization and the business
- Good technical writing skills
- Excellent interpersonal skills
- Financial systems experience a plus
- Bachelors of Science (BS) or above
- Strong analytical, problem-solving, multitasking, and time management skills with consistent attention to detail
Technical Skills
- Python Experience Top-notch is a must – Python coding is a must
- Strong technical knowledge in Python, Object-Oriented Programming
- Python Programming experience in building data pipelines is a must
- AWS Experience is a must
- RedShift is nice to have
- Other Relational Databases experience (Oracle, PostgreSQL ideally)
- Good knowledge of SQL is must have
- PySpark/Spark is nice to have
- RDS is nice to have
- Lambda is nice to have
For more Job opportunities pls check https://avmconsulting.net/careers/
The difference between something good and something great is attention to detail – AVM Consulting.
Top Skills
AWS
Emr
Lambda
Oracle
Postgres
Pyspark
Python
Rds
Redshift
SQL
Similar Jobs
Beauty • Cloud • Fintech • Marketing Tech • Payments • Productivity • Software
The Senior Data Engineer II will design, implement, and manage AWS cloud infrastructure, ensuring reliability and security. This role involves automating CI/CD pipelines, troubleshooting, and collaborating with development teams to optimize cloud applications. The candidate will also implement security best practices and stay current on emerging cloud technologies.
Top Skills:
AWSAws CloudformationAws CodepipelineAws LambdaBashGitlab CiJenkinsPostgresPythonS3Terraform
Artificial Intelligence • Software
As a Data Infrastructure Engineer, you will design, implement, and maintain scalable distributed systems while collaborating with webscraping and infrastructure teams. Your responsibilities include managing CI/CD pipelines, monitoring system performance, and ensuring the security of systems and data. You will handle challenges in creating a high-performance infrastructure.
Top Skills:
AutomationAWSAzureBashCi/CdConfiguration ManagementDevOpsDistributed SystemsDockerGCPKubernetesPython
Fintech • Marketing Tech • Professional Services • Financial Services
As a Test Engineer, you'll ensure application quality by creating and executing manual and automated test cases, maintaining regression test suites, supporting production releases, and mentoring junior engineers. You'll also contribute to best practices in software quality and participate in team hiring and onboarding.
What you need to know about the Calgary Tech Scene
Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.
