Senior Data Platform Engineer

Posted 5 Days Ago
Be an Early Applicant
Wellington, NB
Mid level
Fintech • Insurance
The Role
As a Senior Data Platform Engineer, you will develop and implement a robust data infrastructure to support advanced data capabilities. You'll build scalable data platforms using cloud technologies, deploy data pipelines, manage a SQL-based compute platform, enhance data processing workflows, and lead a team of engineers while ensuring data security standards.
Summary Generated by Built In

Job Summary

Job Description

What is the opportunity?

This is an opportunity within the Data & Analytics team at RBC Global Asset Management. We are seeking a hands-on, highly skilled, and motivated individual to join our dynamic team as a Senior Data Platform Engineer. As a key member of our data engineering team, you will play a crucial role in the development and implementation of GAM’s Data Platform. Your primary focus will be on designing, implementing, and maintaining robust data infrastructure to support our organization’s data needs and advance our capabilities pertaining to data engineering, BI, Machine Learning and AI.

What you will do:

  • Work closely with Data Engineering and Analytics team to drive business decisions using data.

  • Build scalable data platform infrastructure using cloud native technologies to enable Data Engineering, Data Science and Reporting.

  • Take ownership of end-to-end deliverables and ensure high quality data solutions adhering to data platform architecture guidelines and engineering best practices. 

  • Enable the deployment of batch and event-driven data pipelines using latest technologies such as Spark, NiFi, Kafka, and Airflow. 

  • Configure and manage scalable and managed SQL based self-serve compute platform using Starburst Trino.

  • Implement data management tools to streamline data processing, testing, preparing, deploying, and monitoring.

  • Improve the speed and quality of the data development process by applying DevOps principles to data workflow.

  • Ensure data security standards are applied across the data pipelines.

  • Troubleshoot and resolve data integration and data processing issues.

  • Perform proof-of-concepts to implement hybrid cloud data strategy involving on-prem systems like S3, OpenShift, Trino, Spark with Cloud based solutions like Databricks, Azure, Snowflake, etc.

  • Apply design-thinking and agile mindset in working with other engineers and business stakeholders to continuously experiment, iterate and deliver on new initiatives.

  • Stay informed about emerging technologies and trends in data engineering domain.

  • Lead, mentor, and inspire a team of engineers to achieve high performance levels. 

What you need:

  • 3-5 years of hands-on experience in big data processing using Spark, Python, NiFi, Kafka, and Airflow for on-premises and Cloud data platforms (Snowflakes, Databricks, Azure, AWS, GCP)

  • 2-3 years of experience with solution design, data ingestion, scheduling & monitoring of ETL/ELT jobs.

  • 2-3 years of system administration including Docker and Kubernetes platforms.

  • Strong knowledge of UNIX-like operating systems and shell scripting skills.

  • Expertise with DevOps tools, automation, and using Data Ops to develop data flows and the continuous use of data.

  • Proficiency in writing and optimizing SQL queries and at least one programming languages like Java, Scala and/or Python.

Nice-to-have

  • Experience with OpenShift, AirFlow, S3, Trino, Ranger and Hive.

  • Knowledge of networking, information security and vulnerability management.

  • Knowledge of creating dashboards using Prometheus and Grafana.

  • Knowledge about data science tools and libraries.

What’s in it for you?

We thrive on the challenge of being our best, thinking progressively, continuing to grow, and working together to deliver trusted advice to help our clients thrive, and our communities prosper. We care about each other, reaching our potential, making a difference in our communities, and achieving mutual success.

  • A comprehensive Total Rewards Program, including bonuses, flexible benefits, and competitive compensation.

  • Leaders who support your development through coaching and managing opportunities

  • Opportunities to take on progressively greater accountabilities

  • Work in a dynamic, collaborative, progressive, and high-performing team

Job Skills

Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, Quality Management, Requirements Analysis

Additional Job Details

Address:

RBC CENTRE, 155 WELLINGTON ST W:TORONTO

City:

TORONTO

Country:

Canada

Work hours/week:

37.5

Employment Type:

Full time

Platform:

WEALTH MANAGEMENT

Job Type:

Regular

Pay Type:

Salaried

Posted Date:

2024-11-27

Application Deadline:

2024-12-12

Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above

Inclusion and Equal Opportunity Employment

At RBC, we embrace diversity and inclusion for innovation and growth. We are committed to building inclusive teams and an equitable workplace for our employees to bring their true selves to work. We are taking actions to tackle issues of inequity and systemic bias to support our diverse talent, clients and communities.
​​​​​​​
We also strive to provide an accessible candidate experience for our prospective employees with different abilities. Please let us know if you need any accommodations during the recruitment process.

Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.

Top Skills

Java
Python
Scala
The Company
Calgary, AB
88,000 Employees
On-site Workplace

What We Do

Royal Bank of Canada is a global financial institution with a purpose-driven, principles-led approach to delivering leading performance. Our success comes from the 88,000+ employees who leverage their imaginations and insights to bring our vision, values and strategy to life so we can help our clients thrive and communities prosper. As Canada’s biggest bank, and one of the largest in the world based on market capitalization, we have a diversified business model with a focus on innovation and providing exceptional experiences to our 17 million clients in Canada, the U.S. and 27 other countries. Learn more at rbc.com.‎

We are proud to support a broad range of community initiatives through donations, community investments and employee volunteer activities.

Similar Jobs

McCain Foods Logo McCain Foods

Release Train Engineer

Food • Retail • Agriculture • Manufacturing
Florenceville-Bristol, NB, CAN
20000 Employees

McCain Foods Logo McCain Foods

Cloud and Edge Infrastructure Solution Architect

Food • Retail • Agriculture • Manufacturing
Florenceville-Bristol, NB, CAN
20000 Employees

McCain Foods Logo McCain Foods

DevSecOps & Site Reliability Engineer

Food • Retail • Agriculture • Manufacturing
Florenceville-Bristol, NB, CAN
20000 Employees

McCain Foods Logo McCain Foods

Infrastructure Solution Architect

Food • Retail • Agriculture • Manufacturing
Florenceville-Bristol, NB, CAN
20000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account