Senior Data Engineer

N-iX is looking for a passionate and motivated Data Engineer to join our team.
Our customer is a leading global provider of high-quality licensed images, videos, and music. Our customer helps inspire graphic designers, creative directors, video editors, filmmakers, web developers, and other creative professionals by providing diverse content to businesses, marketing agencies and media organizations around the world. Content creators contribute their work to our client, where end users buy and use it in a diverse array of creative personal and business projects. It's a two-sided marketplace that empowers the world's storytellers.
As a Data Engineer you will play a key role in building high volume, customer facing intelligence service across the enterprise. In this role you will be bringing modern data technologies and practices to enable our customers, and internal stakeholders to make effective decisions by providing relevant data products and services. You will work closely with the team and Product Managers to establish clear priorities and milestones.
The day to day:


• Build data services in Python with an emphasis on best practices, consistency, performance and scalability
• Day-to-day operational support of data
• engineering infrastructure, products and services, including on-call routine

Requirements:


• 4+ years of Python development practice with deep understanding of Python’s object-oriented features, including things like class design, inheritance, encapsulation, and design patterns.
• Strong AWS cloud & serveless experience (EKS, IAM, Lambda, EC2, DynamoDB, Kinesis etc)


• Experience in low latency stream processing technology (Kafka, Spark, Storm, Samza, Flink etc)

• Designing and working with scalable, reliable distributed systems with strong knowledge of consistency models, fault tolerance, and system scalability
• Knowledge of SQL, basic data modelling experience
• Experience with REST and GraphQL based design patterns

• Knowledge of and experience with a variety of data stores and an understanding of best practice access patterns and modelling (DynamoDB, RDBMS, columnar data formats etc)

• Exposure to IaC tools like Cloudformation / Terraform

• CI/CD systems experience (Jenkins, Github Actions, etc)


Will be a plus:


• Hands-on experience with Snowflake, DBT, Airflow

• Exposure / Experience with Java/Scala or other JVM based language

• Exposure to Kubernetes and Helm

• Strong expertise/background with Linux