The role involves designing and building event-driven data services on AWS, focusing on real-time streaming, microservices, and integration with various AWS data services, ensuring scalability and quality.
About the Role
Our client is seeking a Senior AWS DataHub Developer to design and build real-time, event-driven data services on AWS. This role is developer-first (application-side) rather than infrastructure-led. You will architect and deliver Kafka-based streaming pipelines and serverless data applications that ingest, transform, and serve data at scale.
You’ll collaborate with architects, data engineers, and product teams to deliver secure, resilient, observable, and highly scalable solutions that power enterprise-grade analytics and event-driven applications.
What You’ll Do (Key Responsibilities)
- Design & Deliver Event-Driven Pipelines: Build serverless data flows using AWS Lambda, Step Functions, EventBridge, SNS, SQS, API Gateway.
- Real-Time Streaming: Develop Kafka (Apache Kafka/Amazon MSK) consumers/producers for high-throughput, low-latency streaming and decoupled microservices.
- Microservices & APIs: Build and optimize TypeScript (preferred) or Python services/APIs for data ingestion, transformation, and delivery.
- AWS Data Services Integration: Work with S3, DynamoDB, Glue, Athena, CloudWatch for storage, metadata, querying, and observability.
- Quality & Reliability: Implement idempotency, retries, dead-letter queues, exactly-once/at-least-once semantics where appropriate, and schema evolution strategies.
- CI/CD & Testing: Use Git-based workflows and CI/CD (e.g., GitHub Actions, Jenkins) with automated tests (unit/integration/load) and infrastructure deployments.
- IaC (Developer View): Define application-layer infrastructure using AWS CDK, Terraform, or CloudFormation—with strong emphasis on developer productivity and repeatability.
- Agile Collaboration: Contribute to technical design, story sizing, peer reviews, and continuous improvement.
Ideal Candidate Profile
- You are a cloud-native, application-side developer who thinks in events, streams, and services—not servers. You design for resiliency, observability, and scale, and you’re comfortable pairing Kafka with AWS serverless to deliver business outcomes.
Similar Jobs
Fintech • Financial Services
Principal Software Engineer responsible for architecting and leading development of scalable, reliable backend systems and the core fintech platform. The role sets technical direction, leads complex cross-team initiatives, promotes architectural and engineering best practices, addresses technical debt and incidents, and mentors engineers. Candidates need 10+ years of technical leadership experience, deep distributed-systems expertise, Ruby on Rails experience, strong communication and influence skills, agile development experience, and familiarity with frontend architecture or full-stack systems.
Top Skills:
Ruby On Rails
Artificial Intelligence • Legal Tech
Shape legal AI products by designing evaluations, validating AI outputs, translating legal workflows into product requirements, and turning customer feedback into product improvements. Partner with Engineering, Product, Design, and GTM teams from discovery through launch. Provide legal expertise, define quality standards, create evaluation metrics, and guide roadmap decisions for AI experiences used by in-house legal teams.
Top Skills:
Generative Ai
Software • Hospitality
Manage a portfolio of Canadian hospitality accounts, serving as the primary leadership contact and driving customer success, program adoption, savings, and year-over-year growth. Partner with procurement, operations, suppliers, category management, onboarding, and internal teams to deliver strategic initiatives, resolve supplier issues, expand programs, and lead business reviews. The role requires executive presentations, data-based decision-making, and approximately 25%–50% travel.
What you need to know about the Calgary Tech Scene
Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.
