Lead product strategy and roadmap for high-throughput data ingestion, Databricks/Medallion lakehouse analytics, and FHIR-native MDM. Define streaming/batch ingestion, identity resolution, error remediation, DLQ replay, and APIs to produce a scalable, fault-tolerant data platform for clinical records and analytics.
Working for a company like Smile Digital Health means supporting our mandate for #BetterGlobalHealth. We strive towards this goal every day, and the results can be seen in the impact of our innovative health data platform and data management solutions, which are used in over 20 countries. We were #19 on Deloitte's Technology Fast 50 Ranking for 2024!
Smile Digital Health makes it easy for healthcare stakeholders to collect and exchange data with our leading FHIR-based data liberation platform.
At its heart, the Smile platform enables people and organizations to better manage healthcare data. We help generate and liberate structured healthcare data to ensure effective delivery across care teams and health systems bringing #BetterGlobalHealth to patients everyday!
Apply today and find plenty of reasons to SMILE!
We are looking for a Senior Technical Product Manager to drive the next generation of our high-throughput, enterprise data ingestion and data management architecture. In this role, you will lead the strategic transformation of our Data Ingress Engine using technologies like Apache Spark, Databricks, and Medallion Lakehouse Architecture
You will also own the product roadmap for our core Master Data Management (MDM) and Data Remediation Engines, defining how millions of disparate clinical records are cleansed, matched into a single "Golden Patient Record," and safely reprocessed when errors occur.
If you thrive at the intersection of distributed systems, high-volume streaming/batch data pipelines, and complex data models, this role is for you.
Responsibilities:
- Lead the product vision and roadmap to decouple core data ingestion modules from operational API boundaries, turning them into highly scalable, standalone micro-services.
- Productize event-driven and streaming ingestion pipelines (e.g., Kafka/Spark Structured Streaming) capable of processing billions of high-velocity records.
- Establish clear API contracts, event interfaces, and integration specs for external sources feeding raw payloads (HL7 v2, C-CDA, FHIR JSON, Claims) into our platform.
- Define requirements for transitioning mass analytics pipelines onto a Databricks / Medallion Architecture using Apache Spark.
- Drive the design of optimized Silver and Gold layer datasets, ensuring deeply nested JSON formats (e.g., FHIR) are efficiently flattened and structured into high-performance columnar models (Delta Lake/Parquet) for OLAP analytics.
- Partner with engineering architects to balance real-time, low-latency micro-batches against cost-optimized, high-throughput daily batch workloads.
- Own the product requirements for our FHIR-native MDM Engine, defining rules for deterministic and probabilistic patient matching at scale.
- Productize Survivorship Logic to establish rules for creating and maintaining the "Golden Record" across fragmented data feeds.
- Design crosswalk management capabilities to track source-to-target entity linkages across millions of patient lives.
- Build out the end-to-end exception lifecycle for data validation failures—from isolation in Dead-Letter Queues (DLQs) to structured error reporting.
- Define requirements for Data Steward interfaces and APIs, allowing users to review validation exceptions, perform manual record merges/unmerges, and correct bad data payloads.
- Architect Idempotent Replay Mechanisms to re-ingest corrected payloads through Spark processing pipelines without generating duplicate data or corrupting state.
1. Data Ingress & Decoupled Architecture
2. Big Data & Medallion Analytics Strategy
3. Master Data Management (MDM) & Identity Resolution
4. Error Remediation & Exception Management
Requirements:
- 5+ years of Technical Product Management experience leading complex backend data platforms, distributed data engineering products, or big-data ingestion systems.
- Hands-on Distributed Computing Knowledge: Proven track record productizing solutions powered by Apache Spark (batch or streaming) and distributed data processing frameworks.
- Databricks / Lakehouse Expertise: Deep familiarity with Medallion Architecture (Bronze/Silver/Gold) and Delta Lake/Parquet performance patterns.
- OLAP / Columnar Strategy Mindset: Demonstrated experience optimizing complex, highly nested arrays and hierarchical data structures for analytical query engines.
- Identity & Governance: Direct experience productizing Master Data Management (MDM), entity resolution, or identity matching tools.
- Fault-Tolerant Systems: Experience with event-driven architectures, Dead-Letter Queues (DLQs), and data replay/remediation workflows.
- Technical Proficiency: Ability to comfortably write and execute SQL and Python to analyze raw datasets, validate engine output, and define logic rules
- Experience with healthcare data standards, including HL7 FHIR, C-CDA, or HL7 v2.
- Exposure to healthcare terminologies (SNOMED CT, LOINC, RxNorm, ICD-10).
- Familiarity with SQL-on-FHIR analytics standards.
Must have Experience
Nice-to-Have Experience
Smile discloses that artificial intelligence (AI) may be used in portions of the recruitment and selection process, such as resume screening or application assessment. All hiring decisions are ultimately made by qualified human decision-makers, and AI tools are used to support — not replace — fair and equitable hiring practices.
This position is a replacement role, created to support Smile’s continued growth and commitment to operational excellence.
This position is a replacement role, created to support Smile’s continued growth and commitment to operational excellence.
Some of the benefits we offer:
* Remote Work Environment
* Flexible Time Away From Work Policy including PTO, Personal and Sick Days
* Competitive Salary and Health/Medical Benefits
* RRSP/TFSA/401K Employee Contribution
* Life and Disability
* Employee Assistance Program
* FHIR Study Program and Skillsoft Learning
* Super HAPI Fun Club
Smile's core values include respect, inclusion, embracing our differences, and celebrating shared values because our people are the foundation of our success. We are big on creating a sense of belonging and empowering each other to bring our authentic selves to work. We are dedicated to fostering a workplace that values diversity, equity, and inclusion.
We welcome and encourage candidates of all backgrounds to apply. Candidates are encouraged to inform us if they wish to discuss or require accommodations during interviews or while working at Smile.
Similar Jobs
Cloud • Security • Software • Cybersecurity • Automation
Build and maintain backend services and APIs using Ruby and GraphQL to improve source code workflows. Ensure reliability, performance, testing, observability, and on-call support. Collaborate cross-functionally and use AI agents responsibly to accelerate delivery.
Top Skills:
Ai Coding AgentsBackground ProcessingCachingGitGitalyGraphQLMonorepoObservabilityRubySQL
Cloud • Security • Software • Cybersecurity • Automation
Build and maintain backend services and APIs for source code workflows using Ruby and GraphQL. Improve performance, reliability, caching, and observability. Collaborate cross-functionally, write tests, participate in Tier 2 on-call, and use AI coding agents where appropriate.
Top Skills:
GitGitalyGraphQLRubySQL
Big Data • Fintech • Mobile • Payments • Financial Services
Lead and develop a team of Technical Account Managers supporting SMB merchants post-sale. Drive technical integrations, troubleshoot escalations, set OKRs, forecast hiring, and advocate cross-functionally to increase merchant adoption and product optimization.
Top Skills:
Rest ApisWeb Development
What you need to know about the Calgary Tech Scene
Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.
