Nexaminds Logo

Nexaminds

RAP Engineer

Posted 22 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in Canada
Senior level
Remote
Hiring Remotely in Canada
Senior level
Design, build, and scale Azure-based data ingestion and transformation pipelines using Python and Databricks. Implement config-driven, testable ETL/ELT with PySpark and Delta Lake, enforce data quality, optimize Spark jobs, create reusable libraries and onboarding templates, and support Bronze/Silver/Gold medallion patterns and domain onboarding (Provider, Claims, Member, Eligibility). Participate in code review, documentation, and production operations.
The summary above was generated by AI

Unlock Your Future with Nexaminds!

At Nexaminds, we're on a mission to redefine industries with AI. We're passionate about the limitless potential of artificial intelligence to transform businesses, streamline processes, and drive growth.

Join us on our visionary journey. We're leading the way in AI solutions, and we're committed to innovation, collaboration, and ethical practices. Become a part of our team and shape the future powered by intelligent machines. If you're driven by ambition, success, fun, and learning, Nexaminds is where you belong.

Nexaminds is looking for a Senior Data Engineer to lead the development, optimization, and scaling of our data solutions. The ideal candidate has hands-on expertise building end-to-end pipelines on Databricks and enjoys working in a fast-paced, highly collaborative environment.

Location: MEXICO, CANADA

Qualifications we are looking for:

  • 5+ years Data Engineering in production Azure environments — Python, SQL, Spark

  • Python: production-grade OOP, config-driven design, no hardcoding, type annotations

  • PySpark / Spark: DataFrames, schema enforcement, partitioning, performance tuning

  • SQL: advanced window functions, CTEs, incremental load patterns, Delta Lake DML (MERGE, UPDATE, DELETE)

  • Azure Data Factory: parameterised pipelines, linked services, triggers, IR configuration

  • Azure Databricks: notebooks, Jobs API, DLT, cluster configuration, Unity Catalog access

  • ADLS Gen2, Delta Lake / Parquet format, Medallion store patterns

  • Testing discipline: pytest, unit and integration tests, data quality assertions

  • Git: feature branching, PR workflow, commit discipline, code review

Nice to have:

  • Scala: Spark Dataset API, typed transformations, sbt build tooling
  • Healthcare data formats: EDI X12 (837/835/834), FHIR R4 resource parsing
  • Delta Lake: schema evolution, time travel, OPTIMIZE, VACUUM, Z-ordering
  • dbt (data build tool) for SQL transformation layering and lineage documentation
  • Databricks Asset Bundles (DABs) for pipeline-as-code deployment
  • DP-203 Azure Data Engineer Associate certification

Job duties:

  • Design and build the core reusable ingestion engine in Python and ADF — parameterised, config-driven, zero hardcoding
  • Build Python ingestion modules: file readers, schema validators, format handlers (CSV, EDI X12, FHIR R4, Parquet, JSON)
  • Implement PySpark / Scala transformation components for batch and streaming at scale on Azure Databricks
  • Write config-driven SQL data models for Bronze, Silver, Gold medallion transformations
  • Develop metadata-driven validation layer: null checks, type enforcement, range rules, referential integrity
  • Build reusable utility libraries: logging, error handling, retry logic, dead-letter routing
  • Implement Databricks notebooks and DLT (Delta Live Tables) pipelines for declarative transformations
  • Build and maintain the onboarding template library v1 and v2 — parameterised, documented, production-ready
  • Onboard Provider, Claims, Member, Eligibility, and Reference data domains using the framework
  • Write unit tests, integration tests, and data contract tests (pytest, Great Expectations or equivalent)
  • Optimise Spark jobs: partitioning, caching, broadcast joins, Z-ordering on Delta tables
  • Participate in code review, follow GitHub branching standards, and contribute to documentation

What you can expect from us

Here at Nexaminds, we're not your typical workplace. We're all about creating a friendly and trusting environment where you can thrive. Why does this matter? Well, trust and openness lead to better quality, innovation, commitment to getting the job done, efficiency, and cost-effectiveness.

  • Stock options 📈
  • Remote work options 🏠
  • Flexible working hours 🕜
  • Benefits above the law
  • But it's not just about the work; it's about the people too. You'll be collaborating with some seriously awesome IT pros.
  • You'll have access to mentorship and tons of opportunities to learn and level up.

Ready to embark on this journey with us? 🚀🎉 If you're feeling the excitement, go ahead and apply!

Similar Jobs

4 Hours Ago
Remote or Hybrid
Calgary, AB, CAN
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Hunt and close net-new enterprise accounts across Alberta, building executive relationships and value-based business cases. Drive pipeline via prospecting, partners, and events; lead complex sales cycles with Sales Engineers and Customer Success to deliver observability, security, cloud modernization, and AI-driven outcomes.
Top Skills: AiopsAWSAzureCloud MigrationCybersecurityDevOpsDynatraceGCPObservabilityPlatform Engineering
7 Hours Ago
Remote or Hybrid
Canada
Senior level
Senior level
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Design, deploy, and operate enterprise network infrastructure across data centers and cloud (GCP, AWS, Azure). Manage VPCs, VPNs, BGP, F5 BIG-IP, hybrid connectivity, and observability. Build IaC and automation with Terraform, GitLab CI/CD, and Ansible. Maintain monitoring, documentation, and participate in on-call support for critical incidents.
Top Skills: AnsibleAWSAzureBgpCloud RouterCloudflareDnsF5 Big-IpFirewallsGCPGitlab Ci/CdHa VpnIp Address ManagementIpsec VpnLoad BalancingTerraformVpc
8 Hours Ago
Easy Apply
Remote
Canada
Easy Apply
Expert/Leader
Expert/Leader
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Lead high-impact reliability projects to improve resiliency, scalability, and deployment safety for thousands of services. Build secure configuration and secrets systems, improve canary-based release systems, partner with critical teams to reduce operational toil, drive observability and reliability best practices, participate in on-call rotations, and communicate architecture decisions to stakeholders.
Top Skills: AWSAzureDatadogGCPGenerative AiGoKibanaRubyTerraform

What you need to know about the Calgary Tech Scene

Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account