Design, develop, test, and support enterprise ETL/ELT data integration and pipeline solutions using Talend and relational databases. Build mappings, transformations, reconciliation, and reusable components; optimize SQL; administer Talend tooling; integrate REST APIs via Azure API Management; monitor and troubleshoot production pipelines; support data quality, governance, metadata, lineage, security, and SDLC processes while collaborating with stakeholders and using AI/automation tools for productivity.
This is a remote position.
A public sector organization is seeking an experienced Data Engineer to support a large-scale initiative modernizing environmental and natural resource regulatory processes.
The Data Engineer will design, develop, maintain, and support enterprise data integration, ETL/ELT, and data pipeline solutions using Talend, SQL, Azure, and relational databases.
Requirements
- Design, develop, test, and support enterprise data integration and ETL/ELT solutions using Talend.
- Build data mappings, transformations, reconciliation processes, and reusable integration components.
- Develop and optimize SQL queries, stored procedures, and database processes using SQL Server, Oracle, or PostgreSQL.
- Administer and support Talend Management Console (TMC) and Talend Remote Engine.
- Schedule, monitor, troubleshoot, and resolve production data pipeline and integration issues.
- Develop scalable batch and near-real-time data pipelines.
- Design and integrate REST APIs using Azure API Management.
- Support data quality, governance, metadata, lineage, security, and data privacy requirements.
- Work across development, testing, and production environments following established SDLC practices.
- Collaborate with data engineers, architects, business stakeholders, platform teams, and vendors.
- Leverage AI and automation tools for code generation, testing, data analysis, documentation, and pipeline optimization.
- Post-secondary degree, diploma, or certificate in Computer Science, Engineering, or a related field.
- 3+ years of experience designing, developing, testing, and supporting enterprise data integration solutions.
- 3+ years of experience with Talend Management Console/Talend Administration Center.
- 3+ years of experience installing, configuring, supporting, and troubleshooting Talend Remote Engine.
- 2+ years of production support experience for enterprise integration solutions.
- 4+ years working within a mature Software Development Lifecycle (SDLC).
- 1+ year of experience using AI for code generation, data analysis, automation, or development productivity.
- 6+ years of experience in business/data requirements analysis.
- 6+ years of strong Microsoft SQL Server experience.
- Experience building scalable ETL pipelines, implementing data quality, and working with cloud platforms.
- 3+ years of experience integrating RESTful APIs.
- 3+ years of experience with message queuing technologies.
- Experience with ServiceNow and Azure-based data management integrations.
- Experience with data governance, metadata management, data classification, and data lineage.
Similar Jobs
Artificial Intelligence • Marketing Tech • Software
Build and operate high-volume event streaming pipelines and analytical databases. Write production Elixir/Python services, integrate legacy pipelines, enforce event schemas and data quality, and provide monitoring, alerting, and SLA-driven observability for event data products.
Top Skills:
Apache FlinkAWSCloudFormationColumnar/Olap DatabasesDatabricksElixirGCPKafkaKinesisPulsarPythonSQLTerraform
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Design, build, and operate production AI systems and marketing data infrastructure. Develop retrieval pipelines, agent orchestration, CDP integrations, ETL/ELT pipelines, and analytics. Automate workflows with AI, ensure data quality and reliability, partner with stakeholders, ship Python and SQL code, mentor engineers, and drive requirements to production.
Top Skills:
Agent OrchestrationBigQueryClaude CodeCursorCustomer Data Platform (Cdp)Data WarehouseDatabricksDbtEtl/EltHightouchLlmsMarketing AutomationPythonSalesforceSegmentSnowflakeSQLWeb Analytics
Artificial Intelligence • Marketing Tech • Software
Design, build, and operate a unified data platform: ingesting, processing, and exposing large volumes of data. Develop scalable ingestion pipelines, storage layers, observability, SLIs/SLOs, multi-tenant models, and metadata/ governance to enable secure cross-product data access and migrations from legacy systems.
Top Skills:
AirflowApache FlinkAWSClickhouseCloudFormationDatabricksDockerElixirGCPKafkaKubernetesOlapOltpRedshiftSQLTerraform
What you need to know about the Calgary Tech Scene
Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.
