Design and optimize SQL Server solutions, manage data, automate processes with PowerShell, and integrate with external systems to enhance functionality.
Cheesy joke to get you to smile:
Two SQL transactions ask a minister to marry them, but the minister replies, "Only if you're willing to commit."
Summary:
We are seeking a hands-on Data Engineer who is skilled in building complex systems beyond just writing queries. This role focuses on SQL Server in both Linux and Windows environments and requires versatility across various tools, including PowerShell, APIs, Python, and emerging AI/LLM technologies. If you enjoy stretching your expertise beyond SQL and want to contribute to innovative solutions, this position is for you. The role is for one of our North American clients with proprietary software for the insurance industry.
Responsibilities:
- Design, build, and optimize complex SQL Server solutions, emphasizing performance tuning, indexing, and data modeling.
- Manage relational and semi-structured data, including JSON stored in SQL Server and multi-dimensional datasets.
- Query and transform JSON using native SQL Server tools, such as OPENJSON and JSON_VALUE.
- Use PowerShell, SQL Server tools, and scripting to automate processes.
- Enhance functionalities by integrating with APIs and external systems.
- Address problems comprehensively, focusing on end-to-end solutions beyond the database layer.
- Operate within a complex, multi-system application environment, avoiding isolated reporting or analytics tasks.
- Explore and implement LLM-driven workflows, including prompting and structured outputs.
- Continuously enhance efficiency by replacing manual processes with automation.
Required Skills:
- Proficient in SQL Server, including query performance, indexing, and data modeling.
- Experience handling JSON in SQL Server and managing hybrid data models.
- Experience with PowerShell or similar scripting languages for automation purposes.
- Ability to work across multiple systems, including databases, APIs, and services.
- Proven ability to deliver effective solutions in a timely manner.
Preferred Skills:
- Background in smaller teams with end-to-end system ownership.
- Experience in complex application environments rather than isolated reporting or analytics settings.
- Capability to navigate and solve problems without detailed requirements.
- Experience in insurance, financial services, or other regulated, transaction-heavy domains.
- Python experience and familiarity with APIs and integrations.
- Exposure to LLMs like OpenAI and Claude.
- Experience developing internal tools or automation frameworks.
- Experience with cloud or hybrid infrastructure.
This is a fully remote position, offering the flexibility to work from anywhere. If you are ready to take ownership and thrive in a fast-paced, adaptive environment, we encourage you to apply!
Similar Jobs
Information Technology • Software
Build and operate Ground News’s data platform, including warehouse integrations, scalable dimensional models, analytical layers, and KPI infrastructure. Own ingestion pipelines, data quality, monitoring, incident response, infrastructure as code, and deployment workflows across AWS and GCP. Partner with analysts, ML engineers, and product stakeholders to create reliable, reusable data models and ensure accurate, observable, cost-effective data systems.
Top Skills:
AirbyteAmazon SqsAWSBigQueryDagsterDbtElasticsearchFivetranGCPGoogle DatastreamGoogle Pub/SubKafkaKubernetesOpensearchOpentofuPostgresPythonSQLTerraform
Marketing Tech
Designs, develops, tests, and maintains cloud-based data pipelines and warehouses for large-scale datasets. The role involves data ingestion using Python and SQL, GCP services, production migrations, infrastructure troubleshooting, and optimization. The engineer collaborates with stakeholders to understand project goals and applies AI/LLM tools thoughtfully within data engineering workflows. Responsibilities also include distributed data manipulation, technical guidance, and maintaining scalable, cost-efficient data architecture.
Top Skills:
AtlassianAWSBigQueryGitGoogle Cloud PlatformGoogle Cloud StoragePythonSQL
Legal Tech
Designs, builds, and operates enterprise data lakes, warehouses, lakehouses, ETL/ELT pipelines, databases, and reporting platforms. Prepares governed, model-ready data for AI and machine learning, supports feature stores and embedding workflows, administers relational databases, optimizes queries and dashboards, and ensures data quality, security, availability, and disaster recovery. Collaborates with technical and business teams, reports to senior management, and mentors data engineers.
Top Skills:
Aderant Expert SierraApache AirflowSparkAWSAzureBashChrome RiverCi/CdDatabricksDevOpsEmbedding PipelinesFeature StoresGCPImanageLitera CamMlopsPeoplesoftPower BIPowershellPythonRetrieval-Augmented GenerationSnowflakeSpmSQLTableauVector DatabasesWorkday
What you need to know about the Calgary Tech Scene
Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.
