The job involves designing, developing, and enhancing the AWS data environment. Responsibilities include setting up AWS Data Platform, building scalable Data Lake solutions, and troubleshooting complex Data Pipelines. It requires expertise in data engineering and leading proofs-of-concept to production.
Company Description
Webtellect is an established software consulting firm. We are equivalent to the finest "custom home builders" as it applies to software. We build software for those companies who have funding but not the resources or for those companies who have the resources but not bandwidth. We analyze, design, develop, test, deploy, maintain, and learn from our engagements to improve for the next. We all share a passion and joy for software excellence. As such, Webtellect consultants are highly coveted.
Job Description
To design, development, and enhancement of our AWS data environment.
Qualifications
- Experience setting up AWS Data Platform – AWS CloudFormation, DevelopmentEndPoints, AWS Glue, EMR and Jupyter/Sagemaker Notebooks, Redshift, S3, and EC2 instances.
- Track record of successfully building scalable Data Lake solutions that connects to distributed data storage using multiple data connectors.
- Must have a background in data engineering – Data Warehouse Development experience would be perfect
- Must have strong skills in SQL, Python, PySpark, and AWS
- Experience in designing, developing, optimizing and troubleshooting complex Data Pipelines using Spark cluster
- Ability to lead proofs-of-concepts and then effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
- Serve as an expert; envision and integrate emerging data technologies, anticipate new trends to solve complex business and technical problems.
Additional Information
Notes:
- 6 month contract.
- ** No 3rd parties. **
- ** No Visas allowed **
Top Skills
AWS
Pyspark
Python
SQL
Similar Jobs
The AWS/Azure Cloud Data Engineer will work with clients to enhance data loading platforms (ETL/data pipelines) and ensure data quality, implement CI/CD pipelines, and manage data migration using AWS services. Collaboration with the Cloud Data Architect is key as well as problem-solving complex SQL and access management issues in various RDBMS environments.
As a Senior Data Engineer at Arcadia, you will design and develop data pipeline connectors for healthcare data integration, manage technical documentation, participate in team projects, code reviews, and scrum ceremonies, while ensuring timely delivery of solutions and collaborating with various internal teams to enhance analytic capabilities.
Be an Early Applicant
The Data Center Selection Manager will enhance the effectiveness and cost-efficiency of colocation sites/PoPs, managing vendor relationships, negotiating contracts, and working with cross-functional teams to support infrastructure growth. This role requires multitasking across various projects and maintaining strong communication with stakeholders.
What you need to know about the Calgary Tech Scene
Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.
