Design and architect large-scale distributed Big Data solutions using Java, Spark, and Hadoop/Cloudera. Lead global teams to build high-volume data processing and analytics pipelines, ensure robust testing (JUnit), and apply scripting for automation and data analysis.
Qualifications
- Minimum 15+ years of relevant experience in applications development
- Architect and design large-scale, distributed big data solutions using Java and big data technologies to handle high-volume data processing and analytics.
- Expertise in Bigdata ecosystem (Cloudera Distribution) using spark and Map Reduce
- Java (core) 1.8 or above - Hands-on experience (advanced concepts of data structures, memory management and design patterns)
- Apache Spark - Hands on (preferable on Java spark)
- Bigdata ecosystem (Good understanding of Hadoop, preferable cloudera distribution), exposure to Hive, Impala, Yarn, Kafka
- Good Data analysis and programing skills and understanding of large datasets (no sql joins)
- Good knowledge of Java and spark architecture and design principles
- Good experience in Junit/Testing frameworks
- Unix/Python shell scripting experience is a big plus
- Experience managing global technology teams
- Working knowledge of industry practices and standards
- Good communication skills
Similar Jobs
.png)
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Lead design and rollout of a fit-for-purpose data governance program: manage data lifecycle, implement governance frameworks and tools, drive data catalogs/lineage, upskill stewards, define KPIs, and partner cross-functionally to improve data quality, compliance, and usability.
Top Skills:
AIData CatalogsData Governance ToolsData LineageMetadata ManagementSQL
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Sell SaaS licenses and generate new business through account and territory planning, prospect research, and field sales. Build C-suite relationships, lead cross-functional account strategies, advise on IT roadmaps and AI integration, identify specialists to win deals, negotiate contracts, and meet sales targets. Role requires travel and collaboration with solutions, success, partners, and marketing teams.
Top Skills:
AISaaSServicenow
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Lead end-to-end COGS and gross margin analysis across hardware and software product lines. Build scenario models, quantify cost-saving opportunities, and present defensible recommendations to C-suite. Tackle ambiguous executive questions, partner with data engineering, finance, and product to establish reliable datasets, and drive analytical best practices and documentation. Operate autonomously with high ownership.
Top Skills:
SQL
What you need to know about the Calgary Tech Scene
Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.
