Senior Java Big Data Developer with 8+ years building applications on Cloudera/Hadoop ecosystems using Spark and MapReduce. Responsible for designing performant Java (1.8+) solutions, data analysis of large datasets, unit testing (JUnit), and collaborating with/managing global technology teams. Preferred skills include Unix/Python scripting and familiarity with Hive, Impala, YARN, and Kafka.
Qualifications
- Minimum 8+ years of relevant experience in applications development
- Expertise in Bigdata ecosystem (Cloudera Distribution) using spark and Map Reduce
- Java (core) 1.8 or above - Hands-on experience (advanced concepts of data structures, memory management and design patterns)
- Apache Spark - Hands on (preferable on Java spark)
- Bigdata ecosystem (Good understanding of Hadoop, preferable cloud era distribution), exposure to Hive, Impala, Yarn, Kafka
- Good Data analysis and programing skills and understanding of large datasets (no sql joins)
- Good knowledge of Java and spark architecture and design principles
- Good experience in Junit/Testing frameworks
- Unix/Python shell scripting experience is a big plus
- Experience managing global technology teams
- Working knowledge of industry practices and standards
- Good communication skills
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead design and implementation of data integration and AI-powered automations. Build ITX transformation maps, optimize SQL databases, author SSRS reports and PowerShell automation, troubleshoot production issues across claims platforms, and support client migrations and product transitions.
Top Skills:
837 EdiAWSClearhealthCodeeditsDesign StudioGithub CopilotIrrItx (Ibm Transformation Extender)Microsoft Copilot 365PowershellSQLSsrsUmr/Ppcv
Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Lead planning and execution of cross-team software initiatives, maintain delivery visibility, manage risks and dependencies, strengthen Agile practices, use metrics and OKRs to improve predictability, and coordinate stakeholders to ensure timely launches and continuous improvement.
Top Skills:
AirtableChatgptClaudeGeminiGoogle WorkspaceJIRAJpd
Fintech • Financial Services
Own end-to-end full-stack features for servicing applications: design, implement, deploy, monitor, and optimize front-end (Next.js/React + NestJS GraphQL) and back-end (.NET/C# + NestJS). Deploy and operate on AWS/EKS with CI/CD, use AI code tools to boost development, participate in on-call rotations, mentor junior engineers, and collaborate with product, design, and analytics teams to improve user experience.
Top Skills:
.NetAi Code Generation ToolsAmazon EksAnthropic Claude CodeAWSC#Ci/CdCursorGithub CopilotGraphQLKubernetesNestjsNext.JsReact
What you need to know about the Calgary Tech Scene
Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.
