Multiple employees collaborating on work
Atlassian Logo

Atlassian

Principal Data Engineer

Posted Yesterday
Remote
Hiring Remotely in San Francisco, CA
Senior level
Remote
Hiring Remotely in San Francisco, CA
Senior level
As a Principal Data Engineer at Atlassian, you'll build and maintain data lakes, optimize data pipelines, and develop micro-services while collaborating with various teams. Your role involves making data ingestion faster and more efficient, driving large engineering efforts, and enhancing self-serve capabilities to support business growth.
The summary above was generated by AI

Working at Atlassian
Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Interviews and onboarding are conducted virtually, a part of being a distributed-first company.
Atlassian is looking for a Principal Data Engineer to join our Go-To Market Data Engineering (GTM-DE) team which is responsible for building our data lake, maintaining our big data pipelines / services and facilitating the movement of billions of messages each day. We work directly with the business stakeholders and plenty of platform and engineering teams to enable growth and retention strategies at Atlassian. We are looking for an open-minded, structured thinker who is passionate about building services that scale.
On a typical day you will help our stakeholder teams ingest data faster into our data lake, you'll find ways to make our data pipelines more efficient, or even come up ideas to help instigate self-serve data engineering within the company. Then you will move on to building micro-services, architecting, designing, and enabling self serve capabilities at scale to help Atlassian grow.
We are a team with little legacy in our tech stack and as a result you'll spend less time paying off technical debt and more time identifying ways to make our data usable and improve our users experience.
As a Principal Data Engineer in the GTM-DE team, you will have the opportunity to apply your strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake. You enjoy working in a fast paced environment and you are able to take vague requirements and transform them into solid solutions. You are motivated by solving challenging problems, where creativity is as crucial as your ability to write code and test cases.
On your first day, we'll expect:

  • You have 12+ years of experience in a Data Engineer role as an individual contributor.
  • You have at least 2 years of experience as a tech lead for a Data Engineering team.
  • You are an engineer with a track record of driving and delivering large (multi-person or multi-team) and complex efforts.
  • You are a great communicator and maintain many of the essential cross-team and cross-functional relationships necessary for the team's success.
  • Experience with building streaming pipelines with a micro-services architecture for low-latency analytics.
  • Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
  • Experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools.
  • Experience working in a technical environment with the latest technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka).
  • Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team.
  • Industry experience working with large-scale, high-performance data processing systems (batch and streaming) with a "Streaming First" mindset to drive Atlassian's business growth and improve the product experience.


We'd be super excited if you have

  • Built and designed Kappa or Lambda architecture data platforms and services.
  • Experience implementing Master Data Management (MDM) solutions.
  • Built pipelines using Databricks and is well-versed with their APIs.


Compensation
At Atlassian, we strive to design equitable, explainable, and competitive compensation programs. To support this goal, the baseline of our range is higher than that of the typical market range, but in turn we expect to hire most candidates near this baseline. Base pay within the range is ultimately determined by a candidate's skills, expertise, or experience. In the United States, we have three geographic pay zones. For this role, our current base pay ranges for new hires in each zone are:
Zone A: $163,400 - $217,800
Zone B: $147,000 - $196,000
Zone C: $135,600 - $180,800
This role may also be eligible for benefits, bonuses, commissions, and equity.
Please visit go.atlassian.com/payzones for more information on which locations are included in each of our geographic pay zones. However, please confirm the zone for your specific location with your recruiter.
Our perks & benefits
Atlassian offers a variety of perks and benefits to support you, your family and to help you engage with your local community. Our offerings include health coverage, paid volunteer days, wellness resources, and so much more. Visit go.atlassian.com/perksandbenefits to learn more.
About Atlassian
At Atlassian, we're motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone, possible together.
We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.
To provide you the best experience, we can support with accommodations or adjustments at any stage of the recruitment process. Simply inform our Recruitment team during your conversation with them.
To learn more about our culture and hiring process, visit go.atlassian.com/crh .

Top Skills

Spark
SQL

Similar Jobs at Atlassian

4 Days Ago
San Francisco, CA, USA
Remote
11,000 Employees
Senior level
11,000 Employees
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer at Atlassian, you will design data models, build scalable data pipelines, and improve data quality for informed decision-making across the organization. Collaboration with various teams is key, alongside ownership of data extraction and cleaning processes, ensuring agile and effective data engineering practices.
7 Days Ago
San Francisco, CA, USA
Remote
11,000 Employees
Senior level
11,000 Employees
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Principal Data Engineer will enable a world-class engineering practice at Atlassian by developing backend systems, building scalable data pipelines, and designing data models. Responsibilities include managing data solutions, supporting business decisions, and fostering a data-driven culture within the organization.
4 Hours Ago
San Francisco, CA, USA
Remote
11,000 Employees
Senior level
11,000 Employees
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Machine Learning Engineering Manager, you will lead a team developing and deploying machine learning models, collaborate with product and analytics teams, and oversee the design of system architectures and model evaluations. You will ensure AI's potential is leveraged across Atlassian's products and provide mentorship to emerging ML engineers.

What you need to know about the Calgary Tech Scene

Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account