The Data Engineer at Butter Payments will architect data systems, ensure high-quality data ingestion and transformation, and collaborate with ML teams to optimize workflows.
About Butter Payments:
At Butter Payments, we’re on a mission to eliminate involuntary churn and make recurring payments seamless. Every year, billions of dollars are lost due to failed payments. Butter leverages machine learning, deep financial data partnerships, and behavioral insights to ensure the right payments go through at the right time—without friction. We're backed by world-class investors like Atomic, Norwest Venture Partners, SpringTride, Transpose Platform, and we're growing fast.
The Problem Statement:
You will work closely with Software Engineering, Machine Learning Engineers and Data Analysts. You help ingest, organize and enable Butter to continue to deliver value on the data we collect. We make sure it arrives in a timely manner, is organized and usable, and is of a high quality. Key to all the work Butter does.
Problem Expanded:
We ingest 3rd-party data from multiple payment providers, such as Stripe, clean it and normalize it for our schema and machine learning pipelines.
We're seeking to build transformation and validation layers as far upstream as possible to ensure a smooth flow of data through our system. The transformation layer will make the data easier to work with for our reporting products and ML models, while the validation layer will ensure the data conforms to our expectations. For example: Is it null, NULL, or 'null'? Is 342 a valid country abbreviation code?
As we expand our product offering and ingest data from additional companies and 3rd-party providers the complexity of the challenge will evolve over time, keeping the problem fresh.
Scope:
You'll get to architect our system and lay the foundation for the future from both a technology and a system design perspective.
No longer will data show up without being tested and structured, as you'll create a system that checks its worst tendencies. You'll work closely with our ML and Eng team to ensure the design meets their requirements and that data properly flows through the system.
Philosophies:
- You strongly believe that action creates information.
- You want to work on a small team and have lots of responsibility.
- You look forward to being scrappy and enjoy overcoming challenges.
Requirements:
- 5+ years of experience delivering value through data at an early stage, high growth startup (ideally within the payments industry)
- Prior experience with cloud environments such as AWS or GCP
- Strong Data Modeling experience, and familiarity with different approaches (Intermediate and up)
- Strong SQL skills
- Strong Python skills
- Prior experience with workflow orchestration tools (Prefectm, Airflow, Dagster)
- Experience with distributed systems workflows (Temporal, AWS Step functions)
- Experience with cloud OLAP providers and optimization (Snowflake, Redshift, BigQuery)
- Experience with Kafka pub/sub patterns and data ingestion
- Experience with data transformation patterns and common tools (dbt)
We are focused on building a diverse and inclusive workforce. If you’re excited about this role, but do not meet 100% of the qualifications listed above, we encourage you to apply.
--------
Butter Payments is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics or any other basis forbidden under federal, state, or local law. Butter considers all qualified applicants in accordance with the San Francisco Fair Chance Ordinance.
Please review our CCPA policies here.
Top Skills
Airflow
AWS
BigQuery
Dagster
Dbt
GCP
Kafka
Prefect
Python
Redshift
Snowflake
SQL
Temporal
Similar Jobs
Artificial Intelligence • Cloud • eCommerce • Enterprise Web • Software • Design • Generative AI
As a Senior DevOps Engineer, you'll manage Webflow's build systems, oversee development environments, enforce best practices, and mentor junior team members to enhance efficiency and delivery in software development.
Top Skills:
AWSCi/CdDockerInfrastructure As Code (Iac)KubernetesNode.jsPulumi
Artificial Intelligence • Cloud • eCommerce • Enterprise Web • Software • Design • Generative AI
The Staff Data Scientist will lead projects to drive insights, define business metrics, advance experimentation, and collaborate with various teams to enhance user experience and product performance.
Top Skills:
PythonRSQL
Artificial Intelligence • Cloud • eCommerce • Enterprise Web • Software • Design • Generative AI
The Partner Manager will develop strategies for growing the reseller ecosystem, build relationships with partners, and work cross-functionally to drive mutual growth and success.
Top Skills:
AIBusiness DevelopmentPartner MarketingSaaS
What you need to know about the Calgary Tech Scene
Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.
