The Senior Data Engineer leads and implements best-in-class data management strategies and practices through various forms of integration, data acquisition/ingestion, data cleansing/refinements, data transformations/conversions, data migrations, data purging, and back-ups. The incumbent works with a variety of users and stakeholders to understand data requirements and supports the data architecture to translate into the data management practice at Healthfirst. The Sr. Data Engineer authors artifacts defining standards and definitions for storing, processing, and moving data including associated processes and business rules. Additionally, the Sr. Data Engineer maps the details within these artifacts to business processes, non-functional characteristics, qualitative criteria, and technical enablement. He/she must constantly think through the needs of the business to support efficient and error-free processes. The Sr. Data Engineer finds trends in datasets and develops workflows and algorithms to highlight strategic raw data as useful to the enterprise. The Sr. Data Engineer creates data acquisition strategy and develops dataset processes in a robust manner according to best practices of standardization.
Duties and Responsibilities:
- Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (e.g., scripts, programs, automation, etc.)
- Ensures quality of technical solutions as data moves across multiple zones and environments
- Provides insight into the changing data environment, data processing, data storage and utilization requirements for the company, and offer suggestions for solutions
- Ensures managed analytic assets to support the company’s strategic goals by creating and verifying data acquisition requirements and strategy
- Develops, constructs, tests, and maintains architectures
- Aligns architecture with business requirements and uses programming language and tools
- Identifies ways to improve data reliability, efficiency, and quality
- Conducts research for industry and business questions
- Deploys sophisticated analytics programs, machine learning, and statistical methods to efficiently implement solutions
- Prepares data for predictive and prescriptive modeling and find hidden patterns using data
- Uses data to discover tasks that can be automated
- Creates data monitoring capabilities for each business process and works with data consumers on updates
- Aligns data architecture to the solution architecture; contributes to overall solution architecture
- Develops patterns for standardizing the environment technology stack
- Helps maintain the integrity and security of company data
- Additional duties as assigned or required
Minimum Qualifications:
- 8+ Years overall IT experience
- Enterprise experience in scripting languages primarily Python and Pyspark building enterprise frameworks
- Enterprise experience in data ingestion methodologies using different etl tools(Glue,DBT or any other)
- Enterprise experience in data warehousing concepts and big data technologies like EMR, Hadoop
- Enterprise experience in any cloud infrastructure like AWS,GCP,Azure
- Strong SQL expertise across different relational and NoSQL Databases.
Preferred Qualifications:
- Strong knowledge of data security, encryption, and compliance standards.
- Hands-on experience with CI/CD pipelines and DevOps practices in a data engineering environment.
- Experience in API building
- Experience building stream platforms
Compliance and Regulatory Responsibilities: N/A
License/Certification: N/A
WE ARE AN EQUAL OPPORTUNITY EMPLOYER. Applicants and employees are considered for positions and are evaluated without regard to race, color, religion, gender, gender identity, sexual orientation, national origin, age, genetic information, military or veteran status, marital status, mental or physical disability or any other protected Federal, State/Province or Local status unrelated to the performance of the work involved.
If you have a disability under the Americans with Disability Act or a similar law and want a reasonable accommodation to assist with your job search or application for employment, please contact us by sending an email to careers@Healthfirst.org or calling 212-519-1798 . In your email please include a description of the accommodation you are requesting and a description of the position for which you are applying. Only reasonable accommodation requests related to applying for a position within Healthfirst Management Services will be reviewed at the e-mail address and phone number supplied. Thank you for considering a career with Healthfirst Management Services.
EEO Law Poster and Supplement
All hiring and recruitment at Healthfirst is transacted with a valid “@healthfirst.org” email address only or from a recruitment firm representing our Company. Any recruitment firm representing Healthfirst will readily provide you with the name and contact information of the recruiting professional representing the opportunity you are inquiring about. If you receive a communication from a sender whose domain is not @healthfirst.org, or not one of our recruitment partners, please be aware that those communications are not coming from or authorized by Healthfirst. Healthfirst will never ask you for money during the recruitment or onboarding process.
Hiring Range*:
-
Greater New York City Area (NY, NJ, CT residents): $131,900 - $190,570
-
All Other Locations (within approved locations): $117,400 - $174,675
As a candidate for this position, your salary and related elements of compensation will be contingent upon your work experience, education, licenses and certifications, and any other factors Healthfirst deems pertinent to the hiring decision.
In addition to your salary, Healthfirst offers employees a full range of benefits such as, medical, dental and vision coverage, incentive and recognition programs, life insurance, and 401k contributions (all benefits are subject to eligibility requirements). Healthfirst believes in providing a competitive compensation and benefits package wherever its employees work and live.
*The hiring range is defined as the lowest and highest salaries that Healthfirst in “good faith” would pay to a new hire, or for a job promotion, or transfer into this role.
