Senior Data Engineer
Monterey Park, CA

Job Description

Overview

Under the direction of Business Intelligence (BI) Manager, the Senior Data Engineer works closely with business leaders, managers, staff and vendor to accurately gather and interpret requirements, specifications. Develop technical specifications and recommend, design, develop, test, implement, and support innovative and optimal data solutions. Serves as a coach and mentor to BI team

Responsibilities Lead on all aspects of a modern and flexible SDLC approach, applied to data engineering, analytics and data science efforts Provide business guidance and steer efforts toward desired outcomes; partner with internal stakeholders and external vendors to meet strategic data warehouse goals Research, evaluate and formally recommend third party software and technology package Drive the technical design of large scale data platforms, utilizing modern and open source technologies, in a hybrid cloud environment Set standards for data engineering functions; design templates for the data management which are scalable, repeatable, and simple Defines and develops appropriate controls to monitor quality of the enterprise data warehouse process Set standards for data engineering functions; design templates for the data management which are scalable, repeatable, and simple Preparation of technical specification Perform all other related duties as assigned Qualifications Minimum 9 years' experience in a complex data engineer or similar role; Health Care industry experience highly desired Bachelor's degree in Computer Science or similar or equivalent 8 years of industry experience 3 years paid development experience using Python, PySpark, Spark, Hadoop, Kubernetes highly desired. 3 years hands on experience with SQL and RDBMS systems such as Microsoft SQL Server Deep understanding of how Spark processes data and how workloads are distributed with Kubernetes highly desired. Experience building solutions with NoSQL database. Proficiency and experience in architecting big data platforms on the public cloud highly desired. Experience in implementing a ata architecture with separation between storage and compute preferred.