Senior Data Engineer
New York, NY

Job Description

The Center for Data Science and Analytics is the innovative corporate Analytics group. We are a rapidly growing entrepreneurial department, which aims to design, create and offer innovative data-driven solutions for many parts of the enterprise. We are aided by existing business with a large market share in individual life insurance. We have the freedom to explore external data sources and new statistical techniques, and are excited about delivering a whole new generation of Analytical solutions.

In fact, we are designing and will build one of the first multivariate model-based continuous risk differentiations in the industry. This model will incorporate current underwriting best practices (including medical rules) as features and add other data sources, patterns/ideas and variables to essentially create a rating plan to support the next generation underwriting process. This is just one of several projects with large business value. Geographic analytics on agents and customers, application fraud detection, agent success prediction and client prospecting analytics (off-line and on-line) are other exciting examples of enormous incremental value from analytics. Our products will be implemented into real-time core business processes and decisions that drive the company (e.g. underwriting, pricing, agent recruiting, prospecting, new product development).

We work with data ranging from demographics, credit and geo data to detailed medical data (medical test results, diagnosis, prescriptions) and social media information. We have a modern computing environment with a solid suite of data science/modeling tools and packages, and a large (but manageable) group of well-trained professionals at various levels to support you. Life insurance is on the verge of huge change. This is a chance to be part of, actually to drive, the transformation of an industry.

You will be part of Data & Platform sub-function team under Center for Data Science and Analytics. The Data & Platform team services internally to Data Scientists who focus on Statistical analysis.

You will be part of a fast paced, high-impact team who will work with an entrepreneurial mindset using some of the best of breed tools as part of our Enterprise Data Lake (Hadoop) using R, Spark and Python.

You will apply your data engineering skills to design, develop and enhance data strategy across and within the data science domain. This role provides strategic support to internal teams and leads the design, build and implementation of model ready data pipelines. Experience in a fast paced data engineering role with multiple and complex data sets.

Responsibilities

* Provide strategy and guidance for the architecture and build of data ingestion jobs to process disparate and unique data sources to form a high integrity model ready data set.
* Action oriented and comfortable working with complex data.
* Thinks strategically and works to define overall direction for solving complex business issues.
* Monitor and track data quality metrics
* Proactively address and resolve technical issues to support key business initiatives.
* Utilize emerging technologies to address business issues through technical innovation.
* Functions as data expert, contributes to analytics/solutions design and productizing decisions
* Can work independently with some supervision and be part of a collaborative team
* Work with Project Managers and Scrum Masters to provide milestones and stories
* Proactively and effectively communicates in various verbal and written formats with senior level member of the team and partners

Required qualifications

* Graduate-level degree in computer science, engineering, or relevant experience in the field of Business Intelligence, Data Mining, Database Engineering, Programming
* 8-10 years of overall experience working in the field of data wrangling and programming with a minimum of 2 years experience with ingesting, cleaning, merging and applying necessary data wrangling logic in Hadoop
* Excellent command of SQL - best practices, optimization, troubleshooting and debugging
* Strong Knowledge of Enterprise Platforms, Cloud Technology and high performance computing.
* Proficiency using Python for all data related work such as Numpy, Pandas, PySpark
* Experience working with Linux Operating System
* Experience working with data visualization tools or packages
* Experience building Exploratory Data Analysis reports such as Histograms, Box plots, Pareto, Scatter Plot using R, Python or a Data Visualization tool such as Tableau, Spotfire

Preferred:


* Understanding of statistical modeling concepts, designs and analytics-based products
* Any experience in using ETL tools such as Ab Initio, Talend, Informatica, Pentaho
* Any experience working with Data Warehouses and/or Data Marts
* Any experience in Life Insurance business

Andiamo is an Equal Opportunity Employer

Andiamo provides equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, Andiamo complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

All qualified candidates are encouraged to apply by submitting their resume as an MS word document including a cover letter with a summary of relevant qualifications, highlighting clearly any special or relevant experience.