Lead Data Engineer - Insurance Verisk Analytics
San Francisco, CA

Job Description

With a history of impressive growth, an innovative culture, and offering industry-leading solutions, Verisk Analytics is an amazing place to work and make a difference. In 2018, Forbes magazine named Verisk to its World's Best Employers list and, in 2017, to its World's Most Innovative Companies list for the third consecutive year. We also earned the Great Place to Work® Certification for the third consecutive year in recognition of our outstanding workplace culture.

Verisk is a leading data analytics provider serving customers in insurance, energy and specialized markets, and financial services. Using advanced technologies to collect and analyze billions of records, Verisk draws on unique data assets and deep domain expertise to provide first-to-market innovations integrated into customer workflows. We've been delivering predictive analytics and decision support solutions to our customers for nearly 50 years, helping them protect people, property, and financial assets. At Verisk, you'll be part of an organization that's committed to serving the long-term interests of our stakeholders, including the communities where we operate.

At Verisk, you can build an exciting career with meaningful work; create a positive and lasting impact on the business; and find the support, coaching, and training you need to advance your career. Our culture of innovation means your ideas on how to improve our business will be heard. As key contributors to our success, our team members enjoy working in a business-casual, collaborative environment that offers state-of-the-art resources, advanced technologies, and an excellent benefits package.

Job Description

The Data Affluence group is responsible to support the analytic product development in the following aspect

* Develop and maintain a data model in Cloud that contains the major entities and attributes which represent the ideal state of content and structure for insurance claims. Our focus would be on any transformed/engineered/normalized views that would create efficiencies and provide value added transformed attributes for data science teams to consume
* Identify new or existing raw sources of information to better populate our conceptual data model
* Enhance data assets by applying new methods and algorithms to raw data
* Develop expertise in each data asset to become the go-to resource for data consumers/users on both raw data and transformed data
* Explore and deploy right tools for exploratory, Metadata and Master Data Management, data quality and reporting and data process flow management
* Creating data pipelines to support analytic products in both development and deployment
* Create highly reusable code modules and packages that can be leveraged across the data pipelines
* Develop and maintain data dictionaries for governance of published data sources
* Commercialize enhanced data assets

Your responsibility as a lead data engineer is to help recruit and develop a team of data engineers/data scientist in diverse locations to

* Independently execute data projects from project design/planning, resource allocation to task management using JIRA
* Assist manager to create detailed project plans to ensure projects are completed on time and within budget
* Explore new methods/tools for continue improvement of quality solutions
* Buildup feature engineering pipeline with scalable deployment
* Collaborate with product management team, data warehouse team, data science team and DevOp team to ensure quality work is produced
* Communicate effectively to internal and external clients.
* Assures compliance with regulatory and privacy requirements during design and implementation

Qualifications

* Experience in columnar relational data stores and NoSQL technologies
* Experience with big data tools such as Spark etc. as well as strong SQL skills
* Experience delivering data pipelines and managing resulting data stores using managed cloud services (like AWS Services)
* Proficient understanding of distributed computing principles
* Experience with modern data pipelines, data streaming, and real time analytics using tools such as Apache Kafka, AWS kinesis, Spark Streaming, ElasticSearch, or similar tools
* ETL or Pipeline design/implementation with Large Distributed Databases (Spark/Scala preferred)
* Outstanding interpersonal skills.
* BS/MS/PhD in Computer Science or a related field (ideal)
* Strong CS fundamentals, problem-solving skills and software engineering skills
* 5+ years industry experience in data engineering and/or software development
* Experience in a hands-on, data centric role with data engineering, streaming, or warehousing.
* Ability to communicate effectively with stakeholders
* A strong ability to understand and organize data from various sources
* Ability to identify and resolve performance and data quality issues

Verisk Analytics is an equal opportunity employer.

All members of the Verisk Analytics family of companies are equal opportunity employers. We consider all qualified applicants for employment without regard to race, religion, color, national origin, citizenship, sex, gender identity and/or expression, sexual orientation, veteran's status, age or disability.

http://www.verisk.com/careers.html

Unsolicited resumes sent to Verisk, including unsolicited resumes sent to a Verisk business mailing address, fax machine or email address, or directly to Verisk employees, will be considered Verisk property. Verisk will NOT pay a fee for any placement resulting from the receipt of an unsolicited resume.