Data Engineer Allstate
San Francisco, CA

Job Description

Drift is a new car sharing platform focused on improving mobility and reducing the cost of car ownership. We give car owners a way to earn extra income from their idle cars and connect drivers with a convenient, affordable way to drive a car when they want.

Job Description

As a Data Engineer, you will be part of a team of engineers working to manage our ever-growing collection of mobility and driver data from across the USA. You'll work primarily with Java and Apache Spark and a variety of data stores including MongoDB, Aurora PostgreSQL, Parquet, and Splunk. You will interact with engineering and product teams to design and optimize the schemas needed to support the products we dream up. Going forward, you'll support our evaluation of new tools and technologies to scale and analyze our data.

Job Qualifications

* Strong background in SQL, Data Modeling, and Performance Tuning in both relational and no-SQL databases
* 2+ years of experience in software engineering including, good programming skills in Java, with either Scala, or Python; Ruby on Rails is a plus
* Qualified candidates will also have experience with the following:
* Building data pipelines with distributed and federated systems
* Data visualization tools e.g., Tableau/D3
* Building services to expose calculated data
* MongoDB, Aurora PostgreSQL and Data Lakes
* Delivering Spark-based data
* Operating in AWS
* Generating and evaluating data quality metrics
* Privately Identifiable Information (PII) data practices- secure data practices