Job Directory Big Data Engineer

Big Data Engineer
Costa Mesa, CA

Companies like
are looking for tech talent like you.

On Hired, employers apply to you with up-front salaries.
Sign up to start matching for free.


Job Description

Experian is seeking a Big Data Engineer to join our CIS Product Delivery team. This is a great opportunity for someone with strong big data analytics skills and big data tools such as Hadoop, Spark, Kafka etc. to work on exciting engineering development projects. If you are passionate about big data, Hadoop, Cloudera and developing analytics solutions with experience in Python, R, SQL, then this would a perfect opportunity to grow your professional career.

About Experian

Experian is the world's leading global information services company, unlocking the power of data to create more opportunities for consumers, businesses and society. For five years in a row, we have been named in the Top 100 "World's Most Innovative Companies" by Forbes Magazine. With a focus on our employees, we were rated the #1 Top Workplace by the Orange County Register. Experian Consumer Information Services is redefining the way our clients do business within all aspects of the customer credit lifecycle. Fueled by best-in-class data and innovative technology we help businesses make smarter decisions, identify consumers, make decisions on loans, market to prospects and collect.

About this role

As a Big Data engineer, you need to be intimately familiar with assembling large, complex data sets to satisfy functional and technical business requirements. Analytical skills related to working with unstructured datasets.

* Optimize data delivery, automate manual processes, re-design infrastructure for improved scalability and identify, design and implement data ingestion, data delivery process improvements.
* Collaborate with analytics, data scientists and product teams to assist in building and optimizing innovative products and services to market
* Develop analytics tools that utilize data pipeline to provide actionable insights into customer acquisition, operational efficiency and key business performance metrics.
* Build big data pipelines, data sets and conduct performance tuning
* Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
* Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
* Experience supporting and working with cross-functional teams in a dynamic environment
* Keep data separated and secure across architectural boundaries through multiple data centers and AWS regions.

What your background looks like:

* 5 years of experience in a Data Engineer role
* Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
* Experience with big data tools: Hadoop, Spark, Kafka, etc.
* Experience with relational SQL and NoSQL databases such as Cassandra.
* Experience with AWS cloud services: EC2, EMR, Athena
* Experience with object-oriented/object function scripting languages: Python, Java, C , Scala, etc.
* Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as familiarity with unstructured datasets.
* Deep problem-solving skills to perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
* Build processes supporting data transformation, data structures, metadata, dependency and workload management.
* Proven experience in manipulating, processing and extracting value from large disconnected datasets.
* Strong project management and organizational skills.
* Experience supporting and working with cross-functional teams in a dynamic environment.


* Four weeks of vacation to start, five sick days and two volunteer days (plus eleven paid holidays)
* This is a bonus eligible position with a 15% bonus target
* Employee stock purchase program and 401K matching
* Wellness initiatives, online discounts, employee discounts, pet insurance and more

EOE including disability/veterans

Let your dream job find you.

Sign up to start matching with top companies. It’s fast and free.