Big Data Engineer
Costa Mesa, CA

Job Description

The Advanced Technologies Group is responsible for leveraging new and emerging open source technologies to solve key technical challenges for our business and clients as well as integrating new data sets, products and applications acquired by Experian.

As a Senior Developer on our team you will be responsible for applying your broad and deep knowledge of enterprise application development and big data to create seamless solutions that integrate our wide array of data and tools into comprehensive, scalable solutions

Key Responsibilities:

* Work in a collaborative manner with our scaled agile (SAFe) teams to rapidly deliver solutions
* Utilize your software engineering skills including Java, Spark, Python, Scala to Analyze disparate, complex systems and collaboratively design new products and services
* Integrate new data sources and tools
* Build working prototypes using Spark, Kafka, Microservices and other big data/cloud technologies using Java and Scala
* Implement scalable and reliable distributed data replication strategies
* Leverage Amazon Web Services to provide innovative solutions
* Convert business requirements to working prototypes and then deployable solutions
* Design and implement high-performance, scalable data solutions
* Ability to mentor and provide direction in architecture and design to onsite/offshore developers
* Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases
* Perform analysis of large data sets using components from the Hadoop ecosystem
* Own product features from the development phase through to production deployment
* Evaluate big data technologies and prototype solutions to improve our data processing architecture
* Provide best in class security in everything you do
* Automate everything
* BS degree in computer science, computer engineering or equivalent
* 10 years of experience delivering enterprise software solutions
* Proficient in Java, Spark, Kafka, Python, AWS Cloud technologies
* Must have active current experience with Scala, Java, Python, Oracle, Cassandra, Hbase, Hive
* 5 years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, Cassandra, HBase, Hive, Flume, Sqoop, Spark, Kafka, Scala Familiarity with AWS scripting and automation
* Flair for data, schema, data model, how to bring efficiency in big data related life cycle
* Must be able to quickly understand technical and business requirements and can translate them into technical implementations
* Experience with Agile Development methodologies
* Experience with data ingestion and transformation
* Solid understanding of secure application development methodologies
* Experienced in various big data formats
* Experienced in designing continuous Integration and continuous Deployment pipelines(DEVOPS) for data processing
* Experienced in developing microservices using spring framework is a plus
* Understanding of automated QA needs related to Big data
* Strong object-oriented design and analysis skills
* Excellent written and verbal communication skills

Benefits:

Working for a leading FTSE 50 global information services company is just one of the rewards of joining Experian. Our benefits package is designed to reward contribution and loyalty and to attract the kind of talented individuals who have their pick of employers. That is why we offer a highly competitive package which comprises:

* Competitive base salary
* Aggressive bonus plan
* Core benefits including: full medical, dental, vision, matching 401K and the opportunity to work with a global leader

Experian is listed on the London Stock Exchange (EXPN) and is a constituent of the FTSE 100 Index. Total revenue for the year ended March 31, 2017 was $4.3 billion. Experian employs approximately 17,000 people in over 40 countries.

Experian is an Equal Opportunity Employer. Anyone needing accommodation to complete the interview process should notify the talent acquisition partner. The word "Experian" is a registered trademark in the EU and other countries and is owned by Experian Ltd. and/or its associated companies.

EEO Including Disability/Veterans