Senior Data Engineer
Aliso Viejo, CA

Job Description

As Senior Data Engineer, you will be responsible for gathering and collecting data, storing it, processing (batch or real-time) and delivering it to the data analyst/science team to easily query it.

We are looking for a savvy mid - senior data engineer who is eager to continually improve their skills, learn new technologies and is willing to take initiative to contribute beyond basic responsibilities.

RESPONSIBILITIES:

* Understanding data source (10%)
* Develop data processes for constructing, mining and modeling that are delivered to the data analyst/science team (30%)
* Create large data warehouses by running ETL (Extract, Transform and Load) that is used for analysis by the data analyst/scientists (30%)
* Install continuous pipelines of huge pools of filtered information so that data analyst/scientists can pull relevant data sets for their analyses (20%)
* Develop, construct, test and maintain architectures such as databases and large-scale data processing systems (10%)

REQUIREMENTS:

* BS in Computer Science or equivalent experience
* 3+ years of day-to-day working experience as data engineer
* Experience with object-oriented and functional programming languages: Python, Scala etc.
* Experience with RDBMS (MS-SQL, MYSQL etc.) and NoSQL (MongoDB, DynamoDB etc.)
* Experience with ETL and data integration tool: Airflow, Informatica
* Experience with AWS cloud services: EC2, S3, EMR, Glue, RedShift, Athena etc.
* Experience with Big Data: Hive, Impala, Fluentd, Spark, Sqoop, Pig and CDH(Hadoop)
* Proficiency in general database administration concepts and efficient query writing
* Excellent verbal and written communication skills

PLUSES:

* Experience with data visualization software like Tableau

About NCSOFT

NCSOFT is one of the leading gaming publishers in the world. At NCSOFT West, we manage the portfolio, initiatives and game services across the Americas, Europe, Australia and New Zealand. Together we operate many of the most successful and influential massively multiplayer online games in the industry, welcoming hundreds of millions of players daily into exciting living worlds for extraordinary adventures.