Senior Big Data Engineer
New York, NY

Job Description

Business Unit:

FreeWheel is hiring a New York based Senior Big Data Developer reporting to Director, Engineering.

FreeWheel helps the television industry generate revenue from their premium content through a robust technology platform, which enables consumers to watch entertainment on any devices from PC, mobile, set-top box to traditional TV.

New York Data Engineering Team at FreeWheel is part of a global engineering group that is building advanced and high quality solutions to process terabytes of raw set top box data on state of the art big data platform, and make it accessible in a secure and cost effective manner for other teams.

Responsibilities

Develop software to run on cloud native big data infrastructure built on AWS using Spark, Lambda, S3, and other cloud native services.

Design and implement high-performance, scalable and optimized data solutions.

Write applications to derive insights from terabytes of highly valuable data sets.

Develop quick proof of concepts for marketing teams and clients with big data needs.

Manage and improve existing code base and add new features to support business needs

Conduct design and code reviews

Work in a collaborative manner with a smart, diverse and fast-growing New York based Data Engineering scaled agile (SAFe) teams to rapidly deliver high quality solutions.

Interface with global engineering, product and operation teams in US/EU/China to incorporate their innovations and vice versa

About You

Bachelor's or master's degree in Computer Science or similar field of study

5+ years of experience building large scale big data applications

Proficient with SQL and database general concepts

Hands-on experience with data processing is preferred.

Experience in AWS technologies such as Lambda, Kinesis, EC2, IAM, CloudFormation, Route 53, ELB, VPC, Cloudwatch, EMR, S3 and Big data related technologies like HIVE, Presto, Kafka is strongly preferred.

You are flexible with languages and tools and are willing to learn whatever is necessary to get the job done. Experience with at least one of the following languages Golang, Scala, Python, and or Java is preferred.

Experience with CI/CD tools like Jenkins.

AWS certification is a plus: AWS Developer/Architect/DevOps/Big Data

Familiar with Linux commands and environments

Strong problem-solver and a team player

Comcast is an EOE/Veterans/Disabled/LGBT employer