Data Pipeline Engineer
New York, NY

Job Description

Role

You will design, develop, and deliver EMX products and services as we operate in a world where 2 extra milliseconds of latency can make or break. If you have experience in the ad tech world, have a passion for bringing new concepts to life, and love using the latest open-source technologies, then join us.

We look for self-starters who thrive in a fast-paced, agile environment; those who love wearing many hats, are able to change direction quickly and show a passion for learning new technologies will thrive at EMX. The ideal candidate will be able to work with a small, collaborative team of engineers, product managers, and designers and can prioritize, multi-task, and deliver cutting edge, clean code.

Responsibilities

* Stay current with the latest development best practices and apply your findings with the team
* Handle data/API's from client-side and server-side communication to back-end collection, manipulation, and analyzation
* Work with diverse array of existing products as well as engineer future data products
* Collaborate with front-end engineering teams to implement new features into the platform
* Have ownership of the data pipeline stack and availability to support in the event of systems failure
* Write clean, modular code that is scalable and secure
* Ensure optimal database architecture design, table schema design, and query design
* Meet certain performance goals including but not limited to data discrepancies, data availability, data granularity, data latency, data security, pipeline errors, and issue response times
* Work with a technology stack that includes AWS services, Python, Bash, SQL, GitHub, and more!

Qualifications

* BA/BS degree in computer science, math, statistics or related field
* 3 years of professional experience in using SQL, Python, Bash
* 2 years of experience using AWS products, such S3, Athena, and Redshift
* Experience designing and building complex, high-volume data pipelines
* Strong foundation in computer science, with competencies in data structures, algorithms, databases, query design and dev ops.
* Eager to learn new languages, frameworks and tools
* Recommending architectural optimizations and solutions

Nice to have

* Experience with Machine Learning
* Experience with Redis
* Experience with real-time data stacks, such as ELK (Elasticsearch, Logstash, Kibana)
* Experience in Adtech or Fintech is a plus, but not required

Benefits Include:

* Unlimited paid time off
* 401(k) employer contributions
* Competitive Medical, Dental, and Vision Insurance
* Life and Disability Insurance
* Entertainment and travel discounts
* Family-friendly benefits
* Relaxed dress code
* Collaborative environment
* Shiny new Macbook Air or Pro
* Surround yourself with some of the smartest people in the industry