Big Data Engineer Jet.Com
Hoboken, NJ

Job Description

The Data Platforms team at JET is looking for an exceptionally talented Data engineer with an outstanding track record reflecting achievements and skills in modernizing and improving the data infrastructure from the ground up. So, if you are passionate about working with very Large Data sets (structured/unstructured), building large scale Data processing platforms, implementing world class data governance and operational controls, solving complex performance challenges and building robust ETL pipelines then we would love to talk to you.Our engineers combine creativity, curiosity, and drive to continuously perfect and revolutionize Jet from the inside out.

The Environment

The Data Platforms team at JET is looking for an exceptionally talented Data engineer with an outstanding track record reflecting achievements and skills in modernizing and improving the data infrastructure from the ground up. So, if you are passionate about working with very Large Data sets (structured/unstructured), building large scale Data processing platforms, implementing world class data governance and operational controls, solving complex performance challenges and building robust ETL pipelines then we would love to talk to you.

What you will do:

* Play a pivotal design and hands on implementation role in improving the Data infrastructure in a project-oriented work environment.
* Influence cross functional architecture in sprint planning
* Gather and process raw data at scale - collect data across all business domains (our functional-first, event sourced, micro services backend) and expose mechanisms for large scale parallel processing
* Design, implement and manage a near real-time ingestion pipeline into a data warehouse and Hadoop data lake.
* Process unstructured data into a form suitable for analysis and then empower state-of-the-art analysis for analysts, scientists, and APIs
* Build efficient new Data Models and refactor existing ones. Partner with business to build right data models and analytics capabilities.
* Solve complex SQL and Big Data Performance challenges.
* Mitigate Risks in our data infrastructure by developing the best in class tools and processes.
* Implement controls, policies, processes and best practices in the Data Engineering space.
* Evangelize an extremely high standard of code quality, system reliability, and performance.
* Help us improve our database deployment and change management process.
* Provide reliable and efficient Data services as part of the database team.
* Work closely with the devs on development best practices and standards.
* Be a mentor.

What you will have:

* Degree in Computer Science, Information Technology, Math or related technical field.
* Natural inclination for designing well thought out data solutions as well as solid hands-on implementation capability
* 5+ years' experience in engineering data solutions using technologies including Spark (batch/streaming), Scala/Java (building data pipelines vs frameworks), Hadoop, Hive, HBase, Kafka, Spark, Oozie, Yarn.
* Solid hands-on experience in building data pipelines, deploying and managing Big Data infrastructure, establishing deployment and operational excellence of Big Data clusters.
* Experience in Relational databases, Data Warehousing, SQL, ETL and/or NOSQL databases will be sweet.
* Proven experience in Building or improving large scale data infrastructure from the ground up. This could include building Data warehousing stores, Data Architecture, Data Integration, building highly performant data movement pipelines, building tools and automation to facilitate Data and operational governance, Data Lineage, Automation and Monitoring.
* Proven Performance Tuning Accomplishments and Advanced tuning and trouble shooting skills in Large data environments on the Hadoop or RDBMS stack.
* Advanced knowledge of internals of at least one RDBMS (MSSQL preferred) and best practices.
* Data Ops experience including hands on skills in scripting language such as Python, Perl or Bash
* Proven experience in trouble shooting, problem determination and rapid problem resolution
* Experience and ability to work under high pressure in a complex technical environment.
*

About Jet

Jet is reshaping ecommerce as we know it. Based in Hoboken NJ (just 10 min from Manhattan), we are a shopping site on the relentless pursuit to build the greatest shopping experience in the world. At Jet, we believe in bold. That means taking risks, asking "why not", looking where no ones looked before and bringing it! Our engineers are utilizing world class technologies, to optimize the supply chain, remove unnecessary costs, sprinkle in some surprise and delight all while saving customers every penny possible and we're just getting started. At Jet, we have worked hard to build a culture that stresses the importance of learning and sharing knowledge. If you want to be part of the team that is changing the shopping norm and learning a lot along the way, we have a hunch you'd look good in purple.

See what we've been up to

"A New & Improved Saving Experience" // by Jessica Anerella, Product Design at Jet.com