Data Engineer
New York, NY

Job Description

Our client is the leading freight marketplace that's transforming the $700 billion trucking industry, connecting shippers to a national network of reliable carriers. Fortune 500 companies such as Anheuser-Busch, Unilever, and Target rely on Our client to handle their most important full truck load (FTL) freight needs. With instant pricing tools, guaranteed capacity, data-driven insights, and reliable service, Our client is changing the world of transportation one load at a time. Come leave a positive impact on the environment as we help reduce the carbon footprint caused by the 65 billion wasted miles on the road.

Our client was named one of Forbes' "Next Billion-Dollar Startups" in 2018.

Based in New York City, Our client is backed by top VC firms including New Enterprise Associates (NEA), Canvas Ventures, and Lerer Hippeau. The company has raised more than $78.5 million in funding.

The problems we solve everyday are real and require creativity, grit, and determination. We are building a culture that challenges norms while fostering experimentation and personal growth. We're hiring team members who are passionate and are energized by the vision to simplify and transform one of the largest and most complex industries through technology, data and a strong commitment to customers.

Our Data Engineers build mission-critical data pipelines and warehouses that power forecasting models (e.g. pricing, capacity, matching) and business insights. These products enable improvements in the lives of truckers and shippers across the country. If you are excited about reinventing an industry from the inside out, send us your resume.

What you'll do

*

Design, build, and scale our data warehouse.
* Collaborate with Data Scientists, BI Analysts, Engineers, and Product Managers to gather requirements for specific datasets, reports, and model training.
* Research new data warehouse and data pipeline solutions. Identify requirements, build prototype implementations, propose adoption, and plan migration paths.
* Implement data pipelines that aggregate data from various sources and write to a variety of internal and external platforms. (Examples include S3, NetSuite, Salesforce, customer APIs.)
* Identify and resolve performance bottlenecks in SQL queries, workflows, and model training.
* Ensure availability of our production data stores and pipelines through building resilient systems, monitoring, alerting, team-wide on-call rotations, and triaging and resolving issues.
* Participate in blameless post-mortems and retrospectives that enable us to learn from both failures and successes in order to improve team process and software design.
* Our current data storage infrastructure is comprised of RedShift, PostgreSQL (Amazon RDS), DynamoDB, and Redis. We are hosted on AWS and leverage a variety of their services. We use Ruby and Python heavily throughout our production application and data infrastructure, along with bits of Java. We use Airflow to manage our ETL workflows and Amazon's Database Migration Service for moving data around.
* Code review and continuous integration are important parts of all our production code, including data architecture. We use Github and CircleCI and write automated tests using RSpec and unittest.



About you

*

Bachelor's degree in a STEM or quantitative field, or have equivalent training or work experience.
* Minimum of 2-years professional experience working in data engineering, product engineering, or infrastructure roles.
* Fluency in at least one programming language (Python, Ruby, C++, Java, or Go preferred).
* Proficiency with SQL.
* Experience with Linux command line and shell scripts.
* Working knowledge of data warehouses, data pipelines, and schedulers.
* You take pride in your work and the quality of products you build.
* You value collaboration and enjoy teaching and learning from peers.
* You speak up when you see something wrong and support your opinions with data.



Andiamo is an Equal Opportunity Employer

Andiamo provides equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, Andiamo complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

All qualified candidates are encouraged to apply by submitting their resume as an MS word document including a cover letter with a summary of relevant qualifications, highlighting clearly any special or relevant experience.