Data Engineer
San Francisco, CA

Job Description

Description

Global problems. Global impact.

Flexport's mission is to make global trade easy for everyone. We are re-making a trillion dollar industry that touches every person on Earth, which means solving some of the global community's most complex challenges. We are looking for makers who love learning, are passionate about collaborating, and desire to build solutions with a global impact.

Reliable and scaleable data pipelines and data warehouse are integral in allowing us to fulfill our mission of fixing the user experience in global trade. At Flexport you'll provide data for products that are at the forefront of reshaping the entire logistics & supply chain industries. You'll work alongside self-starters interested in solving real-world problems and streamlining the inefficiencies in the complex global trade industry.

You'll have the opportunity to reshape an industry by creating the new operating system for global trade. Started in 2013, with a total addressable market of $1 trillion, we've raised $304M from investors that include Google Ventures, First Round Capital, Bloomberg Beta, Y Combinator and more.

What you'll do

* Create new data assets and data warehouse elements in collaboration with business stakeholders, data scientists and software engineers


* Develop resilient pipelines from a variety of data sources


* Implement data frameworks for tracking data quality, timeliness, and completeness


* Build scraper framework processing hundreds of millions of records per day


* Take job scheduling framework to the next level using Airflow


* Be part of a close-knit data engineering team that ships new code every day



What you'll need

* 3+ years of using SQL for data manipulation in a fast-paced work environment


* 3+ years experience developing data pipelines using Python or Ruby


* 1+ year of Data Warehousing development plus strong fundamentals


* Experience with bash scripting and job schedulers


* Passion for business-oriented data development



What you'll get

* The opportunity to shape data engineering at agile startup


* Meaningful equity in a startup growing their business 20% every month


* Feature ownership - design, implement and own significant portions of data infrastructure



Our Stack

Our pipelines are built using Python and SQL, glued with bash. Data Warehouse is a combination of Postgres and Redshift. All of our infrastructure is based on AWS. Our BI data is only 15 minutes behind production servers.

Culture & Values

* Learn more at www.keyvalues.com/flexport