Software Engineer - Big Data Platform
Redwood City, CA

Job Description

The Basics:

Our core product is being used by more and more companies and developers globally, and the demand on our backend systems and databases continues to grow. Today we're handling over 6 billion API transactions a day. You would be responsible for developing and leading the systems and infrastructure to build, release and deploy our product across our platform. You would help us keep the Engineering team running smoothly and efficiently. You will help the Engineering team accept tools, automating the configuration and deployment of services.

Are you naturally inclined to love big-data sets and use them to drive business growth? Are you passionate about big-data technologies and bringing cutting-edge technologies to the table?

Are you a leader in data domain who can identify state-of-the-art vs cutting edge and make clear decisions on the technologies for data wrangling? Do you like to be in a place where you can get a phenomenal working culture and support, visibility for your work and grow?

We are looking for an ambitious, driven individual to join our data platform and engineering team. In this role, you will be responsible to share your vision, expand, improvise and add necessary optimization to the data pipelining (batch and streaming) architecture, infrastructure to enable other engineering teams to do data engineering efficiently.

What you'll do:

* Work with data platform and engineering product manager, your partners to build necessary tools, help their data-related needs.
* Create efficient data ingestion process in Druid, preach standard methodologies on Druid data schema management.
* Create tools on top of Airflow to enable other engineering teams to write batch pipelines effectively and easily.
* Create tools on top of stream processing frameworks to enable other engineering teams to write stream pipelines effectively.
* Identify existing technical problems in the infrastructure or data engineering architecture, design and implement, recommend solutions to solve.
* Always keen to improve engineering efficiency, automate manual steps, improve monitoring and alerting solutions which are already in place.
* Create and maintain core data pipelines which involve both batch and streaming pipelines.

We're Looking for Someone With: Qualification

* 1 to 3 years of experience in data engineering.
* 1 to 2 years of experience in software engineering on customer-facing products.
* Great understanding of modern data warehousing concepts using Hadoop, Spark and modern storage like HDFS, S3 and data modeling.
* Great understanding, experience in modern ETL (incremental, one-time) with DAG design patterns, data quality checks etc. Airflow experience is helpful but Oozie, Luigi can help as well.
* Phenomenal experience building and maintaining data pipelines.
* Proficient in SQL and at least 1 scripting/programming language (Python preferred).
* An efficient programmer in one or many languages and we prefer Java 8 or 9, Python and/or Scala. You write readable efficient code, love testing your code and choose an object-oriented vs functional style programming at appropriate places.
* Familiarity with AWS.

Preferred Qualification

* Experience with Linux, and containers using Docker and Kubernetes.
* Experience building large scale distributed data infrastructure.
* Experience with Kafka or Kinesis.

If all above described you accurately, then we need to talk to you.

About Us:

At Branch, we're transforming how brands and users interact across digital platforms. Our mobile marketing and deep linking solutions are trusted to deliver seamless experiences that increase return on investment, decrease wasted spend, and eliminate siloed attribution. By integrating Branch technology into core marketing channels including apps, web, email, social media, search, and paid ads, leading brands are driving higher-value conversions than ever before.

Headquartered in Redwood City, CA and with offices around the globe, Branch has raised more than $200M from investors such as NEA, Founders Fund and Playground Ventures. We power mobile links, attribution, and measurement for more than 3 billion monthly users and over 50,000 apps, including Airbnb, Ticketmaster, Reddit, Buzzfeed, Twitch, OfferUp, Poshmark, and many more.