Senior Software Engineer-Platforms
San Francisco, CA

Job Description

Description

Marin's Data Platform team builds our core data infrastructure including transactional data (OLTP), metric data (OLAP) and the related ETL pipelines. Our platform is built running on CDH, using HBase, Phoenix and Presto, and we make heavy use of Spark, Spark Streaming, HDFS, Kafka, Oozie, ZooKeeper and Yarn.

If you are or strive to be an expert in those big-data distributed technologies, if you can read documentation and open-source code and are excited to participate in the Hadoop community, if you thrive on deep-diving into gnarly production issues related to big-data platforms, you belong with us!

Responsibilities

* Own the Hadoop tool-set
* Work closely with SRE and guide the development and use of those tools
* Actively monitor, optimize, tune and configure the tools
* Resolve platform-related issues as they come up
* Drive Hadoop platform upgrades
* Design, build, and unit-test object-oriented, scalable, and maintainable software on top of the Hadoop ecosystem

Requirements

* BS/MS in Computer Science or related discipline
* 5+ years software development experience
* 3+ years using or administering Hadoop clusters
* Familiarity with most of the following: CDH, HBase, Phoenix, Kafka, YARN, Spark
* Critical thinking and problem solving
* Enjoy troubleshooting production issues related to big-data platforms
* DevOps experience is a plus