Software Engineer - Machine Learning / R Infrastructure Databricks
San Francisco, CA

Job Description

Mission

Databricks provides a unified analytics platform that allows users to focus on extracting value from their data using advanced analytics techniques and machine learning. To achieve this, Databricks offers a cloud-hosted SaaS platform created around Apache Spark. This is where you come in. You should be a software engineer passionate about architecting tools for machine learning scientists and statisticians, specifically when using R. You will build tools and features to make Databricks the best place for large-scale enterprise R workloads. The work you do will lead to providing a great experience for R users on Databricks.

Outcomes

* Improve state of distributed R computing through Apache Spark and R integration on Databricks
* Implement new features on Databricks platform for R users (e.g., ACL)
* Improve and extend Databricks R notebooks to satisfy R users' use cases and requirements
* Implement new R-based APIs on Databricks platform (e.g., secret management API)
* Expand Databricks workspace through integration with third-party tools such as RStudio and Shiny.
* Integrate critical packages from the R ecosystem into Databricks Runtime
* Provide engineering support and thought leadership to Databricks field engineering teams on R
* Give talks and write blog posts about R on Databricks

Competencies

* Strong foundation in algorithms and data structures, excellent communication and teamwork
* Production quality coding standards and patterns
* 3+ years of general software programming experience or equivalent experience in graduate research
* BS in Computer Science or equivalent practical experience
* Experience with development in R or Python scientific libraries

Benefits

* Medical, dental, vision
* 401k Retirement Plan
* Unlimited Paid Time Off
* Catered lunch (everyday), snacks, and drinks
* Gym reimbursement
* Employee referral bonus program
* Awesome coworkers
* Maternity and paternity plans

About Databricks

Databricks' mission is to accelerate innovation for its customers by unifying Data Science, Engineering and Business. Founded by the original creators of Apache Spark™, Databricks provides a Unified Analytics Platform for data science teams to collaborate with data engineering and lines of business to build data products. Users achieve faster time-to-value with Databricks by creating analytic workflows that go from ETL and interactive exploration to production. The company also makes it easier for its users to focus on their data by providing a fully managed, scalable, and secure cloud infrastructure that reduces operational complexity and total cost of ownership. Databricks, venture-backed by Andreessen Horowitz, NEA and Battery Ventures, among others, has a global customer base that includes Viacom, Shell, and HP. For more information, visit www.databricks.com.

Apache, Apache Spark and Spark are trademarks of the Apache Software Foundation.