Software Engineer- Clusters Databricks
San Francisco, CA

Job Description

Mission

Databricks provides a unified analytics platform that allows users to focus on extracting value from their data, while Databricks handles for them the challenging, data-agnostic, parts of analyzing Big Data, such as reliability, easily spin up clusters, code management in notebooks and schedule production jobs. This team builds the compute fabric necessary for managing Spark workloads in a robust, flexible, secure and cloud agnostic way. Common use cases are stable and fast while advanced users have the primitives required to take advantage of cutting edge cloud features, services and data sources.

Outcomes

* Develop and extend the Databricks product. This implies, among others, writing software in Scala, Python or Javascript and/or interacting with: cloud APIs (e.g., compute APIs, cloud formation, Terraform), with open source and third party APIs and software (e.g., Kubernetes) and with internal APIs.
* Be responsible for full software development lifecycle - design, development, testing, operating in production
* Architect solutions to achieve a high level of reliability, scalability and securityCommunicate effectively with other engineers in the same team, with other teams and with various other stakeholders such as product managers
* Operate in an Agile development environment

Competencies

* 4+ years of production level experience in one of: Java, Scala, C++
* Experience in architecting, developing, deploying and operating large scale distributed systems
* Experience with usability and user experience
* Experience with cloud APIs (e.g., a public cloud such as AWS, Azure, GCP or an advanced private cloud such as Google, Facebook)
* Experience working on a SaaS platform or with Service Oriented Architectures
* Good knowledge of Linux OS
* Experience with API development
* Good knowledge of SQL (MySQL preferred)
* Experience with software security and systems that handle sensitive data
* Exposure to container technologies, such as Docker
* Experience with Continuous Integration/Continuous Deployment frameworks

Benefits

* Medical, dental, vision
* 401k Retirement Plan
* Unlimited Paid Time Off
* Catered lunch (everyday), snacks, and drinks
* Gym reimbursement
* Employee referral bonus program
* Awesome coworkers
* Maternity and paternity plans

About Databricks

Databricks' mission is to accelerate innovation for its customers by unifying Data Science, Engineering and Business. Founded by the original creators of Apache Spark™, Databricks provides a Unified Analytics Platform for data science teams to collaborate with data engineering and lines of business to build data products. Users achieve faster time-to-value with Databricks by creating analytic workflows that go from ETL and interactive exploration to production. The company also makes it easier for its users to focus on their data by providing a fully managed, scalable, and secure cloud infrastructure that reduces operational complexity and total cost of ownership. Databricks, venture-backed by Andreessen Horowitz, NEA and Battery Ventures, among others, has a global customer base that includes Viacom, Shell, and HP. For more information, visit www.databricks.com.

Apache, Apache Spark and Spark are trademarks of the Apache Software Foundation.