Senior DevOps Engineer - Data Science
Irvine, CA

Job Description

Worker Sub-Type:

Regular

Job Description:

THE POSITION

BlackBerry Cylance is seeking a Senior DevOps Engineer who will join the Data Science Engineering team to lead the management of cloud infrastructures used within Data Science Engineering.

The ideal candidate will have extensive knowledge of AWS infrastructure technologies, understanding of cloud infrastructure provisioning using a combination of mutable and immutable resources (e.g. AMI building/cluster provisioning), and experience managing infrastructure as code.

You'll work in a cross-functional development team with an 18 member data science division (comprised of data scientists and software engineers) to improve team-wide infrastructure and accelerate machine learning model development. This position also requires an equal mix of strong technical skills and drive in order to solve challenging problems, design cutting-edge architecture, and scale our systems.

WHAT YOU WILL DO

* Work closely with data engineers and data scientists to correctly setup experimental and production systems on AWS infrastructure
* Develop and maintain reliable tools and reusable patterns for AWS cloud infrastructure provisioning such as but not limited to ElastiCache, Spark Clusters, AWS Lambda, Auto-scaling groups
* Inform software engineers and data scientists about DevOps best practices (automation, CI, automated testing, etc)
* Maintain/improve existing IAM security roles and policies defined in Terraform to correctly set users up with appropriate access
* Maintain Jenkins cluster (we run tests using Jenkinsfiles and Docker containers)
* Deploy and configure monitoring systems on existing and new infrastructure
* Troubleshoot AWS issues with a team of data scientists and engineers

WHO WE ARE LOOKING FOR

* A consistent track record for delivering commitments on time and with minimal supervision
* Strong problem solving skills with an equally strong sense of responsibility and ownership
* Ability to investigate and understand new technologies needed for the job
* In-depth knowledge of Linux and networking troubleshooting
* AWS cloud infrastructure (3+ years). Particularly valuable is experience in:
* IAM (with cross account policies)
* S3
* EC2 (and AMI building)
* Autoscaling
* SQS
* Route53
* Lambda


* Deploying and configuring AWS services using tools such as boto, Amazon SDKs, Terraform, etc (2+ years experience)
* Jenkins and Jenkinsfile
* Automated configuration management tools such as Saltstack, Puppet or Ansible (1+ years)
* Scripting languages such as Python 2.x/3.x and shell scripting in a *NIX environment
* Deploying and configuring monitoring systems
* Git

ABOVE AND BEYOND

* Experience with provisioning and configuring Spark clusters
* Experience with Pyspark or Scala-spark at scale
* Experience building data processing pipelines
* Experience using Terraform
* Experience configuring machines with Saltstack
* Experience building AMIs with Packer
* Experience building Docker containers
* Motivation to automate all tasks
* Python packaging and package management (pip)

WHAT YOU NEED TO APPLY

WHAT WE NEED FROM YOU TO APPLY

* Current resume
* Coverletter/summary expressing:
* Why you are interested in working at Blackberry Cylance
* The skills, strengths and expertise you will contribute to our diverse team of extraordinary talent and humble hearts



Job Family Group Name:

Product Development

Scheduled Weekly Hours:

40