Principal Technology Operations Engineer (Santa Monica) Cornerstone Ondemand
Santa Monica, CA

Job Description

We will expect you to have:

* Multiple years hands on System Engineering and Administration, Networking or Data Center operation and support experience, specifically for a large technology or internet company
* Multiple years' experience providing technical leadership for an International team of Engineers in geographically diverse locations providing 24/7/365 operational support
* Demonstrated experience building and maintaining production system infrastructure, involving massive amounts of data that needs to be secured, replicated, archived, and delivered to end users with high reliability
* Deep understanding of web application protocols
* Experience monitoring remote servers, applications, and cloud services
* Scripting Experience: BASH, Python, Powershell
* Expert level experience with Linux and Windows infrastructure; OS, networking, sysadmin
* Multiple years working for enterprise corporations, preferably SaaS, in highly efficient and dynamic teams, using different hardware and software platforms
* Extensive experience in a complex software environment
* Bachelor's degree in Engineering or Computer Science, or equivalent work experience required
* Collaborative team player that is excited to work alongside some of the most talented resources

Responsibilities:

* Work hard to keep Cornerstone's infrastructure and application services up 99.99%
* Manage configuration, administration, upgrade and maintenance of Windows and Linux servers, Microsoft clusters, Virtual Infrastructure, SQL Always-On Databases, Storage (HP, Pure, EMC), Amazon Web Services (AWS) EC2 and native Infrastructures, and multiple open source technology solutions
* Bring new automation technologies to improve the velocity and quality of our engineering efforts
* Design, engineer, and automate across multiple proprietary, open source, and cloud infrastructure and technologies to enable reliable and rapid deployment of microservices with effective monitoring and resilient operations
* Standardize, automate and document setup of development and production environments
* Act as the champion and driver for special projects and persistent issues
* Drive incidents to resolution, ensuring that the service SLAs are met
* Work with your team members and peer groups to ensure the security, availability, resiliency, and compliance with industry and regulatory requirements (ISO, SSAE16, FedRamp, SOC I&II, PCI) in a fast-paced SaaS environment
* Research and resolve complex problems encountered during the installation and operation of our software applications to ensure negligible impact on both client and internal operations
* Maintain Cornerstone's global SaaS service ensuring all incidents are tracked and remediated and changes are implemented under the auspices of Cornerstone's policies and procedures
* Provide technical leadership to the team regarding stand operation procedures and best practices; guide and train team members to achieve collective excellence
* When required, work extended hours under considerable pressure, including holidays and weekends if necessary, to ensure operational compliance with Cornerstone service level agreements. Providing 24/7/365 support for all production services
* Interact with our clients on an as needed basis regarding technology issues and escalations
* Managing and extending our existing infrastructure to support our Multi-Cloud services
* Liaison with Software Engineering and IT Security and Compliance departments as we continue to drive towards integrated and autonomous site reliability and devops domains
* Help other departments to move towards shared services including centralized logging, monitoring, and CI/CD services.

Required Skills and Experience:

* Expertise in incident and problem management including timely problem identification, successful resolution, and root-cause analysis
* Architecture and implementation of both on-premise and cloud-based monitoring, alerting and reporting, using Splunk, Logic Monitor, Sensu, CloudWatch, ELK, Prometheus and Grafana
* Advanced skill in designing, analyzing, and troubleshooting large-scale distributed systems
* Solid experience with scripting languages (Python, Bash, PowerShell, etc.), infrastructure automation and configuration management tools such as Puppet, Cloudformation, Salt, Ansible, and Chef
* Practical experience managing databases or search engines, such as MS SQL Server, MySQL, PostgreSQL, Redis, or ElasticSearch
* Expert knowledge of managing and supporting Windows 2012, 2016, IIS, and Linux
* Networking basics including load balancing: A10/F5, Firewall support - opening/managing ACLs
* Experience of Active Directory, VMware, and managing Cloud based infrastructure
* Ability to debug and optimize code and automate routine tasks
* Demonstrated ability to coordinate cross-functional work toward task completion
* Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive

.