Sr. Engineer, Software (Splunk) T-Mobile USA
Snoqualmie, WA

Job Description

Sr Engineer, Software (Splunk)

Description

The Technology Sr. Software Engineer will work with a team of other software developers and network and systems engineers to design, implement, and deploy software which meet customer's requirements, scales easily, removes the limitations of traditional networking solutions, and supports deployment in highly available environments. The engineer will participate in architecture and design of various software components focused on creating applications that leverage technologies such as virtualization, micro services, SDN, NFV, and Big Data platforms and technologies. Works on technical assignments that are moderately difficult, requiring judgment in resolving issues or in making recommendations. Works on assignments requiring considerable judgment and initiative. Understands implications of work and makes recommendations for solutions. Normally receives little instruction on daily work, general instructions on newly introduced assignments.

The Sr. Engineer has deep experience and strong passion for delivering highly available, performant logging solutions using the Splunk platform. You are an expert Splunk administrator with a solid UNIX/Linux background. You know how to analyze and tune both a Splunk environment and a UNIX/Linux server for optimal performance. You are tired of manual, repetitive tasks and have experience with automation tools, and you also can develop custom automation solutions. You have experience with enterprise log management platforms and pipelines at a multi-petabyte scale.

Enterprise Core Competencies

Requires competency in customer focus, change & innovation, strategic thinking, relationship building & influencing, talent management, results focus and inspirational leadership.As America's Un-carrier, T-Mobile USA, Inc. (NASDAQ: "TMUS") is redefining the way consumers and businesses buy wireless services through leading product and service innovation. The company's advanced nationwide 4G and 4G LTE network delivers outstanding wireless experiences for customers who are unwilling to compromise on quality and value. Based in Bellevue, Washington, T-Mobile USA. Inc. provides services through its subsidiaries and operates its flagship brands, T-Mobile and Metro by T-Mobile. For more information, please visit http://www.t-mobile.comMinimum Required

* 4+ years technical engineering experience
* 3+ years of Splunk administration experience or similar
* 3+ UNIX/Linux administration and shell scripting
* 3+ years of remote logging experience (syslog-ng or Rsyslog)
* 3+ years of programming experience (Python preferred)
* Well-versed in Splunk SPL (Search Processing Language)
* Familiar with storage solutions and technology (SAN, NAS, SSD, Flash, etc.)
* Familiar with networking protocols, firewalls, load balancers
* Familiar with virtual machines
* Ability to work with minimal supervision
* Self-motivated and able to work well under pressure
* Ability and desire to work cooperatively with others on a team

Desired

* Splunk Certifications are a plus: Splunk Power User, Architect, Admin, Developer
* Experience with Kafka and real-time distributed data pipelines
* Experience with Splunk ITSI, ES, MLTK and apps in Splunkbase a plus
* Previous experience in wireless/telecom is a plus

Education

Minimum Required

* Bachelors Degree. Computer Science or Engineering or equivalent experience

Essential Functions

* Continually analyze and tune the Splunk application and servers to optimally use the system resources
* Perform deployments of Splunk configurations to support data onboarding and other maintenance/upgrade activities
* Implement both off-the-shelf and custom monitoring solutions to proactively and quickly detect issues affecting the Splunk platform and user experience
* Be able to quickly identify and resolve Splunk issues, even during non-business hours if necessary
* Educate and respond to user base on all Splunk questions
* Work with the Automation Team to leverage their solutions for managing multiple Splunk deployments
* Participate in design discussions with Principals and cross-functional teams
* Participate in a regular on-call rotation to support the Splunk platform
* Mentor and provide guidance to junior engineers on the team
* Identify broken or sub-optimal processes and develop creative and efficient improvements
* Partner with other internal teams to understand their logging requirements and how Splunk can solve their use cases
* Stay up-to-date on Splunk releases and features; take training as needed
* Participate in compliance audits (SOX, CPNI, PCI)