Software Engineer, Streaming (Data Ingest)
San Francisco, CA

Job Description

At Lyft, community is what we are and it's what we do. It's what makes us different. To create the best ride for all, we start in our own community by creating an open, inclusive, and diverse administration where all team members are recognized for what they bring.

If you are passionate about building large-scale data processing systems and are motivated to improve creating a scalable data platform - we would love to talk to you. Data is essential to how we make decisions; it's the core of our business helping us create an outstanding transportation experience for our customers and providing insights into the effectiveness of our product.

More specifically, Lyft is one of a small number of companies whose essential business actually moves in real-time. Our Streaming team is responsible for building and supporting the myriad real-time demands of the business. We work with Product to improve our driver and passenger experiences through real-time features. ETA, pricing, dispatch, and more - this work is at the heart of Lyft's business and is a huge focal point for the company in 2019 and 2020. If you're interested in being at the center of Lyft's efforts to achieve delightful experiences to our passengers and drivers, this might be the role for you.

Responsibilities:

* Design and lead the way real-time data is collected and stored with the entirety of Lyft.
* Build and operate large-scale distributed systems (Kafka, Flink, Zookeeper, etc).
* Provide technical leadership and mentorship to a team of 4 to 5 engineers.
* Write well-crafted, well-tested, readable, maintainable code.
* Participate in code reviews to ensure code quality and distribute knowledge, including Open-Source projects.
* Share your knowledge by giving brown bags, tech talks, and promoting appropriate tech and engineering best practices.

Experience and Skills:

* 8+ years of agile software development experience. 5+ years of experience working with distributed systems..
* Experience building highly-available, low-latency and high-throughput real-time data ingestion systems.
* Experience with Protocol Buffers or other similar technology for data serialization.
* Exposure to message brokers like Kinesis, Kafka, or similar.
* Schema management experience for data pipelines and pub/sub systems would be strong plus.
* Proficiency with Python or GoLang.
* Understand distributed systems concepts and principles (consistency and availability, liveness and safety, durability, reliability, fault-tolerance, agreement algorithms, etc).
* BA/BS in Computer Science, Math, Physics, or another technical field, or equivalent.

Benefits:

* Great medical , dental, and vision insurance options.
* In addition to 11 observed holidays , salaried team members have unlimited paid time off, hourly team members have 15 days paid time off.
* 401(k) plan to help save for your future
* 18 weeks of paid parental leave. Biological, adoptive, and foster parents are all eligible
* Monthly commuter subsidy to cover your transit to work & 20% of all Lyft rides

Lyft is an Equal Employment Opportunity employer that proudly pursues and hires a diverse workforce. Lyft does not make hiring or employment decisions on the basis of race, color, religion or religious belief, ethnic or national origin, nationality, sex, gender, gender identity, sexual orientation, disability, age, military or veteran status, or any other basis protected by applicable local, state, or federal laws or prohibited by Company policy. Lyft also strives for a healthy and safe workplace and strictly prohibits harassment of any kind. Pursuant to the San Francisco Fair Chance Ordinance and other similar state laws and local ordinances, and its internal policy, Lyft will also consider for employment qualified applicants with arrest and conviction records.