Arity - Senior Software Engineer - Data and Streaming Systems Allstate
Chicago, IL

Job Description

Founded by The Allstate Corporation in 2016, Arity is a data and analytics company focused on improving transportation. We collect and analyze enormous amounts of data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer and more useful for everyone.

At the heart of that mission are the people that work here-the dreamers, doers and difference-makers that call this place home. As part of that team, your work will showcase both your intelligence and your creativity as you tackle real problems and put your talents towards transforming transportation.

That's because at Arity, we believe work and life shouldn't be at odds with one another. After all, we know that your unique qualities give you a unique perspective. We don't just want you to see yourself here. We want you to be yourself here.

The Role

Arity is a new technology company that uses advanced predictive analytics to help partners evaluate risk and make sense of everyday experiences. Our proprietary algorithms analyze billions of data points, distilling the flood of information into simple, actionable insights. Chief among these is the Arity Driving Score, which models billions of miles of driving and claims data to assess risk, gauging each driver's likelihood of an event. Founded by The Allstate Corporation, an organization synonymous with protection and preparation, Arity is born from a long-standing commitment to deep customer understanding and future-focused innovation. Fueled by the curiosity of a startup, our expertise begins with connected car, providing applied insights that meet insurer and transportation/mobility company needs and enhance driver safety, connectivity and value. Don't miss this opportunity to join a team where your innovative thinking and technology skills can improve the safety of those on the road and further enhance the car-ownership experience.

Our engineers are fueled by a passion to impact the future of mobility. They push the boundaries of telematics and transportation tech by creating and supporting cutting-edge products. As part of an Agile team, they are armed with the freedom to innovate and the opportunity to see projects through from start to finish. Using a variety of languages and a top-notch technology stack, our engineers make critical advances in areas like sensor technology, enterprise engineering and platform development. Our team understands what it means to collaborate and communicate in an interconnected global team, all while having trust, transparency and empathy for the end user. Which is pretty cool, if you ask us.

As a Senior Software Engineer, you will be responsible for assisting with the design, architecture, implementation, performance tuning, monitoring and on-going support of Arity's streaming and ETL platforms running within AWS.

We're looking for teammates who bring in:

* Experience building highly relieable, secure and optimized streaming applications
* Experience building data pipelines and capabilities to process data to and from disparate sources
* An understanding of large-scale data processing and data streaming tools

Key Responsibilities

* Lead the effort in design and development of Arity's streaming data platforms, doing heavy lifting in the infrastructure and designing data pipelines using distributed streams as a primary building block
* Compose the building blocks of streaming architecture (partitions, producers, consumers, retries, guaranteed delivery) to fit Arity's changing business needs by continuously improving speed, security and reliability
* Provide hands-on leadership for data security, support, monitoring, and alerting of the distributed streaming stacks
* Collaborate with Product Managers, Data Architects, Project Managers, Designers and other Engineers to develop full stack solutions for streaming data
* Work in Agile/Scrum environment, design, estimate, test, and develop user stories

Technical Experience and Skills

* Expertise in distributed systems architecture, stream-oriented architecture and implementations (Kafka, Flink, NiFi, Kinesis, Spark, Storm, Informatica or any other similar streaming library experience)
* 3 years' of hands-on experience as a data, back-end, infrastructure, performance, or API developement
* 2 years' experience building large-scale, distributed, high-volume systems with reasonably high throughput of data
* Ability to build and optimize real-time streaming and end to end data processing systems
* Understanding of Linux, Cloud (AWS), ETL, Message Queuing Systems and Software Development Processes
* Understanding of data transformation specifications and data formats like JSON, Avro, XML, CSV, UTF-8, Base-64 encoded and standard HTTP response/ error codes

Qualifications

* Minimum Bachelor's Degree from an accredited institution in Computer Science or a related discipline, or equivalent experience/combined education, with some relevant professional experience
* Experience with Java, Scala, or equivalent programming language, and knowledge on scripting languages like Python, Shell Scripting or equivalent scripting languages
* Passion for software development and ability to write source code, reuse existing components, and evaluate and integrated open source software into solutions
* Proven ability to lead multiple high priorities initiative with aggressive timelines leveraging an agile/scrum framework
* Comfortable performing in a fast paced, dynamic and ambiguous business environment
* Excellent listening and communication skills and strong problem solving skills with the ability to design and implement technical solutions
* Ability to lead a group of employees (directly or indirectly) and work in a team environment in a collaborative manner