Staff Software Engineer, Big Data Intuit
San Francisco, CA

Job Description

Responsibilities

* Design and develop big data and real-time analytics solutions using industry standard technologies.
* Develop web services that make big data available in real-time for in-product applications.
* Work with data architects to ensure that Big Data solutions are aligned with company-wide technology directions.
* Lead fast moving development teams using agile methodologies.
* Lead by example, demonstrating best practices for unit testing, CI/CD, performance testing, capacity planning, documentation, monitoring, alerting, and incident response.
* Communicate progress across organizations and levels from individual contributor to senior executive. Identify and clarify the critical few issues that need action and drive appropriate decisions and actions. Communicate results clearly and in actionable form.
* Serve as technical "go to" person for our core technologies - Hadoop, Spark, AWS, Hive, and other big data technologies.
* Demonstrate strong implementation aptitude to translate objectives into a scalable solution to meet the needs of the end customer while meeting deadlines.
* Demonstrate commitment to your professional development by attending conferences, taking classes, giving technical presentations, and participating in developer communities inside and outside of Intuit

Qualifications

* BS in Computer Science.
* Strong CS fundamentals including data structures, algorithms and distributed systems.
* Strong database fundamentals including SQL, performance and schema design.
* Strong programming skills in Java, C++, Python, Ruby or similar.
* 8+ years of hands-on software engineering experience.
* 8+ years of experience integrating technical processes and business outcomes - specifically: data and process analysis, data quality metrics/monitoring, data architecture, developing policies/standards & supporting processes.
* Strong project leadership experience, including 5 or more years leading multiple complex software development projects using agile methodologies.
* Experience with Hadoop, Hive, HBase, Spark, Kafka, NoSQL Databases
* Experience with various offerings from AWS, including S3, EMR, Redshift, Data Pipeline, Athena and Kinesis.
* History of contributing to open source projects is a plus.
* 1+ years DevOps experience including configuration, optimization, backup, high reliability, monitoring and systems version control.
* Track record working with data from multiple sources - willingness to dig-in and understand the data and to leverage creative thinking and problem-solving.
* Excellent interpersonal and communication skills, including business writing and presentations. Ability to communicate objectives, plans, status and results clearly, focusing on critical few key points. Demonstrated ability to work in a matrix environment, ability to influence at all levels, and build strong relationships.
* Knowledge of enacting service level agreements and the appropriate escalation and communication plans to maintain them