Big Data Engineer
Armonk, NY

Job Description

Job Description

Do you have a passion for learning and applying modern software engineering practices to help solve business problems or bring new insight? If so, we are looking for energetic team members to join our agile squad in 1 North Castle Drive, Armonk, NY

Job Duties:

We are looking for someone to develop a modern, cloud based solution for a strategic initiative that enables IBM to more effectively and efficiently make business decisions based using your solution. Your team's responsibility will be to create the working foundation of infrastructure and architecture design of the large scale, big data solution. This will include the development of the prototype through to a full operational system that many different teams (including yours) perform development within.

The key experiences required include Apache SPARK, Apache Kafka, Python, and Parquet formats. Also, significant experience using ETL (extract, transform, and load tools) not mentioned are needed. Experience with Scala is also a nice to have.

You will also be responsible for selecting and using the DevOps tools for continuous integration, builds, and monitoring of the solutions. You will join and exciting team, in an open landscaped, collaborative environment using agile delivery methods. Any experience in converting legacy ETL into the newer technologies is highly valued as well.

Above all, we are looking for applicants who will thrive in an open, energetic, flexible, fun-spirited, collaborative environment and desire creative freedom and an opportunity to work on high performing teams!

No remote opportunities exist

Will consider relocation for candidates with the right skills/experience

Must have the ability to work in the US without current/future need for IBM sponsorship

Experience in Jasmine/Karma or a similar unit/functional testing framework.

Experience in Test Driven Development (TDD)

Experience in Automated Testing

Experience with Data Science / Data Analyst and their associated tools.

CIODEM19

Required Technical and Professional Expertise

* 1 year professional experience using Apache Spark and Kafka
* 2 years professional experience using Python
* 1 year professional experience using Parquet formats
* 2 years professional experience using ETL (extract, transform, and load) tools.
* 1 plus year of Cloud base architecture (for example: IBM Cloud or AWS development)
* Demonstrated experience to work as part of an Agile team as a strong team player

Preferred Tech and Prof Experience

* 2 plus years in Full-stack development experience (Apache Spark, Python), with a stronger need for backend experience.
* 2 plus years of advanced practice of Agile development methodologies.
* 2 plus years of experience in DevOps (for example: Jenkins, Travis CI, UrbanCode Deploy, Nagios)

EO Statement

IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

Preferred Education: Master's Degree Commissionable: No

Key Job Details

* Country:US
* State:NEW YORK
* City:ARMONK
* Category:Software Development & Support
* Required Education:Bachelor's Degree
* Position Type:Professional
* Employment Type:Full-Time
* Contract Type:Regular
* Req ID:226294BR
* Location:ARMONK, NY US