Senior Big Data Developer
Manassas, VA

Job Description

SWIFT provides the platform, messaging, standards, and products & services to over 11,000 customers in 200+ countries and territories. Our employees are the foundation of this success.

SWIFT has an unique corporate mindset, where diversity, personal development and networking are actively encouraged. And we think you'll like our office culture, built around the way we work to achieve a healthier work/life balance.

If you want to be part of our dynamic, multi-cultural institution with over 2800 employees of 75 nationalities, in 26 offices worldwide, then explore the vast opportunities, rewards and internationally competitive packages that are waiting for you here at SWIFT.

.

The Data Analytics team delivers components of an Operations And Support Intelligence System ("OASIS"), providing insight into customer and operational data, using a variety of big data and search technologies. The pipeline is evolving into a critical component of the Operations and Support tooling arsenal.

Responsibilities

You will play a prominent role in a DevOps team providing a pipeline of log data from financial messaging applications and infrastructure systems to Operations and Support personnel.

The pipeline presently comprises syslog-ng, Apache Flume, Cloudera Hadoop, Elastic stack, Kafka.

Over the next 12 months, the resiliency of this infrastructure will be increased through deployment of additional clusters, the infrastructure will start to be used to monitor applications running on OpenShift Container Platform via an additional Elastic stack deployment, Spark/Scala jobs for metrics processing and machine learning will be evolved and additional analytics capabilities may start to be developed.

Qualifications

* Bachelor's degree in IT/Engineering or equivalent
* 5+ years of total work experience, including experience with at least four of the following:
* Java development
* Scala development
* Apache Spark
* Apache Kafka
* Apache Hive
* Cloudera Hadoop
* Elastic stack
* Delivery within a CI/CD pipeline
* Familiarity with MicroServices architecture
* understanding of big data architectures