Data Engineer
Herndon, VA

Job Description

Job Description

THIS POSITION REQUIRES AN ACTIVE TS/SCI with POLY

BI&A seeking a Software Engineer with data transformation (ETL) experience working with latest industry tools; elastic search, apache Kafka, and Apache NiFi.

DUTIES ENTAIL:

* Work with a teammate on data integration requirements.
* Write code on ETL platform to transform data to a suitable formats as defined by IC ITE initiatives.
* Add features to ETL platform to shorten timelines for future data integration efforts.
* Develop, maintain code, and integrate software into a fully functional software system.
* Participate in daily scum meetings, sprint retrospectives, and other agile processes.
* Work with external teams to validate data ingest.
* Provide and maintain documentation of system architecture, development, and enhancements.

EDUCATION:

* Bachelor's Degree and 6 or more years' experience or Master's Degree with 3 or more years' experience from an accredited course of study, in engineering, computer science, mathematics, physics or chemistry.

REQUIRED EXPERIENCE:

* 6+ years of software development experience
* Linux/Unix experience
* Object Oriented programming language
* Possess strong verbal and written communication skills
* Possess strong analytical skills, with excellent problem solving abilities in the face of ambiguity

DESIRED EXPERIENCE:

* Expertise in data ingestion, data transformation (ETL), and data modeling.
* Experience with Java, Ruby, or Python
* Experience in Agile/SCRUM enterprise-scale software development
* 3 years' experience working with one of the following batch-processing and tools (eg, Nifi, Midpoint, MapReduce, Yarn, Pig, Hive, HDFS, Oozie)
* 1 year working with Restful web services
* Experience with code development, deployment, versioning, and build tools (eg, Eclipse, git, svn, maven, Jenkins)

BI&A is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race,color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.