Job Directory Data Engineer

Data Engineer
Herndon, VA

Companies like
are looking for tech talent like you.

On Hired, employers apply to you with up-front salaries.
Sign up to start matching for free.


Job Description

Job Description


BI&A seeking a Software Engineer with data transformation (ETL) experience working with latest industry tools; elastic search, apache Kafka, and Apache NiFi.


* Work with a teammate on data integration requirements.
* Write code on ETL platform to transform data to a suitable formats as defined by IC ITE initiatives.
* Add features to ETL platform to shorten timelines for future data integration efforts.
* Develop, maintain code, and integrate software into a fully functional software system.
* Participate in daily scum meetings, sprint retrospectives, and other agile processes.
* Work with external teams to validate data ingest.
* Provide and maintain documentation of system architecture, development, and enhancements.


* Bachelor's Degree and 6 or more years' experience or Master's Degree with 3 or more years' experience from an accredited course of study, in engineering, computer science, mathematics, physics or chemistry.


* 6+ years of software development experience
* Linux/Unix experience
* Object Oriented programming language
* Possess strong verbal and written communication skills
* Possess strong analytical skills, with excellent problem solving abilities in the face of ambiguity


* Expertise in data ingestion, data transformation (ETL), and data modeling.
* Experience with Java, Ruby, or Python
* Experience in Agile/SCRUM enterprise-scale software development
* 3 years' experience working with one of the following batch-processing and tools (eg, Nifi, Midpoint, MapReduce, Yarn, Pig, Hive, HDFS, Oozie)
* 1 year working with Restful web services
* Experience with code development, deployment, versioning, and build tools (eg, Eclipse, git, svn, maven, Jenkins)

BI&A is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race,color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

Let your dream job find you.

Sign up to start matching with top companies. It’s fast and free.