Software Developer (Hadoop) - Expert
Herndon, VA

Job Description

Job Description

Required Skills

* Demonstrated experience with the Hadoop ecosystem (Hive, Pig, MapReduce, Spark etc.)
* Demonstrated experience with ETL, and experience with ETL tools (NiFi, Pentaho, Twister)
* Development experience in one or more of the following languages: Java, Python and Scala
* Demonstrated experience with SQL and no-SQL databases (Hbase, Accumulo, MySQL)
* Experience with AWS offerings such as EC2, ELB, ASG, RDS, DynamoDB, EMR
* Experience with DevOps/CI tools such as Git Hub, Puppet, CloudFormation and Jenkins

Desired Skills

* Understanding of Cloudera
* Experience with both the operation of and interfacing with search engines such as Solr/Elasticsearch
* Experience with Spring-Boot, Gradle

Researches, designs, develops and/or modifies enterprise-wide systems and/or applications software. Work with a team performing entity correlation for mission critical systems. Identify methods for more precise entity resolution and determine the value of the introduction of new data sets. Support the migration from a physical to cloud based computing environment. Evaluate the benefits of new entity resolution technologies. Support special projects and new requirements as needed.

1. Designs, develops, codes, tests and debugs highly complex new software products or makes significant enhancements to existing software.

2. Develops and applies advanced methods, theories, and research techniques in the investigation and solution of complex and advanced software applications and problems.

3. Resolves highly complex hardware/software compatibility and interface design considerations.

4. Conducts investigations and tests of considerable complexity.

5. Factors emerging technologies and product supportability into design and implementation.

6. Provides input to staff involved in writing and updating technical documentation such as user manuals, system documentation, and training materials.

7. Advises hardware engineers on machine characteristics that affect software systems, such as storage capacity, processing speed, and input/output requirements.

8. Prepares reports on analyses, findings, and project progress, and presents results to management and/or customer personnel.

9. Serves as a customer interface to resolve problems and ensure requirements are met on a timely basis.

10. Provides guidance and work leadership to less-experienced software developers, and may have supervisory responsibilities.

11. Serves as a technical team or task leader.

12. Maintains current knowledge of relevant technology as assigned.

13. Participates in special projects as required.

Education

1. Bachelors Degree in Computer Science, Engineering or a related technical discipline, or the equivalent combination of education, technical training, or work/military experience.

2. Masters Degree preferred.

Qualifications

10-15 years of related software development experience.

Required Skills

* Demonstrated experience with the Hadoop ecosystem (Hive, Pig, MapReduce, Spark etc.)
* Demonstrated experience with ETL, and experience with ETL tools (NiFi, Pentaho, Twister)
* Development experience in one or more of the following languages: Java, Python and Scala
* Demonstrated experience with SQL and no-SQL databases (Hbase, Accumulo, MySQL)
* Experience with AWS offerings such as EC2, ELB, ASG, RDS, DynamoDB, EMR
* Experience with DevOps/CI tools such as Git Hub, Puppet, CloudFormation and Jenkins

Desired Skills

* Understanding of Cloudera
* Experience with both the operation of and interfacing with search engines such as Solr/Elasticsearch
* Experience with Spring-Boot, Gradle

As a trusted systems integrator for more than 50 years, General Dynamics Information Technology provides information technology (IT), systems engineering, professional services and simulation and training to customers in the defense, federal civilian government, health, homeland security, intelligence, state and local government and commercial sectors. With approximately 32,000 professionals worldwide, the company delivers IT enterprise solutions, manages large-scale, mission-critical IT programs and provides mission support services. GDIT is an Equal Opportunity/Affirmative Action Employer - Minorities/Females/Protected Veterans/Individuals with Disabilities.

#DPOST

#CJPOST

#SWDevIC

#ISDCJ

#ERP