Software Engineer - ETL Lead Developer Jpmorgan Chase & Co.
New York, NY

Job Description

Software Engineer - ETL Lead Developer

Req #: 190056808

Location: New York, NY, US

Job Category: Technology

Job Description:

As a senior leader in Software Engineering, you will combine your years of proven expertise with a never-ending quest to create innovative technology. You'll lead a highly inspired and inquisitive team of technologists who are already developing and deploying applications to the highest standards. With your deep knowledge of design, analytics, development, coding, testing and application programming, your team will raise their game even more, meeting your standards, as well as satisfying both business and functional requirements. Your experience in one or more technology domains will help solve complex and mission critical problems, internally and externally. As a constant learner and early adopter, you're already embracing leading-edge technologies and methodologies; your example encourages others to follow suit. In addition to creating solutions with your in-house team, you'll also work alongside our team of technologists from around the world who are just as dedicated as you are.

This role requires a wide variety of strengths and capabilities, including

* Develop complex Talend jobs to implement the business logic for extraction data from Teradata, Oracle, Salesforce for CRM optimization implementation project.
* Develop process frameworks and support data migration on Hadoop systems using Talend


* Create proof of concept application to demonstrate feasibility of recommended architecture.


* Develop and modify BTEQ Scripts in UNIX and TERADATA.


* Design and write a layer on top of MapReduce to make the task of writing MapReduce jobs easier and much better for Junior Engineers.


* Develop Shell scripts for Teradata offloading and injecting into HDFS.


* Create Tables, Views, Indexes, and SQL Scripts to load the data into the tables in the development environment.


* Responsible for Scheduling and orchestrating the ETL process using Oozie/Autosys.


* Identify the bottlenecks and implement appropriate solutions like parallelization, optimize the Pig scripts, Diagnostics operators (Illustrate, Explain,..), modularize functionalities to achieve the Performance SLA's.


* Integrate with dependent modules and external entities or systems


* Interact with user and Understand business requirements


* Evaluate and reverse engineer the end-to- end data flow of legacy system and document the same


* Provide the solution to the ad-hoc requests from business users and resolve the performance issues


* Report technical progress of projects to stakeholders. Identify and manage technical risks and issues, and prepare escalation matrix in a clear and timely manner.


* Provide technical leadership for projects spanning multiple business units, throughout the project lifecycle. Drive aspects of projects including technical design, integrations, and guiding and mentoring internal teams on architectural/integration decisions.


* Draft and implement framework, mapping and ETL business process for Revenue data warehouse and principles and best practices


* Involve in technical evaluation when recruiting software engineers.


* Report technical progress of projects to stakeholders. Identify and manage technical risks and issues, and prepare escalation matrix in a clear and timely manner.


* Participate in various phased of deployment - QA, DEV & SIT phase


* Participate in QA Testing, system Integration Testing and provide support


* Provide primary and secondary level production support


* Handle deployment and post deployment activities


* Extensive Documentation of the system application


*