Lead Data Engineer - Director
New York, NY

Job Description

Lead Data Engineer - Director

Job ID: 3191735 Full/Part-Time: Full-time Regular/Temporary: Regular Listed: 2019-06-11 Location: New York, United States of America

Global Transaction Banking

Global Transaction Banking (GTB) is a leading global provider of cash management, trade finance and securities services, delivering the full range of commercial banking products and services for both corporates and institutions worldwide.

Position Overview

Job Title: Lead Data Engineer

Corporate Title: Director

Location: New York, NY

About Deutsche Bank

We are Germany's leading bank with strong positions in Europe and significant presence in the Americas and Asia Pacific. We're driving growth through our strong client franchise, investing heavily in digital technologies, prioritizing long-term success over short-term gains, and serving society with ambition and integrity. We serve our clients' real economic needs in commercial and investment banking, retail banking and transaction banking, and provide ground-breaking products and services in asset and wealth management. That means a career packed with opportunities to grow and the chance to shape the future of our clients.

Global (Digital) Transaction Banking

We are on the lookout for enthusiastic Data Engineers to help unlock the power of data. The Global Transaction Banking organization is investing in an important step change in managing and leveraging data to accelerate the business. Data will play a significant role in building out future digital applications with the aim to utilize the latest analytics, machine learning and AI capabilities. You will have hands on technical experience in building and managing complex data pipelines, tools and applications, and will have a keen interest in staying ahead of the fast evolving data technology landscape. As Deutsche Bank looks to leverage its data assets, the role of the Data Engineer becomes ever more important, as you will play a key role in quickly understanding and delivering powerful data solutions within an agile product team.

What You'll Do

As the Lead Data Engineer for the Digital group within Deutsche Bank's Global Transaction Banking (GTB) division, you will lead, build and manage the data engineering capability, applications & tools that drive one of the world's largest provider of payment and financial solutions at a global scale. You will be leading the team and engaging with your coworkers to design and deliver data assets to power a brand new set of scalable data applications, leveraging the latest technology, innovation and development methodologies - helping Deutsche Bank leapfrog their existing data products while showcasing what 'great looks like' in a modern software development and engineering function. You will be required to be highly adaptable and can roll up your sleeves and act as a catalyst to drive data delivery, providing hands on expertise and support. Your experience likely comes from working in high performing agile analytics, technology or engineering teams.

In addition to the responsibilities outlined above, the GTB Lead Data Engineer will:

Responsibilities

* Build the data engineering function
* Hire, mentor and develop talent to perform at the best of their ability
* Work in collaboration with Data Architects, Scientists and Analysts to understand business and user needs
* Ensure data quality and develop data quality best practice and control gates
* Foster agile software development practices, including agile product releases, automated testing, continuous development and integration practices
* Define and build the metadata strategy
* Architect and rapidly build cost effective automated data pipelines fit for analytics and reporting products
* Research new concepts and applications for data and technology which will provide commercial value or efficiency benefits, such as increased compression ratios, faster processing, better metadata and lineage management
* Develop coding best practices and conventions, managing git projects and collaborative development frameworks
* Create automated data monitoring solutions, including quality, integrity and timeliness checks
* Build batch, micro batch and real time data processing
* Mentor and train data users across the organization
* Develop and deliver training plans that engage potential data users detailing benefits, practical applications and technical up skilling
* Design and develop automation workflows, build and perform automated tests and conduct reviews to make sure your work is rigorously designed, elegantly coded, and effectively tuned for platform performance, and assess the overall quality of delivered components
* Drive improvements to processes and design enhancements to automation to continuously improve the production environment
* Identify data issues and work with IT & Business partners to remediate using the problem management process
* Manage and develop the team
* Build, design, develop and manage end to end automated data pipelines
* Manage data analysis and documentation
* Define and build data quality frameworks and checks
* Performance monitoring and fine tuning on data processes

Technical Skills:

* Comprehensive knowledge and hands-on experience on Hadoop ecosystem components
* Good understanding of Distributed and Grid Computing
* Good understanding of software engineering and programming principles
* Experienced with continuous integration and continuous deployment frameworks and tools
* Can demonstrate expertise in data modeling and query performance tuning on SQL Server, MySQL, Redshift, Hive/Hadoop, Postgres or similar platforms
* Experience with building stream-processing systems, using solutions such as Kafka Streams, Storm or Spark-Streaming
* Good knowledge of Big Data querying tools, such as Hive, Impala, SparkSQL, Presto
* Good experience with Java, SQL, Python, Scala, Shell, Java, PHP and Spark
* Experience with integration of data from multiple data sources
* Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
* Knowledge of various ETL techniques and frameworks

Education:

* A graduate degree in a technical field is strongly preferred, such as Computer Science or Engineering

Location:

* You will be based in New York with potential travel to our hubs in London, Germany, Cary and Dublin

For candidates applying for positions in the US:

Deutsche Bank is an Equal Opportunity Employer - Veterans/Disabled and other protected categories. Click these links to view the "EEO is the Law" poster and pay transparency statement.