Manager, Data Engineering (Azure/Python/Spark)
Framingham, MA

Job Description

Description

The Data Engineering Manager should have strong data infrastructure and data architecture skills, a proven track record of leading and scaling data engineering teams, strong operational skills to drive efficiency and speed, strong project management leadership, and a strong vision for how analytics can proactively improve organizations. You will be part of the Enterprise Data & Analytics engineering technology team and will partner closely with a team of data scientists, business analysts & data engineers leading a cloud based Data & Analytics strategy.

You'll work on implementing Azure based data pipeline projects with a focus on collecting, parsing, managing, analyzing and visualizing large sets of data to turn information into insights using multiple technology platforms. Therefore, this role requires an understanding of how a secure data cloud environment is architected to gain real insights faster, with less friction and complexity. Ideal candidate should be a champion of building a distributed and scalable architecture that is metadata driven. You're also a detail oriented person that believes data quality should never be sacrificed.

You'll need to be an innovative forward-thinker who will help lead end-to-end execution of data engineering initiatives and contribute directly to existing and emerging business strategies and goals. Creativity, Attention to detail and ability to work in a collaborative team environment are essential.

The Data engineering Manager will work closely with the Senior Manager of Data Engineering to decide on needed infrastructure architecture and software design needs and act according to the decisions.

Responsibilities:

* Champion the use of technology & modern tools to optimize solutions and continuous process improvements
* Lead a team to design, build and test end to end data pipeline including data ingestion (streaming, events and batch), data integration, data curation (on MPP, Graph db)
* Help build out an Enterprise Data Marketplace
* Build and support the Big data platform on the cloud
* Define and implement automation of jobs and testing
* Optimize the data pipeline to support ML workloads and use cases
* Support mission critical applications and near real time data needs from the data platform
* Build and support reusable framework to ingest, integration and provision data
* Capture and publish metadata and new data to subscribed users
* Work collaboratively with product managers, data scientists as well as business partners and actively participate in design thinking session
* Motivate, coach, and serve as a role model and mentor for other development team associates/members that leverage the platform
* Establish relationship with key business lines, Infosec and infrastructure team

Qualifications

Required Skills:

* 8+ years' experience in data warehouse / data lake technical architecture
* Minimum 3 years of Big Data and Big Data tools in one or more of the following: Kafka, Spark or Python, Hadoop
* 2-3 years' experience with MPP database (Snowflake, Azure SQL Warehouse), NoSQL, Graph DB in the cloud (AWS, Azure)
* Strong familiarity with batch processing and workflow tools such as AirFlow, NiFi
* Understanding of streaming data architectures and technologies for real-time data processing
* Experience building distributed architecture and IoT in a Dev/Ops environment
* Strong interpersonal, verbal and written communication skills and ability to present complex technical/analytical concepts to executive audience
* Strong business mindset with customer obsession; ability to collaborate with business partners to identify needs and opportunities for improved data management and delivery
* BS/BA degree in Computer Science, Physics, Mathematics, Statistics or other Engineering disciplines
* Experience leading teams in both Agile and Waterfall methodologies
* Ability to lead multiple projects and teams
* Experience managing offshore and third-party team resources

Preferred Skills:

* Master's Degree
* Excellent planning, prioritization, problem solving skills.
* Experience with Predictive Analytics
* Experience with any of the following scripting languages, R, JSON, Parquet, JavaScript, Regex, PowerShell, shell scripting. Experience with Data Bricks, HDInsight, Python
* Experience with Hortonworks implementation
* Project/Program Management experience
* Cloud Experience
* Professional Knowledge/Experience
* Experience in Retail, E-Commerce business functions
* SAFe Agile experience

Staples is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, or any other basis protected by federal, state, or local law.

Staples