The Data Engineer works within our Strategy and Analytics team and will be responsible for working with a portfolio of internal clients to define and implement our Data Architecture and Management processes and systems. The goal is to govern, access and distribute key information to business users and, applications to support our company strategic objectives. This position is a highly technical focusing on Big Data technologies like streaming data ingestion, storage, data processing and advanced analytics across cloud and on-prem environments. The ideal candidate will be a data specialist responsible for driving innovation and process improvements through the use of traditional and Big Data technologies with focused on key companywide strategic implementations. This function includes the development and maintenance of enterprise data architecture, within the context of all enterprise architecture, and its connection with the application system solutions and projects that implement enterprise architecture. The position will work closely with IT leaders, data delivery team, business managers and subject matter experts, and technology partners to plan, prototype, and build innovative data management and analytical solutions.
ESSENTIAL DUTIES & RESPONSIBILTIES
Estimated % of Time Spent
Data Architecture Management: Drive the design, development and implementation of our Big Data initiatives.
+ Defining the data needs of the enterprise, and designing the master blueprints to meet those needs.
+ Develop processes for data collection (pub/sub) and connection, modeling and mining of large-scale applications (systems of engagement, automation and transactions).
+ Conduct research on new technologies to evolve our data integration hub to support our digital transformation in engaging with our customers and team members.
+ Knowledge of how to assess the performance of data solutions, how to diagnose data problems, and tools used to monitor and tune performance.
+ Meet with business teams frequently to transform requirement into data model designs
+ Work very closely with the data delivery and data application management teams to implement processes to centralize and govern the company's data and analytics business rules to enforce the highest level of truth (Data Governance for Big Data).
+ Develop and define data retention policies, and take ownership of various big data solutions and provide production support
+ Collaborate with application architects, developers, system and business analysts for application changes or new applications that would translate into new data models or changes to existing models.
+ Research and introduce new data management technologies and software engineering tools
+ Recommend and implement ways to improve data reliability, efficiency and quality
+ Proactively understand and anticipate the company's information needs and identify new opportunities to improve our information consumption.
Data sourcing, modeling and cataloging.
+ Planning, implementation, and control activities to ensure consistency with a "golden version" of contextual data values.
+ Planning, implementation, and control processes to provide decision support data and support for knowledge workers engaged in reporting, query and analysis.
+ Planning, implementation, and control activities to enable easy access to high quality, integrated meta-data.
+ Design changes, provide solutions, and manage additions to the Enterprise Data Warehouse and Data Marts working in conjunction to our data delivery team.
+ Identify data requirements by meeting with other Information Technology and business teams; analyze department applications, programming, and operations; evaluate existing systems and design proposed solutions.
Collaboration and Organizational Relationships
+ Work closely with the Data Delivery team, Data Scientists, Reporting Governance Manager and Consumer Insights Manager to understand tasks and priorities.
+ Regularly work with Database Administrators, Application developers and architects to ensure new implementations meet design standards
+ Work with team members and manager to estimate efforts and plan activities.
Governance, Documentation and Standards
* Assist the Director of Data Architecture and Governance define and implement the Data Governance procedures * Align the data business requirement documentation across the organization * Document data architecture solutions, mappings and processes to share amongst team members. * Leverage personal technical experience in software development lifecycle to manage task assignment and appropriation of work effort. * Commit to project quality and on-time delivery.
This role partners with Accounting, Marketing, Finance, Real Estate Strategy, Pricing & Products, IT, among other business departments and internal Data & Analytics teams, and reports to the Director of Data Architecture and Governance
Knowledge, Skills & Abilities
+ High level understanding of Big Data platforms and applications
+ Knowledge of cloud and hybrid solutions (Azure and Amazon)
+ Development experience with Data Lake technologies for stream ingestion, storage and processing, such as Kafka, Flume, Spark Streaming, Apache Storm, AWS S3, Azure, Hadoop, Spark, Hbase, MongoDB, Hive, Snowflake or Cassandra
+ Experience with Data Integration applications like Informatica Power Center, Informatica BDM products, IBM InfoSphere, etc.
+ Expert knowledge of SQL and ability to implement advanced queries to extract information from very large datasets
+ Experience implementing software and/or solutions in the enterprise Linux or Unix environment
+ Strong understanding of various security requirements around integration such as exchanging certificates, using tokens/keys or simply password based.
+ Strong understanding of network configuration, devices, protocols, speeds and optimizations.
+ Strong understanding on mapping and identifying the appropriate level of trust for different data elements aligned to analytics and data governance initiatives.
+ Knowledge and experience in implementing BI DW and integration
+ Familiarity with scripting tools such as bash shell scripts, Python
+ Proven characteristics of intellectual curiosity, leadership, responsibility, determination, creativity, flexibility, drive and self-confidence.
+ Excellent written, oral communication, project management and presentation skills. Ability to present complex data reports, financial analyses, and statistics in a simple and clear way.
+ Demonstrated ability in managing details and delivering on timelines.
+ Strong problem-solving skills.
Minimum Educational Level/Certifications
+ 4 year Bachelor's degree in Engineering, Business Analytics, Computer Sciences, Mathematics, Statistics, or related field.
Minimum Work Experience and Qualifications
+ 3+ years of experience in Big Data technologies
+ 5+ years of professional achievement and management of an analytical and research function with emphasis on consumer research, online and emerging media platforms, and the supporting / enabling technology.
+ 5+ years of experience extracting data in SQL, HQL or SAS
+ 1+ years of experience with streaming technologies for Data Lake (Kafka, Storm, Spark Streaming, S3, Hadoop, HBase, Cassandra, MongoDB, Spark, Hive)
FUNCTIONAL GROUP Corporate Operations
Let your dream job find you.
Sign up to start matching with top companies. It’s fast and free.