Experienced Back End Data Engineer
New York, NY

Job Description

Job Description:

What makes Gartner Research & Advisory a GREAT fit for you? When you join Gartner, you'll be part of a leading-edge team that values expert insights, bold ideas and intellectual courage. You'll deliver must-have research through compelling client interactions, and contribute to our double-digit growth by providing clients the unbiased insight and advice they need to make the right decisions every day. Through constant learning, discovery and collaboration, you'll help clients deliver on their mission-critical priorities, grow your career and increase your industry impact. We value hard workers - and reward you with unlimited opportunity. If you're looking to explore what's next in technology and business, Gartner is looking for you.

We are looking for a Back End oriented or Full Stack Engineer with a passion for complex data and building high quality software. In this role, you will work on essential tools to automate and manage data pipelines that powers Gartner for Marketers analytics and machine learning teams. As a member of our team you will enter a startup like fast-paced, challenging environment with the potential to make a large impact on our architecture and the organization. You will work on a wide variety of applications and data pipelines, and it is a great opportunity to grow.

Here is a sample of projects you would be contributing to:

* A scalable internal platform that powers scraping of half a million pages a day.


* Processing pipelines that ingest and process data from our data partners.


* Integrating machine learning models into data pipelines.


* A workflow application that automates data collection by humans.



What we'd like to see in you:

* 2 to 4 years of professional experience using Python to develop production-ready software.


* Strong SQL knowledge and experience designing data models to solve a problem.


* Experience with AWS in production settings.


* Familiarity with JavaScript frameworks/libraries, such as React/Redux.


* Passion for learning and self-improvement, being receptive to feedback.


* Comfortable with complexity and drive to make things simpler.


* Ability to quickly learn a new vendor API, new tool or a technology concept.


* Experience with modern web and application development practices: continuous integration, scrum or agile development, distributed version control systems, test-driven development, automated deployment and provisioning.


* Ability to support product team on planning, scope breakdown, task estimation.


* Strong communication skills, ability to self-motivate and self-direct.


* Hands on with an active Github, Bitbucket or StackOverflow profile.



About us:

We believe in tackling difficult questions/problems as a team in order to get to the best solution and we don't hesitate to change our approach when a better idea is on the table.

We are a cross-functional team of engineers (front-end, back-end, QA, and data), product managers, and data scientists. We practice code reviews, unit and integration testing, continuous integration and delivery, agile 2 week sprints, and take pride in seeing our work through from conception to deployment and to the next better iteration.

Our Stack:

* Our primary languages are Python and modern JavaScript (React, ES6, Redux, Babel/Webpack, SASS, Express, Node).


* Primary data stores include S3, Postgres, Redshift, Athena, Snowflake, SQL is our lingua franca.


* AWS (EC2, Lambda, EKS, Kinesis, Fargate, Cloudwatch, DynamoDB, etc).


* Docker and Kubernetes deployments triggered by GitLab CI.


* Airflow for workflow management.


* dbt and more for ETL and data pipelines.



Job Requisition ID:35068

By submitting your information and application, you confirm that you have read and agree to the country or regional recruitment notice linked below applicable to your place of residence.

Gartner Applicant Privacy Link: https://jobs.gartner.com/applicant-privacy-policy

For efficient navigation through the application, please only use the back button within the application, not the back arrow within your browser.