Data Engineer
San Francisco, CA

Job Description

201 Third Street (61049), United States of America, San Francisco, California

At Capital One, we're building a leading information-based technology company. Still founder-led by Chairman and Chief Executive Officer Richard Fairbank, Capital One is on a mission to help our customers succeed by bringing ingenuity, simplicity, and humanity to banking. We measure our efforts by the success our customers enjoy and the advocacy they exhibit. We are succeeding because they are succeeding.

Guided by our shared values, we thrive in an environment where collaboration and openness are valued. We believe that innovation is powered by perspective and that teamwork and respect for each other lead to superior results. We elevate each other and obsess about doing the right thing. Our associates serve with humility and a deep respect for their responsibility in helping our customers achieve their goals and realize their dreams. Together, we are on a quest to change banking for good.

Data Engineer

Data Engineer

What you'll do:

* Develop new ways to analyze and deliver experimentation on our site
* Discover, ingest, and incorporate new sources of streaming, batch, and API-based data into our platform to enhance the insights we get from running tests and expand the ways and properties on which we can test
* Help the team improve with the usage of data engineering best practices
* Experiment with new tools to streamline the development, testing, deployment, and running of our pipelines
* Learn and share by attending conferences and meetups
* Collaborate with other data engineering teams to improve the data engineering ecosystem and talent within Capital One
* Creatively solve problems when facing constraints, whether it is the number of developers, quality or quantity of data, compute power, storage capacity or just time

Some things that gets us excited:

* Someone who has a good software engineering background and has some experience dealing with large datasets
* Someone who understands some constraints working with data
* Someone who has shown consistent growth in abilities and responsibilities
* Someone who has learned about or used tools and techniques to process large datasets efficiently and is keen to continue learning
* Someone who has been able to use various languages and platforms to get things done

Basic Qualifications:

* Bachelor's degree or military experience
* At least 2 years of Software Engineering experience

Preferred Qualifications:

* 3+ years of experience in Data Engineering
* 3+ years of experience in Python
* Experience with Spark
* Experience with AWS including Redshift, S3, EMR, and EC2
* Understanding of statistics

At this time, Capital One will not sponsor a new applicant for employment authorization for this position.