Job Directory Staff Systems Hadoop Administrator-Engineer

Staff Systems Hadoop Administrator-Engineer
Austin, TX

Companies like
are looking for tech talent like you.

On Hired, employers apply to you with up-front salaries.
Sign up to start matching for free.

About

Job Description

Common Purpose, Uncommon Opportunity. Everyone at Visa works with one goal in mind - making sure that Visa is the best way to pay and be paid, for everyone everywhere. This is our global vision and the common purpose that unites the entire Visa team. As a global payments technology company, tech is at the heart of what we do: Our VisaNet network processes over 13,000 transactions per second for people and businesses around the world, enabling them to use digital currency instead of cash and checks. We are also global advocates for financial inclusion, working with partners around the world to help those who lack access to financial services join the global economy. Visa's sponsorships, including the Olympics and FIFA™ World Cup, celebrate teamwork, diversity, and excellence throughout the world. If you have a passion to make a difference in the lives of people around the world, Visa offers an uncommon opportunity to build a strong, thriving career. Visa is fueled by our team of talented employees who continuously raise the bar on delivering the convenience and security of digital currency to people all over the world. Join our team and find out how Visa is everywhere you want to be.

We are looking for a smart, capable Hadoop Systems Engineer who will perform Hadoop administration on production Hadoop clusters, perform tuning and increase operational efficiency on a continuous basis. You will be responsible for monitoring the health of the platforms and generating performance reports. You will work closely with development, engineering and operation teams who jointly work on key deliverables ensuring production scalability and stability. As an experienced administrator and/or engineer, you'll develop and enhance platform best practices to ensure the Hadoop platform can effectively meet performance & SLA requirements. You will be further responsible for support of the Hadoop production environment which includes Hive, YARN, Spark, Impala, Kafka, SOLR, Oozie, Sentry, Encryption, Hbase, etc. Performing optimization capacity planning of a large multi-tenant cluster will also fall within scope of this role.

* Minimum of 6 years of work experience in maintaining, optimization, issue resolution of Hadoop clusters, supporting Business users and Batch
* Experience in configuring and setting up Hadoop clusters, and providing support for aggregation, lookup & fact table creation criteria
* Map Reduce tuning, data node, NN recovery, etc.
* Experience in Linux / Unix OS Services, Administration, Shell, awk scripting
* Experience in building and scalable Hadoop applications
* Experience with Core Java and Hadoop (Map Reduce, Hive, Pig, HDFS, H-catalog, Zookeeper and OOzie)
* Hands-on Experience in SQL (Oracle) and NoSQL Databases (HBASE/Cassandra/Mongo DB)
* Excellent oral and written communication and presentation skills, analytical and problem solving skills
* Self-driven with the ability to work independently and as part of a team with proven track record developing and launching products at scale
* Minimum of four year technical degree required
* Experience on Cloudera distribution preferred
* Hands-on Experience as a Linux Sys Admin is advantageous
* Knowledge on Spark and Kafka is also advantageous

All your information will be kept confidential according to EEO guidelines.All your information will be kept confidential according to EEO guidelines.

Let your dream job find you.

Sign up to start matching with top companies. It’s fast and free.