Job Directory JPC 4418 - DevOps Engineer with Kerberos

JPC 4418 - DevOps Engineer with Kerberos
San Francisco, CA

Companies like
are looking for tech talent like you.

On Hired, employers apply to you with up-front salaries.
Sign up to start matching for free.


Job Description

Job Description

* Share
* Share
* Email
* Facebook
* Twitter
* Linkedin

* Print

Big Data Engineer (SCALA)

San francisco, California - United States | Posted - 07/09/19

Apply Easy Apply


PROLIM Global Corporation ( is currently seeking Big Data Engineer for Location San Francisco, CA for one of our top Client.

Job Description:

* Build scalable data pipelines on top of Hive and Spark using the Airflow scheduler/executor framework
* Collaborate with Payments Engineering, Data Science, FP&A, Accounting, and Product Management to produce accurate and timely financial data
* Apply Machine Learning models to forecast and visualize key revenue metrics and trends
* Anomaly detection and analysis for payments integrations, processing, and processor reconciliation
* Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
* Craft data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
* Work with data and analytics experts to strive for greater functionality in our data systems.

Skills and experience:

* Proficient understanding of distributed computing principles
* Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
* ETL or Pipeline design/implementation with Large Distributed Databases (Hive/Spark/Scala preferred)
* Experience in data validation, sampling & regression tests
* Pipeline stability and performance tuning
* Working knowledge of relational databases and query authoring (SQL)
* Experience with Scala is Must
* Love to use and develop open source technologies like Kafka, Hadoop, Hive, Presto, and Spark
* Rigor in high code quality, automated testing, and other engineering standard methodologies
* Payment data processing or system design knowledge is a plus (not required)
* Experience with NoSQL databases, such as HBase or Cassandra is a plus (not required)
* Outstanding interpersonal skills
* BS/MS/PhD in Computer Science or a related field (ideal)

Apply online for immediate consideration, please send your updated resume and contact info via email

About PROLIM Corporation

PROLIM is a leading provider of end-to-end IT, PLM and Engineering Services and Solutions for Global 1000 companies. They understand business as much as technology, and help their customers improve their profitability and efficiency by providing high value technology consulting, staffing, and project management outsourcing services.

Their IT and PLM consulting offerings include; Advisory, PLM Software/Services, Program Management, Solution Architecture Training/Staffing, Cloud Solutions, Servers/Networking, Infrastructure, ERP Practices and QA Services. Engineering services include Data Translation, CAD/CAM/CAE, Process & Product Engineering, Prototyping, and Testing/Validation within a wide range of markets and industries.

Let your dream job find you.

Sign up to start matching with top companies. It’s fast and free.