JPC 4362 - Big Data Engineer
San Francisco, CA

Job Description

Job Description

* Share
* Share
* Email
* Facebook
* Twitter
* Linkedin


* Print

Scala Engineer

San francisco, California - United States | Posted - 06/21/19

Apply Easy Apply

Overview

PROLIM Global Corporation (www.prolim.com) is currently seeking Scala Engineer for location San Francisco, CA for one of our top client.

Job Description:

PURPOSE OF THE JOB

As a Scala engineer you will work on one of the world largest marketplace, dealing with one billion events per day and contribute as part of R&D self-organized scrum team working in a challenging, innovative environment for our Customer.

MAIN TASKS AND RESPONSIBILITIES

* Work proactively on the system architecture, choosing optimal solutions to build scalable and reliable systems to process key financial data.
* Data processing system optimization and tuning
* Ensure high quality development standards (unit/integration tests, etc.)
* Collaboration with the product management team to incorporate the needs of our customers
* Introduce new ideas to existing infrastructure and code

EDUCATION, SKILLS AND EXPERIENCE

Must have:

* 1+ years of commercial Scala development (at least)
* 5+ years of commercial JVM-based languages development experience
* 1+ year of experience in big data technologies and tools

o ETL or Pipeline design/implementation with Large Distributed Databases (Hive/Spark/HDFS/Scala preferred)

* Pipeline stability and performance tuning
* Good knowledge of SQL
* Rigor in high code quality, automated testing, and other engineering best practices
* Ability to analyze/find issues in already existing code
* Good English (oral & written) and communication skills in general

Would be a plus:

* Hands-on experience with: Spark, NoSQL-Databases.
* Experience in Python
* Basic understanding of accounting
* Having experience working with AirFlow, Hive, Presto, HBase
* Experience in data validation, sampling & regression tests
* Payment data processing or system design knowledge

PERSONAL COMPETENCIES

* Verbal/written communication skill (phone, email, instant messenger etc.)
* Self-education skill
* Result-oriented skills
* Team-playing skills
* Responsibility
* Flexibility
* Personal motivation

About PROLIM Corporation

PROLIM is a leading provider of end-to-end IT, PLM and Engineering Services and Solutions for Global 1000 companies. They understand business as much as technology, and help their customers improve their profitability and efficiency by providing high value technology consulting, staffing, and project management outsourcing services.

Their IT and PLM consulting offerings include; Advisory, PLM Software/Services, Program Management, Solution Architecture Training/Staffing, Cloud Solutions, Servers/Networking, Infrastructure, ERP Practices and QA Services. Engineering services include Data Translation, CAD/CAM/CAE, Process & Product Engineering, Prototyping, and Testing/Validation within a wide range of markets and industries.