Working within the DSS Central team, the Software Engineer will be responsible for the acquisition and transformation of terabytes of data being used to enhance the company's leverage over data and information. The ETL Engineer will work with the teams to enable the next generation of data driven services at eBay. The ideal candidate will have strong knowledge and experience in creating and managing data in SQL/NoSQL environments. Previous experience in environments with big data platforms like Hadoop and processing frameworks like Spark/Hive is highly desirable. Knowledge of Front End technologies is also highly desirable.
* Primary Job Responsibilities:
* Define, design, implement and test data engineering modules written in Spark/Hive/ANSI SQL.
* Strong Unix scripting skills.
* Experience in Java, Scala, and Python is a plus.
* Experience in Realtime technologies like Flink, Kafka is a plus.
* Estimate engineering effort; plan implementation, and rollout system changes.
* Must be able to independently design, code, and test major features.
* Share engineering support, release, and on-call responsibilities.
* Find and help fix stability/scalability issues in a very time critical environment.
* Utilize ETL best practices and implement them for process improvement.
* Work with external and internal teams to resolve infrastructure related issues when developing integration modules.
* Experience with agile and waterfall project development methodologies.
* Exposure and experience working in big data environments managing terabytes of data and information.
* Able to work with product managers, architects and data scientists to translate conceptual requirements into technical implementation requirements.
* Understanding of data models and data structures. Knowledge of Star Schema, Data Normalization.
* Understanding of difference between 3NF and Star Schema.
* Proficient in parallel data processing concepts.
* Highly self-motivated for success in a fast-paced, dynamic environment.
* Strong communication and organizational skills.
MS in CS or related engineering field with 5+ years of job relevant experience
Bachelor's Degree in CS or related engineering field with 5 + years of of job relevant experience
View our accessibility info
eBay Inc. is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you are unable to submit an application because of incompatible assistive technology or a disability, please contact us at email@example.com. We will make every effort to respond to your request for disability assistance as soon as possible.
For more information see:
EEO is the Law Poster
EEO is the Law Poster Supplement
eBay is an online auction and e-commerce marketplace, enabling people and businesses to buy and sell goods and services.