REQUIRED: bachelor's degree in related field; at least two years' programming experience (may include experience gained as an undergraduate) in a Linux environment using Python and/or C/C++; six months' professional experience writing software or managing data; experience with relational databases (e.g., PostgreSQL) and managing large complex data; meticulous attention to detail; strong problem-solving, time-management, communication, and organization skills; and ability to manage multiple priorities, work as part of a team, quickly learn new software programs/interfaces, and troubleshoot minor technical problems. Experience with data and network security and knowledge of and interest in working with vehicle-based data preferred. Job #17666
DATA SOFTWARE ENGINEER, AGELAB, Center for Transportation & Logistics, to support naturalistic and simulated advanced driving technology research. Will manage a growing dataset comprised primarily of video and tabular sensor data housed on remote servers and databases. Will be responsible for working with data through various software components of a growing data pipeline including activities; leveraging and expanding existing processing pipelines for the SLURM workload manager hosted on a remote academic computing cluster (MGHPCC) running CentOS 6 and 7; managing secure storage and access for hundreds of terrabytes of data while providing data support for local researchers and remote sponsors; working with an existing PostgreSQL database for storing metadata and design new storage schemas on a per-project basis; maintaining/leveraging existing preprocessing code and synchronization scripts that preparing video and time series data for analysis by researchers; developing/integrating third-party annotation approaches into data processing pipelines to augment and transform data; evaluating and developing new computing resources as needed; implementing backup routines; generating documentation; and other duties as requested.
Massachusetts Institute of Technology is a private research university.