Senior Data Engineer

Overview

SOSi is seeking a Senior Data Engineer to assist the MLOps Team in creating, maintaining, and automating workflows leveraging cutting-edge technologies and supporting a government customer in Huntsville, Alabama . This role will be responsible for delivering automation to key national security missions interacting with petabyte-scale data using High-Performance Computing (HPC) environment.

In this role, you will lead a group of fellow Data Engineers and work with Data Scientists across the organization to construct digital infrastructure necessary to produce and deploy Machine Learning models. You will leverage scientific techniques to iteratively transform petabyte-scale data, construct efficient and effective Extract, Transform, and Load (ETL) pipelines, and refactor manual workflows into containerized-services. You will work with multiple database types including SQL and NoSQL databases, leveraging different storage techniques to maximize efficiency and capability of analytics products. Working on the client-site, you will be embedded with the end-user working to understand their processes and improve upon current standards.

The team will work with Open-Source technologies including :

• Scripting languages such as Python and Go.
• Databases such as Postgres and Arango DB.
• Apache products including Apache Airflow, Apache Spark, Apache AGE.
• Containerization software with Docker, Podman, Kubernetes, and Kubeflow.
• Configuration management tools like yaml, Github, Gitlab, and FastAPI.
• Agile tools such as Confluence, Jira, Scrum Methodologies.

SOSi is seeking Senior Data Engineering talent to unlock insights from massive datasets supporting strategic national security objectives. If you have a passion for data and want to apply your skills to impactful projects at scale, we want to hear from you!

Essential Job Duties

Minimum Requirements

Preferred Qualifications

Work Environment

Working at SOSi

All interested individuals will receive consideration and will not be discriminated against for any reason.

J-18808-Ljbffr