Contract consulting opportunity for an experienced Machine Learning Engineer with Hadoop / Python experience.
- Hybrid onsite (approx 2-3 days / week) - Must be local to Minneapolis metro
- Client work authorization requirements : US Citizen or GC holder
- W2 hourly only (No C2C)
- Must have experience with Hadoop, Spark, Python, Orchestration
Seeking a Machine Learning Engineer to support and maintain critical batch jobs responsible for generating high-volume forecasts. These jobs are scheduled using a proprietary in-house scheduler and run R, Python, Bash, and Spark on an in-house YARN-managed cluster.
You will play a key role in enabling smooth day-to-day operations by watching, restarting, and debugging jobs in order to minimize downtime and system reliability. Besides operations, you will also contribute towards code enhancements, performance optimization, and observability instrumentation to improve workflow efficiency and stability.
Responsibilities
Manage, debug, and oversee day-to-day batch jobs and Spark-based forecasting pipelines.Diagnose and resolve performance, reliability, and dependency issues in distributed environments.Develop and scale existing roles with Python (PySpark), Bash, and Terraform.Develop and automate observability and monitoring features with OpenTelemetry (OTEL), Kibana, Grafana, and bespoke REST APIs.Collaborate with cross-functional groups (Data Science, DevOps, Infrastructure) to integrate high system reliability.Make code contributions to versioned repositories with GitHub, pull requests, code reviews, and branching models.Identify continuous improvement opportunities in orchestration, monitoring, and job performance.Must Have Skills
Apache Hadoop, Apache Hive, Apache Spark, and the Apache Spark ecosystemBig Data technologies and distributed computing conceptsPySpark and Python development backgroundDocker for containerized environmentsGit / GitHub for version control and collaborationNice to Have Skills
Workflow orchestration experience with Airflow or similarBash scripting for automation and environment setupExperience with Grafana or Kibana for observability and monitoringKnowledge of MLOps principles and toolingKnowledge of OpenTelemetry (OTEL) for metrics and tracingWorking experience with R for model run or integrationTerraform for infrastructure-as-code managementSoft Skills
Excellent analytical and troubleshooting skills with high focus on detailsExcellent communication and collaboration in cross-functional teamsProactive, ownership-focused mindset with focus on reliability and performance optimizationThis is an opportunity to make a tangible impact on a large-scale forecasting platform, working at the intersection of Machine Learning Operations, Data Engineering, and Infrastructure Automation. You'll collaborate with a technically strong team and contribute to both system stability and innovation.
ITR Group offers a competitive compensation and benefits package, including medical, dental, and 401(k) for eligible employees. The W2 pay range for this type of role is approximately $70.00-89.00 per billable hour. This range is an estimate and not a guarantee of compensation. The final rate will be determined by factors such as experience, market trends, and specific job assignments. Discover more about how ITR Group connects top talent with leading client opportunities.