Search jobs > St Louis, MO > Senior data engineer

Senior Research Data Engineer

The Climate Corp
St Louis, MO, United States
Full-time

Climate LLC’s St. Louis, MO office seeks a Senior Research Data Engineer. This is a hybrid work-from-home position that will work closely with team members to develop and implement research data pipelines for producing data layers and storage of research data.

  • Will also : (i) implement and maintain scalable data-intensive processing pipelines that apply geospatial data to ML / DL models;
  • ii) assist in the automation and processing of internal geospatial and environmental products and datasets using large amounts of geospatially referenced data;

iii) utilize Python and its libraries such as SciPy, NumPy, Pandas, Geopandas, utm, pingoui, Xarray etc., and also work with geospatial / imagery formats such as Geotiff, GeoJSON, Avro and Parquet etc.

iv) accessing data over the AWS cloud and processing it using the distributed computing environment such as Pyspark, Scala etc.

and (v) develop POCs when necessary for new pipelines to be integrated to science data pipeline in collaboration with diverse research partners.

This is a hybrid office / work-from-home position that requires the employee to be able to work in our St. Louis office three (3) days per week.

Must have a Master’s degree (or foreign equivalent degree) in Information Science, Computer Science, Data Science, Data Analytics, or a directly related field plus three (3) years of experience in a related position.

  • Experience must include three (3) years with : (i) designing, developing and testing geospatial pipelines that encompass statistical yield analysis and report generation, proven experience in design and implementation of scalable data integration & transformation for geospatial applications and interactive visualization dashboards;
  • ii) working with large size raster and vector geospatial datasets applied to machine learning model generation and deployment in big data environment;
  • iii) designing and developing packages, procedures / methods using Python, SQL / PLSQL in distributed environment; (iv) with RDBMS, SQL and No-SQL databases to perform complex transformations using tools such as Oracle, Postgres, MSSQL and solid knowledge of SQL, query optimization and OLAP;
  • v) using geospatial and remote sensing tools such QGIS, ArcGIS, Postgis etc. and pre-processing workflows such as yield analysis, report generation, and field prescription creation by applying GDAL, proj4, CRS, projections for geospatial experimentational design;
  • vi) working in a matrix / hybrid organization structure with cross-functional leadership skills as well as troubleshooting and making quick and effective decisions;
  • vii) Big Data technologies including Spark, Arrow and fluent in interacting with file format like Avro, Parquet, CSVs, Geotiff and GeoJSON;

viii) Amazon Webservices S3, EMR, ECS and RDS and orchestration platform like AWS Step Functions, AWS Event bridge, etc.

ix) code versioning and dependency management systems such as GitHub, Git, GitLab with CI / CD pipelines, SharePoint and / or other repositories used by the team;

and (x) waterfall or Agile methodologies in Atlassian suite or JIRA.

This is a hybrid office / work-from-home position that requires the employee to be able to work in our St. Louis office three (3) days per week.

Experience can be concurrent.

Apply at , #3534 or Careers climate [email protected] with reference to #3534 (Senior Research Data Engineer).

21 days ago
Related jobs
Promoted
Bayer
St. Louis, Missouri

This is a hybrid work-from-home position that will work closely with team members to develop and implement research data pipelines for producing data layers and storage of research data. Louis, MO office seeks a Senior Research Data Engineer. Will also: (i) implement and maintain scalable data-inten...

Promoted
VirtualVocations
Florissant, Missouri

A company is looking for a Senior Big Data Engineer specializing in Airflow and Oozie on GCP. ...

Promoted
EMW Staffing Solutions LLC
St. Louis, Missouri
Remote

Data Engineers analyze and develop on-premises and/or cloud data and ETL solutions to solve the client’s challenges. Data migrations and conversions to the cloud and to cloud data warehouse services. Open to mid to approaching senior/stand alone resource. Develop data solutions leveraging traditiona...

Promoted
VirtualVocations
Florissant, Missouri

A company is looking for a Senior Data Engineer in Business Analytics. ...

Promoted
Zelis
St. Louis, Missouri

Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards. Lead, Mentor and develop offshore Data Engineers in adopting best practices and deliver data products. Anticipate, identify, and ...

Promoted
VirtualVocations
Florissant, Missouri

A company is looking for a Senior Data Engineer in Tampa, FL. ...

Promoted
Watlow
St. Louis, Missouri

Develop data transformation processes to integrate data from various sources and prepare the data for analysis. Knowledgeable about data engineering concepts and methodologies. Ensure data processing meets business requirements and industry practices for data integrity, latency, and scalability. Bac...

Highmark Health
MO, Working at Home, Missouri

We are seeking an experienced Senior Analytic Data Engineer to join our team and drive the development of innovative AI (generative and predictive) based solutions for our enterprise stakeholders. As a member of the AI Services and Platform team, you will collaborate with engineers and scientists to...

Boeing
Hazelwood, Missouri

Bachelor of Science degree from an accredited course of study in engineering, engineering technology (includes manufacturing engineering technology), chemistry, physics, mathematics, data science, or computer science. Product Security Engineer (Mid-Level, Experienced, or Senior). Boeing Research & T...

TekWissen LLC
Creve Coeur, Missouri

Strength of ideas trumps position on an org chart </div> </li> </ul> </div> <div> <div lang="EN-US" paraeid="{d26b76d5-0adf-4507-8b7b-1392005f1560}{136}" paraid="1676875394" xml:lang="EN-US"><b>If you share our values...