Spark / Glue Developer

Linthicum Heights, United States | Posted on 09 / 09 / 2025

100% On-site Mon-Fri, Linthicum Heights, MD 21090

Interview Type

In-Person

Contract Duration

1year with 9 one-year renewal options

Tentative Start Date

10 / 01 / 2025

Deadline

09 / 22 / 2025

Project Overview :

Innosoft is the primecontractor for MD Benefits (formerly MD THINK), supporting the management,design, development, testing, and implementation of this strategic InformationTechnology (IT) program. Maryland Benefits is seeking an agile developmentresource team with required skill sets to build and / or maintain the MarylandBenefits infrastructure / platform, applications development, data repositories,reports and dashboards and support activities related to network services andsystem oper ations.

The Shared DataPlatform (SDP) is designed as a cloud-based, data-centric infrastructure tosupport scalable, flexible, and integrated data operations. It empowersself-service and accelerates data-driven decision-making across the enterprise.Key strategic goals include establishing a mature data infrastructure thatbalances analytics and business intelligence, enabling iterative learning andactionable insights, and fostering a "Data Center of Excellence"(DCoE) to govern and enhance data-driven processes. The SDP also prioritizesthe delivery of trusted information and the streamlined onboarding of StateAgencies to the Maryland Benefits platform through standardized procedures,ultimately driving operational efficiency and measurable business value. The"Data Platform - Automation" team plays a critical role in achievingthese goals by supporting the "Data Platform - Engineering" team.

Duties / Responsibilities :

The Spark / GlueDeveloper shall utilize IT equipment and languages (third- andfourth-generation or current state-of-the-art) to develop and preparediagrammatic plans to solve business, management, communications, and strategicproblems. This individual shall design detailed programs, flowcharts, anddiagrams showing mathematical computations and sequence of machine operationsnecessary to copy and process data and print results. This individual shallverify the accuracy and completeness of programs and systems by preparingsample representative data, and perform testing by means of cycle and systemprocessing.

• Design, develop, and optimize ETL / ELT pipelinesusing AWS Glue (PySpark) to ingest, transform, and load data from varioussources (RDBMS, APIs, files) into S3-based Data Lake and Redshift / Snowflake.
• Implement complex business logic, datacleansing, and enrichment using PySpark.
• Handle both batch and streaming data processinguse cases using AWS services such as Kinesis, Glue Streaming, or SparkStructured Streaming.
• Contribute to the implementation andoptimization of the Lake House pattern, integrating data lakes (S3, LakeFormation) with data warehouses (Redshift, Snowflake).
• Leverage Glue Catalog, Lake Formation, andAthena to enable data discovery and secure data sharing.
• Work with data architects, data analysts, andDevOps teams to design end-to-end data workflows.
• Collaborate on building reusable code modules,job orchestration using Step Functions, Airflow, or AWS Glue Workflows.
• Optimize Spark / Glue jobs for performance andcost.
• Implement and maintain data quality checks,logging, and error-handling mechanisms.
• Ensure compliance with data governance, privacy,and security policies.

Requirements

Education :

This position requires a Bachelor's degree from anaccredited college or university with a major in computer science, informationsystems, engineering, business, or a related scientific or technicaldiscipline; or three (3) years of equivalent experience in a related field.(Note : A Master's degree is preferred.)

General Experience :

Specialized Experience :

Standard Employee Benefits.

50% Health Insurance Paid by Innosoft, Paid Vacation, 401K Match, STD LTD and AD&D paid by Innosoft. See attached Innosoft Benefits Guide.

J-18808-Ljbffr