Data Engineer

Job Description

Job Description

ESSENTIAL DUTIES & RESPONSIBILITIES

General description of main / primary duties and responsibilities of the job, aptitude, level of complexity, span of control, autonomy, decision making and judgement. It is central and necessary to the satisfactory performance of the job. Includes the following and other duties as assigned.

Under limited supervision, this position will :

• Perform data engineering and modernization by designing, building and maintaining data integration, transfer and analysis solutions for structured, and semi-structured data. Leverage T-SQL, Spark SQL, SSIS, Python, Synapse, Azure Data Factory, OneLake, Data Lake, DBT etc.
• Lead the technical migration of data solutions, primarily SQL Server, to Azure (Microsoft Fabric), Snowflake and Databricks or other cloud data technologies.
• Implement and adhere to data management best practices as well as adopted security, development and coding standards for solution designs, performance tuning and optimization.
• Ensure solutions are compatible with state-based deployment operations and CI / CD ready using tools such as SSDT projects, ARM / BICEP, DAB, etc.
• Provide operational support by investigating failed jobs, troubleshoot data issues and respond to user reported errors in collaboration with DBAs and other members of the IT Teams. Perform diagnostics, index tuning, resource and performance optimizations.
• Ensure continuity and reliability of existing data solutions during modernization.
• Initially develop and support SQL Server solutions like stored procedures, SSIS packages and views. Transition and deliver reports via Spotfire to transfer data between systems or extract data to be transferred to outside partners or agencies. These solutions are mostly T-SQL and SSIS with occasional Python and PowerShell.
• While progressing on cloud initiatives, build the same types of solutions, leverage cloud technologies and platforms like Microsoft Fabric and / or Databricks, and convert solutions to the cloud technology.
• Perform other duties as assigned.

QUALIFICATIONS

Education, Experience, Licensure (minimum level required)

CORE COMPETENCIES

List and describe the required factors (i.e. knowledge, skills, abilities, software programs), that are needed for this role.

SUPERVISORY RESPONSIBILITIES

WORK ENVIRONMENT

The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Excludes occasional visitation to the field – reference Travel section.

Office Related :

HOURS / SHIFTS

PHYSICAL DEMANDS

TRAVEL

Approximate amount of time.

Summary of Available Benefits