Software Engineer / Databrick Engineer

Software Engineer / Databrick Engineer

Location : Dulles, VA

Must have an active Secret Clearance

Node is supporting a U.S. Government customer on a large mission critical development and sustainment program to design, integrate, build, deliver, and operate a network operations environment including introducing new cyber capabilities to address emerging threats.

Node is seeking a Databricks Engineer to support the migration of customer applications, services and platforms to a Medallion Model. This opportunity represents the cornerstone of the future of the organization.

Responsibilities :

• Supporting teams to migrate services, applications and platforms from legacy back-end systems to Databricks.
• Identifying the optimal path for migration, building the plan for migration and finally, execution of the plan.
• Data Pipeline migration of legacy pipelines from NiFi to Databricks, complete with  validation.
• Implementing the medallion model for each of the data assets being migrated to Databricks.
• Develop an SOP for integration of data assets into the Databricks platform focused on efficiency, instrumentation  and performance.
• Optimize development, testing, monitoring and security for data assets being added to the Databricks platform.
• Develop and implement a strategy for optimizing migration and integration of data assets to the Databricks platform.
• Develop code using various programming and scripting languages to automate / optimize data ingestion, pipeline orchestration and improve data management processes.
• Ingest transparency, leveraging technologies such as AWS CloudWatch to identify places for measuring and gathering performance information on automated data pipelines
• Ensure Data Engineering Team Standard Operating Procedures are appropriately captured and communicated across the team.
• Ensure technical correctness, timeliness and quality of delivery for the team.
• Demonstrate excellent oral and written communication skills to all levels of management and the customer.

Requirements

Required Skills :

Desired Skills :

Required Education :

Company Overview :

Node.Digital is an independent Digital Automation & Cognitive Engineering company that integrates best-of-breed technologies to accelerate business impact.

Our Core Values help us in our mission. They include :

OUR CORE VALUES

Identifying the~RIGHT PEOPLE~and developing them to their full capabilities

Our customer’s “Mission” is our “Mission”. Our~MISSION FIRST~approach is designed to keep our customers fully engaged while becoming their trusted partner

We believe in~SIMPLIFYING~complex problems with a relentless focus on agile delivery excellence

Our mantra is “~Simple

Benefits

We are proud to offer competitive compensation and benefits packages to include