Join to apply for the Lead Data Engineer- iGrid / Power Systems role at Jobs via Dice
2 days ago Be among the first 25 applicants
Join to apply for the Lead Data Engineer- iGrid / Power Systems role at Jobs via Dice
Get AI-powered advice on this job and more exclusive features.
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Primary Talent Partners, is seeking the following. Apply via Dice today!
Primary Talent Partners has a new contract opening for a Lead Data Engineer with our large power and utilities client in Charlotte, NC. This is a 12-month contract with a potential for extension.
Pay : $92.25 - $102.25 / hr ; W2 contract, no PTO, no Benefits. ACA-compliant supplemental package available for enrollment.
Description :
- Support or collaborate with application developers, database architects, data analysts and data scientists to ensure optimal data delivery architecture throughout ongoing projects / operations.
- Design, build, and manage analytics infrastructure that can be utilized by data analysts, data scientists, and non-technical data consumers, which enables functions of the big data platform for Analytics.
- Develop, construct, test, and maintain architectures, such as databases and large-scale processing systems that help analyze and process data in the way the Analytics organization requires.
- Develop highly scalable data management interfaces, as well as software components by employing programming languages and tools.
- Work closely with a team of Data Science staff to take existing or new models and convert them into scalable analytical solutions.
- Design, document, build, test and deploy data pipelines that assemble large complex datasets from various sources and integrate them into a unified view.
- Identify, design, and implement operational improvements : automating manual processes, data quality checks, error handling and recovery, re-designing infrastructure as needed.
- Create data models that will allow analytics and business teams to derive insights about customer behaviors
- Build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications.
- Responsible for obtaining data from the System of Record and establishing batch or real-time data feed to provide analysis in an automated fashion.
- Develop techniques supporting trending and analytic decision making processes
- Apply technologies for responsive front-end experience
- Ensure systems meet business requirements and industry practices
- Research opportunities for data acquisition and new uses for existing data
- Develop data set processes for data modeling, mining and production
- Integrate data management technologies and software engineering tools into existing structures
- Employ a variety of languages and tools (e.g. scripting languages)
Core Responsibilities :
Provides technical direction, guides the team on key technical aspects and responsible for product tech deliveryLead the Design, Build, Test and Deployment of componentsWhere applicable in collaboration with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead)Understand requirements / use case to outline technical scope and lead delivery of technical solutionConfirm required developers and skillsets specific to productProvides leadership, direction, peer review and accountability to developers on the product (key responsibility)Works closely with the Product Owner to align on delivery goals and timingAssists Product Owner with prioritizing and managing team backlogCollaborates with Data and Solution architects on key technical decisionsThe architecture and design to deliver the requirements and functionalityCore Experience and Abilities :
Power Systems engineering experienceDER Dispatch experienceAutomated fault analysis systems experienceAbility to perform hands on development and peer review for certain components / tech stack on the productStanding up of development instances and migration path (with required security, access / roles)Develop components and related processes (e.g. data pipelines and associated ETL processes, workflows)Lead implementation of integrated data quality frameworkEnsures optimal framework design and load testing scope to optimize performance (specifically for Big Data)Supports data scientist with test and validation of modelsPerforms impact analysis and identifies risk to design changesAbility to build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applicationsEnsures Test Driven developmentExperience leading teams to deliver complex productsStrong technical skills and communication skillsStrong skills with business stakeholder interactionsStrong solutioning and architecture skillsExperience building real time data ingestion streams (event driven)Ensure data security and permissions solutions, including data encryption, user access controls and loggingCore Technical Skills :
Experience with native AWS technologies for data and analytics such as Athena, S3, Lambda, Glue, EMR, Kinesis, SNS, CloudWatch, etc.Tools and Languages such as Django, Python, Java, Scala, PandasInfrastructure as Code technology such as TerraformAWS services such as S3, EMR, Glue, Lambda, Athena, Kinesis, EC2, SNS, SQS, CloudwatchExperience with databases such as Redshift, Document DB, DynamoDB and Mongo DBExperience transitioning on premise big data platforms into cloud based platforms such as AWSAdditional Technical Skills (nice to have, but not required for the role) :
Hadoop platform (Hive; HBase; Druid)SparkPySparkSQLWorkflow AutomationDevOps pipeline (CI / CD); Bitbucket; ConcourseAPI frameworksRequirements :
Degree in Computer Science, Engineering, or related fields.8-15 years of experiencePrimary Talent Partners is an Equal Opportunity / Affirmative Action employer committed to diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, disability, protected veteran status, gender identity, or any other factor protected by applicable federal, state, or local laws.
If you are a person with a disability needing assistance with the application or at any point in the hiring process, please contact us at
PTPJobs
Seniority level
Seniority level
Mid-Senior level
Employment type
Employment type
Full-time
Job function
Job function
Information Technology
Industries
Software Development
Referrals increase your chances of interviewing at Jobs via Dice by 2x
Sign in to set job alerts for "Data Engineer" roles.
Charlotte, NC $75,300.00-$143,100.00 4 days ago
Charlotte, NC $112,597.33-$152,810.66 3 weeks ago
Charlotte, NC $95,000.00-$105,000.00 2 weeks ago
Charlotte, NC $153,000.00-$196,000.00 1 week ago
Front End Software Engineer - All Levels
Charlotte, NC $90,000.00-$130,000.00 2 weeks ago
Charlotte, NC $100,960.00-$151,440.00 1 week ago
Data Engineer with Gen AI Experience(Charlotte, NC) Onsite
Charlotte, NC $100,960.00-$151,440.00 2 months ago
Charlotte, NC $105,000.00-$189,000.00 2 weeks ago
Charlotte, NC $135,668.03-$166,971.00 1 month ago
We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
J-18808-Ljbffr