Talent.com
Data Engineer 1/2/3 or Sr
Data Engineer 1/2/3 or SrBerkshire Hathaway Energy • Urbandale, IA, United States
No longer accepting applications
Data Engineer 1 / 2 / 3 or Sr

Data Engineer 1 / 2 / 3 or Sr

Berkshire Hathaway Energy • Urbandale, IA, United States
30+ days ago
Job type
  • Full-time
Job description

Job Description

This is a multi-level posting. Candidates may be considered for any of the posted levels 14 / 15 / 16 / 17, depending on their level of experience and depth of expertise.

As a Data Engineer, you will design, build, and maintain scalable data pipelines and infrastructure to support analytics, reporting, and data science initiatives. You will work closely with cross-functional teams to ensure data is accessible, reliable, and secure across the organization.

Responsibilities

Primary Job Duties and Responsibilities (Essential Job Functions)

Design and Develop Scalable Data Pipelines

  • Design and implement scalable data ingestion and transformation frameworks using Azure services enabling structured, semi-structured, and unstructured data to be efficiently processed and integrated into enterprise data platforms
  • Build and maintain robust ETL / ELT pipelines using Azure Data Factory and Azure Databricks.
  • Integrate data from diverse sources including on-premises systems, cloud storage, APIs, and streaming platforms.

Databricks Development and Optimization

  • Develop and optimize notebooks and workflows in Azure Databricks using PySpark, SQL.
  • Implement Delta Lake for efficient data storage, versioning, and ACID transactions.
  • Leverage Databricks features such as Unity Catalog and job orchestration.
  • Data Modeling and Architecture

  • Design and implement data models (star / snowflake schemas) for analytics and reporting.
  • Collaborate with architects to define data lakehouse architecture and best practices.
  • Hands-on experience implementing and optimizing data solutions using the Medallion Architecture (Bronze, Silver, Gold layers) for scalable and structured data processing
  • Data Quality and Governance

  • Implement data validation, profiling, and cleansing routines.
  • Ensure compliance with data governance policies, including data lineage and metadata management.
  • Performance Tuning and Monitoring

  • Monitor and optimize performance of Spark jobs and data pipelines.
  • Troubleshoot and resolve issues related to data latency, job failures, and resource utilization.
  • Collaboration and Stakeholder Engagement

  • Work closely with data scientists, analysts, and business units to understand data requirements.
  • Translate business needs into technical solutions that are scalable and maintainable.
  • Security and Compliance

  • Implement role-based access control (RBAC), encryption, and secure data handling practices.
  • Ensure compliance with industry regulations (e.g., NERC CIP, GDPR, HIPAA if applicable).
  • Documentation and Best Practices

  • Maintain clear documentation of data flows, architecture, and operational procedures.
  • Promote best practices in code versioning, testing, and CI / CD for data engineering.
  • Qualifications

    Bachelor's degree in information systems, computer science or related technical field or equivalent work experience. (Typically four years of additional related, progressive work experience would be needed for candidates applying for this position who do not possess a bachelor's degree.)

    A minimum of two years additional direct related technical experience in IT operations or data engineering experience with foundational knowledge of database structures, principles, and practices. is required for the level 1.

    A minimum of three or more years additional direct related technical experience in data engineering, data integration, or database administration, with hands-on experience in Azure data services and pipeline development is required for the level 2 and 3.

    Six or more years of experience with advanced knowledge of data architecture, cloud platforms (especially Azure), and enterprise data solutions is required for the sr level.

    Proficiency in data engineering tools and platforms, especially Azure Data Factory and Azure Databricks.

    Strong understanding of data modeling, ETL / ELT processes, and performance tuning of enterprise-level applications.

    Expert-level knowledge of data-related technologies from architecture to administration, including design, development, optimization, and licensing.

    Proven experience working in the utility industry is required

    Effective oral and written communication skills, with the ability to collaborate across teams and mentor junior engineers.

    Strong analytical and problem-solving abilities.

    Ability to prioritize and manage multiple tasks and projects concurrently.

    Employees must be able to perform the essential functions of the position, with or without an accommodation.

    All qualified applicants will receive consideration for employment without regard to race, color, religion or religious creed, age, national origin, ancestry, citizenship status (except as required by law), gender (including gender identity and expression), sex (including pregnancy), sexual orientation, genetic information, physical or mental disability, veteran or military status, familial or parental status, marital status or any other category protected by applicable local, state or U.S. federal law.

    About Us

    MidAmerican Energy Company, a Midwest utility, provides regulated electric and natural gas service to more than 1.6 million customers in Illinois, Iowa, Nebraska and South Dakota. The company owns and operates a portfolio of power-generating assets, approximately 61% of which is wind generation.

    About the Team

    MidAmerican Energy Company is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion or religious creed, age, national origin, ancestry, citizenship status (except as required by law), gender (including gender identity and expression), sex (including pregnancy), sexual orientation, genetic information, physical or mental disability, veteran or military status, familial or parental status, marital status or any other category protected by applicable local, state or U.S. federal law. Employees must be able to perform the essential functions of the position, with or without an accommodation.

    Create a job alert for this search

    Sr Data Engineer • Urbandale, IA, United States

    Related jobs
    Sr Software Engineer II (Platform Modernization)

    Sr Software Engineer II (Platform Modernization)

    Principal Financial Group, Inc. • USA, Iowa, Des Moines
    Full-time +1
    We're looking for a Senior Software Engineer to join our Retirement & Income Solutions (RIS) business.In this role, you'll be an engineering lead providing architectural oversight for the moderniza...Show more
    Last updated: 30+ days ago
    Software Engineer Leader (Des Moines, IA or Charlotte, NC)

    Software Engineer Leader (Des Moines, IA or Charlotte, NC)

    Principal Financial Group, Inc. • USA, Iowa, Des Moines
    Full-time +1
    We're looking for a Senior Software Engineer to join our WSRS technology team.In this role, you'll be a key player and leader in strategically shaping our technological future from innovative custo...Show more
    Last updated: 30+ days ago
    Lead Software Engineer - Data Platform

    Lead Software Engineer - Data Platform

    Relativity • Des Moines, IA, United States
    Full-time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Domain - a foundational component of our platform-into...Show more
    Last updated: 30+ days ago • Promoted
    Director of Data Engineering

    Director of Data Engineering

    Workiva, Inc. • Ames, IA, United States
    Full-time
    We are seeking a seasoned and strategic Director of Data Engineering to lead the evolution and operations of Workiva's multi-tenant data platform. This platform underpins our enterprise and customer...Show more
    Last updated: 30+ days ago • Promoted
    Senior Engineer, SAP Pricing

    Senior Engineer, SAP Pricing

    Cardinal Health • Des Moines, IA, US
    Full-time
    What Application Development & Maintenance contributes to Cardinal Health.Application Development & Maintenance performs configuration or coding to develop, enhance and sustain the organiza...Show more
    Last updated: 2 days ago • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Workiva, Inc. • Ames, IA, United States
    Full-time
    Machine Learning team and help build the next generation of intelligent solutions at Workiva.In this role, you'll play a key part in designing, developing, and delivering machine learning infrastru...Show more
    Last updated: 30+ days ago • Promoted
    Infrastructure Engineer I (Des Moines, IA)

    Infrastructure Engineer I (Des Moines, IA)

    Principal Financial Group, Inc. • USA, Iowa, Des Moines
    Full-time
    As an Infrastructure Engineer in Benefits & Protection Distribution IT, you'll assist with production, implementation, and support of new and existing technologies in our Des Moines office.You'll i...Show more
    Last updated: 4 days ago
    Sr. Software Engineer - Full Stack

    Sr. Software Engineer - Full Stack

    Robert Half • Ames, IA, US
    Full-time +1
    Position : SENIOR SOFTWARE ENGINEER.Salary : up to $160K + Excellent Benefits.Robert Half is seeking a SENIOR SOFTWARE ENGINEER for a permanent, direct hire, full time position for our client company...Show more
    Last updated: 23 days ago • Promoted
    Lead Software Engineer

    Lead Software Engineer

    Relativity • Des Moines, IA, United States
    Full-time
    Are you looking to be in a workplace where colleagues inspire one another, working together to build AI software solutions?. We're looking for a Lead Software Engineer to join our Relativity Privacy...Show more
    Last updated: 30+ days ago • Promoted
    Mission Critical - Data Center

    Mission Critical - Data Center

    Michael Page • Des Moines, IA, US
    Full-time
    Mission Critical Data Center Project Manager.Our client is a Top ENR General Contractor and Top Green Contractor with 40+ years in business. They have a strong presence in the U.Market sectors inclu...Show more
    Last updated: 30+ days ago • Promoted
    Data Center Services Electrical Commissioning Engineer Senior II

    Data Center Services Electrical Commissioning Engineer Senior II

    CAI • Des Moines, IA, US
    Full-time
    THIS IS NOT A DATA ENGINEERING RELATED POSITION.CAI seeks DC Services Electrical Commissioning Engineers with a minimum of five to seven years' experience in Data Center Commissioning.This posi...Show more
    Last updated: 16 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Workiva, Inc. • Ames, IA, United States
    Full-time
    Workiva's Search Team powers how customers find and interact with information across our platform.As a Senior Software Engineer on this team, you'll design and build backend services in Java on top...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer Intern

    Data Engineer Intern

    Deliverect • Madrid, Iowa, United States, 50156
    Full-time
    At Deliverect, our API-first platform is revolutionizing commerce by providing a connected suite of on and off-premise solutions. We empower both the food and retail industries to expand their reven...Show more
    Last updated: 4 days ago
    Senior AI Server Engineer - BigBox

    Senior AI Server Engineer - BigBox

    Meta • Des Moines, IA, US
    Full-time
    BigBox is seeking an experienced Server Engineer to lead the development of AI-powered games, focusing on underlying infrastructure and working across Meta's product and infrastructure teams.Senior...Show more
    Last updated: 19 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Tractor Zoom • West Des Moines, IA, US
    Full-time
    We are committed to helping leaders in agriculture make data-driven decisions when it comes to buying, selling, financing, and insuring heavy equipment. Tailored to each business unique needs, the T...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI Engineer - On-site or Hybrid Opportunity

    Senior AI Engineer - On-site or Hybrid Opportunity

    The Mutual Group • West Des Moines, IA, US
    Full-time
    As a Senior AI Engineer, you will be responsible for designing, building, and deploying solutions that leverage large language models (LLMs), Generative AI, and natural language processing (NLP) to...Show more
    Last updated: 30+ days ago • Promoted
    Senior Lead Database Engineer

    Senior Lead Database Engineer

    Lumen • Des Moines, IA, US
    Full-time
    We are igniting business growth by connecting people, data and applications - quickly, securely, and effortlessly.Together, we are building a culture and company from the people up - committed to t...Show more
    Last updated: 12 days ago • Promoted
    Sr Software Engineer II (Salesforce)

    Sr Software Engineer II (Salesforce)

    Principal Financial Group, Inc. • USA, Iowa, Des Moines
    Full-time +1
    We're looking for an experienced, Senior Software Engineer to join our Workplace Personal Investing team.As we embark on building an innovative greenfield platform, we are seeking an experienced Te...Show more
    Last updated: 30+ days ago