Talent.com
Principal Data Engineer
Principal Data EngineerMetropolitan Council • Saint Paul, MN, United States
Principal Data Engineer

Principal Data Engineer

Metropolitan Council • Saint Paul, MN, United States
10 days ago
Job type
  • Permanent
Job description

WHO WE ARE

We are the Metropolitan Council, the regional government for the seven-county Twin Cities metropolitan area. We plan 30 years ahead for the future of the metropolitan area and provide regional transportation, wastewater, and housing services. More information about us on our website.

We are committed to supporting a diverse workforce that reflects the communities we serve.

Information Services (IS) is the central IT department within the Regional Administration (RA) division that supports all divisions of the Metropolitan Council. Our 140 team members provide technology, practices, and innovative solutions that enable the core services of the Council.

How your work would contribute to our organization and the Twin Cities region :

The Principal Data Engineer works with business and IS leaders and stakeholders to establish data engineering strategies that support the organization's goals and objectives. They lead and influence decisions around data, collaborating with IS and business units to create solutions that make data available to systems and / or data consumers, such as system users, developers, data scientists, or business analysts.

They create and socialize the data engineering technology roadmap and plan how to get there. They evaluate new technologies, tools, and techniques and work closely with the IS architects to build data engineering solutions on top of the overall technology architecture. They help establish data governance policies, procedures, standards, and best practices to ensure compliance with industry regulations, security and data privacy laws, and information security requirements.

This role designs, develops, and maintains data solutions. This includes databases (DBs), data lakes, data warehouses, data marts and data movement (data pipelines / ETL / ELT), as well as integrating analytics and data science outputs into existing business processes or systems. They administer, monitor, and maintain data solutions and tools, ensuring their security, performance, and availability. They also identify and resolve data quality issues.

The Principal Data Engineer requires the highest degree of expertise in database technologies, data modeling, structured and unstructured data, and strong programming skills. They often act as technical leads and work on small to large initiatives, advising and mentoring others. They play a critical role in ensuring the data is properly managed and leveraged to support strategic decision-making and to achieve business objectives.

Full Salary Range : $47.50 - $77.09 hourly / $98,800 - $160,347 yearly

This position is eligible for a hybrid telework arrangement (both remote and onsite). Candidate's permanent residence must be in Minnesota or Wisconsin.

What you would do in this job

Strategic Planning & Leadership

  • Develop data engineering strategies for operations, reporting, and analytics.
  • Create and socialize the data engineering roadmap to achieve the strategic plan.
  • Evaluate new technologies, tools, and techniques and make recommendations.
  • Develop data policies, procedures, standards, and best practices.
  • Mentor, influence, and advise data engineers on industry best practices.
  • May act as a technical lead on small to large data-related initiatives.

Data Operations

  • Ensure data systems are available, scalable, secure, and supportable.
  • Administer, monitor, and support 24x7x365 operations, ensuring data security, performance, and availability.
  • Resolve incidents and meet Service Level Agreements (SLAs).
  • Ensure compliance with industry regulations, security, and data privacy laws.
  • Recommend performance improvements, optimizations, and automation.
  • Help fulfill data practices requests, complete audits, and respond to cybersecurity events.
  • Efficiently complete data service requests.
  • Identify and resolve data quality issues.
  • Data Development

  • Design, develop, and implement data solutions for operational, reporting, and analytical systems.
  • Create solutions that make data available to systems and / or data consumers, including system users, developers, data scientists, and business analysts.
  • Build and leverage CI / CD development practices.
  • Integrate analytics and data outputs into business processes or systems.
  • Cross-Functional Collaboration

  • Effectively collaborate with business teams on data needs and requirements.
  • Partner with IS teams to deliver available, secure, and supportable solutions for on-premise, hybrid, and cloud environments.
  • Mentor and train IS and business teams on data solutions.
  • What education and experience are required for this job (minimum qualifications)

    Any of the following combinations of education (in Computer Science / Engineering, Information Technology, or related) and relevant experience :

  • Master's degree and four (4) years of experience
  • Bachelor's degree and six (6) years of experience
  • Associate's degree and eight (8) years of experience
  • High school diploma / GED and ten (10) years of experience
  • Knowledge, Skills, and Abilities Required :

  • Developed data strategies & roadmaps
  • Defined data standards, best practices, policies, & procedures
  • Administered & supported DB operations 24x7x365 & metrics for SLAs
  • Developed data solutions for operations, reporting, & analytics
  • ITIL, Incident, Service, Change & Problem Management experience
  • Knowledge of & experience with data privacy laws, security, & industry regulations
  • Installation & configuration of DB software & drivers on servers & clients
  • Writing & tuning complex SQL queries
  • Oracle DB Administration
  • Oracle Exadata Administration
  • What additional skills and experience would be helpful in this job (desired qualifications) :

  • Oracle Database@Azure Experience
  • SQL Server Administration
  • Experience leading a technical team
  • Modern cloud data platform experience in Databricks
  • Developing & supporting data integrations (data pipelines / ETL / ELT)
  • Reporting & data visualization experience
  • What knowledge, skills, and abilities you should have within the first six months on the job :

  • Knowledge of IS teams, roles & responsibilities, services, & general technologies.
  • Understand the data management team, group functions, & data technologies.
  • Knowledge of the various business units & the types of data each has and needs.
  • Understand & use incident, service, problem, & change management processes.
  • Strong interpersonal relationships within and across teams, to remove barriers, reduce risk, build trust and improve insights.
  • Skill and comfort in delivering strategic guidance to IS teams and leadership.
  • What you can expect from us :

  • We offer the opportunity to make a difference and positively influence the Twin Cities metropolitan area.
  • We encourage our employees to develop their skills through on-site training and tuition reimbursement.
  • We provide a competitive salary, excellent benefits, and a good work / life balance.
  • More about why you should join us!

    Additional information

    Union / Grade : AFSCME / Grade J

    FLSA Status : Exempt

    Safety Sensitive : No

    What your work environment would be :

    You would perform your work in a standard office setting. Work may sometimes require travel between your primary work site and other sites.

    If you are new to the Metropolitan Council, you must pass a background check, which verifies education, employment, and criminal history. If you have a criminal conviction, you do not automatically fail. The Metropolitan Council considers felony, gross misdemeanor, and misdemeanor convictions on a case-by-case basis, based on whether they are job-related and whether the candidate has demonstrated adequate rehabilitation.

    If you are already an employee of the Metropolitan Council, you must pass a criminal background check if the job you're applying for is in Information Services.

    Security Policy :

    This position involves direct access to Criminal Justice Information (CJI) as defined by the FBI CJIS (Criminal Justice Information Services) Security Policy. In accordance with section 5.12.1.1 of the FBI CJIS Security Policy, final candidates must agree to submit to a state-of-residence and national fingerprint-based record check. If the record check reveals criminal convictions, the Metropolitan Transit Police Department and / or the Minnesota Bureau of Criminal Apprehension will review the nature and circumstances of those convictions to determine whether access to Criminal Justice Information would be permissible. If it is determined that access to Criminal Justice Information would not be permissible, the candidate will no longer be eligible for this position.

    IMPORTANT : If you make a false statement or withhold information, you may be barred from job consideration.

    The Metropolitan Council is an Equal Opportunity, Affirmative Action, and veteran-friendly employer. The Council is committed to a workforce that reflects the region's diversity and strongly encourages persons of color, members of the LGBTQ community, individuals with disabilities, women, and veterans to apply.

    If you have a disability that requires accommodation during the selection process, please email HR-OCCHealth@metc.state.mn.us

    Create a job alert for this search

    Principal Data Engineer • Saint Paul, MN, United States

    Related jobs
    Principal Sales Engineer - Data Modernization

    Principal Sales Engineer - Data Modernization

    Rocket Software • St Paul, MN, United States
    Full-time
    It's fun to work in a company where people truly BELIEVE in what they're doing!.We're looking for a Principal Sales Engineer who is not only passionate about technology but thrives on engaging with...Show more
    Last updated: 3 days ago • Promoted
    Plastics Engineer

    Plastics Engineer

    Diedre Moire Corp. • Farmington, MN, US
    Full-time
    Process Engineer Plastic Molding - Farmington, MN Plastics Engineer Process Engineer Manufacturing Engineer Project Engineer Plastic Molding Injection Mold Blow Extrusion Tooling Designer Moldmakin...Show more
    Last updated: 20 days ago • Promoted
    EHS Specialist

    EHS Specialist

    Pace Analytical Services, LLC • Cottage Grove, MN, United States
    Full-time +1
    Monday through Friday, 8 : 00 AM to 5 : 00 PM (Flexible).Are you ready to work making the world a safer, healthier place? Join our mission to continuously move science forward; to innovate and advance ...Show more
    Last updated: 30+ days ago • Promoted
    Part-Time Side Work - Earn on Top of Your Day Job

    Part-Time Side Work - Earn on Top of Your Day Job

    Finance Buzz • Forest Lake, Minnesota, US
    Part-time +1
    We’re looking for people interested in a part-time remote opportunity to supplement their main income.This position is ideal for professionals, freelancers, and anyone who wants to improve their fi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, Data Platform

    Senior Software Engineer, Data Platform

    Coinbase • St Paul, MN, United States
    Full-time
    Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineering Sr Con

    Data Engineering Sr Con

    Securian • Saint Paul, MN, United States
    Full-time
    Securian Financial Groups internal position title is Data Engineering Senior Consultant.Securian Financial offers an exciting opportunity for an experienced and passionate data professional eager t...Show more
    Last updated: 30+ days ago • Promoted
    Data Scientist (Kaggle-Grandmaster)

    Data Scientist (Kaggle-Grandmaster)

    Mercor • St. Paul, Minnesota, US
    Remote
    Full-time
    Role Description • • Mercor is hiring on behalf of a leading AI research lab to bring on a highly skilled • •Data Scientist • • with a • •Kaggle Grandmaster profile. In this role, you will transform compl...Show more
    Last updated: 10 hours ago • Promoted • New!
    Physician - Emergency Medicine

    Physician - Emergency Medicine

    Fairview Health Services • Wyoming, MN, United States
    Full-time
    Emergency Medicine Physician to join the Emergency Medicine Department at.Join a team of 15 Physicians and 7 APRNs / PAs. Fairview Lakes Medical Center is a 65 licensed bed facility and 24 bed ED.Depa...Show more
    Last updated: 30+ days ago • Promoted
    RN Float Pool

    RN Float Pool

    Monarch Healthcare Management • Chisago City, MN, United States
    Full-time
    Monarch Healthcare Management Benefits Include : .UKG Wallet - get paid the same day!.Career path to other positions within our growing company!. Current Float Pool positions are available in the foll...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Securian • Saint Paul, MN, United States
    Full-time
    At Securian Financial the internal title for this position is Infrastructure Sr.We have an exciting opportunity for a.In this role, you will design and implement data solutions that adhere to data ...Show more
    Last updated: 13 hours ago • Promoted • New!
    Data Engineer III

    Data Engineer III

    Old National Bank • St. Paul, MN, United States
    Full-time
    US-MN-Lake Elmo | US-IN-Evansville | US-IL-Chicago | US-IN-Indianapolis | US-MN-Saint Paul | US-MN-St Louis Park.Old National Bank has been serving clients and communities since 1834.With over $70 ...Show more
    Last updated: 30+ days ago • Promoted
    Medical Oncologist – Change the World One Patient at a time

    Medical Oncologist – Change the World One Patient at a time

    Mary Lanning Healthcare • Hastings, US
    Full-time
    Join a growing practice serving two communities (Grand Island and Hastings).Morrision Cancer Center comprehensive Service (Medical and Radiation Oncology). Build patient relationships that last a li...Show more
    Last updated: 30+ days ago • Promoted
    Telemedicine Physician

    Telemedicine Physician

    QuickMD • Columbus, MN, United States
    Full-time
    QuickMD is a leading telemedicine provider, delivering high-quality virtual care across 44 states.Since our founding in 2019, we have helped more than 100,000 patients access essential medical trea...Show more
    Last updated: 1 day ago • Promoted
    Senior Software Engineer - Big Data

    Senior Software Engineer - Big Data

    Oracle • St Paul, MN, United States
    Full-time
    Oracle's Cloud Infrastructure team is building new Infrastructure-as-a-Service technologies that operate at high scale in a broadly distributed multi-tenant cloud environment.Our customers run thei...Show more
    Last updated: 30+ days ago • Promoted
    Manufacturing Engineering Technician

    Manufacturing Engineering Technician

    Distinctive Staffing Solutions • Stacy, MN, US
    Full-time
    Quick Apply
    We are seeking a dedicated Manufacturing Engineering Technician to enhance our production processes.This role involves collaborating closely with Manufacturing Engineers and production teams to opt...Show more
    Last updated: 30+ days ago • Promoted
    Anesthesiologist : Balance Practice / Balanced Life

    Anesthesiologist : Balance Practice / Balanced Life

    Mary Lanning Healthcare • Hastings, US
    Full-time
    Mary Lanning Healthcare is seeking a physician to join their established practice.This group works with four Anesthesiologists and 12 CRNA's in a Collaborative Model.Shifts per year Required ...Show more
    Last updated: 30+ days ago • Promoted
    BCG Platinion | Principal Architect - AI

    BCG Platinion | Principal Architect - AI

    Boston Consulting Group • St Paul, MN, United States
    Full-time
    Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver | Detroit | Houston | Miami | Minneapolis | Nashville | Summit | New York | Philadelphia | Pittsburgh | Durham | Washington.Boston C...Show more
    Last updated: 5 hours ago • Promoted • New!
    Restaurant General Manager

    Restaurant General Manager

    Border Foods LLC • Forest Lake, Minnesota, US
    Part-time +1
    What began as an idea between two brothers to open a Mexican restaurant has since grown into one of the largest, privately held Taco Bell franchisees in America. At Border Foods, we work with a peop...Show more
    Last updated: 30+ days ago • Promoted