Talent.com
ETL Architect
ETL ArchitectDamco Solutions • Tampa, FL, United States
ETL Architect

ETL Architect

Damco Solutions • Tampa, FL, United States
1 day ago
Job type
  • Full-time
Job description

JobTitle : ETL Architect

Location : Tallahassee, FL

Duration : Long Term

Roles & Responsibilities

The Data Architects, under the working job title of Extract, Transform, Load (ETL) Architects, will serve as the principal line of communication for the project team. The ETL Architects will drive the development of data integration pipelines, enabling efficient, reliable access to critical data within the Correction Information Management System (CIMS) Data Warehouse / Data Lake on Azure. They will

work with Azure Data Factory (ADF), Azure Databricks, Azure Synapse, Power BI, and Azure Purview. The ETL Architects will be at the forefront of transforming complex data into actionable insights. The ETL Architects will be responsible for ensuring data integrity, security, and performance, all while

meeting mission-critical needs. The specific duties and responsibilities of this position are as follows :

ETL Pipeline Design and Development :

  • Lead the design and development of high-performing ETL processes to integrate and transform data across disparate sources;
  • Deliver efficient, reliable pipelines that meet business needs and maintain the highest standards of security; and
  • Utilize ADF to automate and streamline data workflows, ensuring smooth transitions from source to target.

Data Integration and Transformation :

  • Build and manage complex ETL workflows that extract, transform, and load data for downstream analytics and reporting, ensuring data is accurate, timely, and secure; and
  • Take ownership of data quality and validation, creating resilient ETL processes that ensure only trusted data reaches its destination.
  • Cloud Platform Expertise :

  • Leverage the full power of the Azure ecosystem-ADF, Databricks, Synapse, and Purview-to manage and process high volumes of structured and unstructured data, delivering solutions that are scalable and performance-optimized; and
  • Integrate large datasets into Azure Synapse Analytics, enabling analytics teams to deliver data-driven insights that support the Department's mission.
  • Performance Optimization :

  • Continuously optimize ETL jobs to minimize latency and maximize throughput; and
  • Ensure the architecture supports fast, reliable data access for end-users and systems, meeting stringent performance metrics.
  • Security and Compliance :

  • Embed security and compliance best practices in every step of the ETL process;.
  • Protect sensitive data by adhering to industry standards and ensuring compliance with the Department's data governance policies; and
  • Use Azure Purview to enforce data governance, track data lineage, and ensure that data handling meets the highest standards of integrity.
  • Collaboration and Stakeholder Engagement :

  • Partner with cross-functional teams (e.g., data engineers, analysts, business stakeholders, and security experts) to design and implement ETL solutions that meet the Department's evolving needs; and
  • ct as a technical leader and mentor, helping guide junior team members and providing expert guidance on data processing and transformation best practices.
  • Documentation and Best Practices :

  • Develop and maintain clear, detailed documentation for ETL processes, ensuring the team can consistently deliver high-quality, reliable solutions; and
  • Establish and enforce best practices for data handling, ETL development, and security, driving a culture of excellence and accountability.
  • Required Qualifications

    A bachelor's degree from an accredited college or university in Computer Science, Information Systems, or a related field is required. Alternatively, equivalent work experience, including experience in Service-Oriented Architecture (SOA) and Microsoft Azure Cloud Solutions, can be substituted for the educational requirement on a year-for-year basis, when applicable.

    The Department requires the following experience, skills, and knowledge for this position :

  • Seven (7) or more years of experience in ETL development and data engineering;
  • Three (3) or more years of hands-on experience working with ADF, Azure Cloud, Azure Databricks, Azure Synapse Analytics, and Azure Purview;
  • Proven track record of building and optimizing large-scale ETL pipelines for high-performance, high-availability environments;
  • Extensive expertise in Spark, Python, and / or Scala for large-scale data transformations;
  • Strong Structured Query Language (SQL) proficiency and experience working with complex data structures;
  • In-depth knowledge of data governance, security protocols, and role-based access control (RBAC) within the Azure ecosystem; and
  • bility to design ETL processes that are resilient, efficient, and fully compliant with regulatory standards.
  • Preferred Qualifications

    The Department prefers the Candidates to have the following experience, skills, and / or knowledge for this position :

  • Possession of a Microsoft Office Certification as an Azure Data Engineer Associate, Azure Solutions Architect Expert, and Azure Fundamentals; and
  • zure Databricks Certification as a Data Engineer Associate.
  • Create a job alert for this search

    Architect • Tampa, FL, United States

    Related jobs
    HP NonStop Cobol Developer - Local to Tampa, FL

    HP NonStop Cobol Developer - Local to Tampa, FL

    Noblesoft Solutions • St Petersburg, FL, United States
    Full-time
    HP NonStop Cobol Developer - Local to Tampa, FL.This job is posted by Noblesoft Solutions.Your actual pay will be based on your skills and experience discuss with your recruiter for more details.As...Show more
    Last updated: 1 day ago • Promoted
    ETL Developer

    ETL Developer

    Citigroup Inc • Tampa, FL, United States
    Full-time
    The ETL Developer is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the...Show more
    Last updated: 1 day ago • Promoted
    Process Optimization Analyst

    Process Optimization Analyst

    Climate First Bank • St. Petersburg, FL, United States
    Full-time
    We are changing FINANCE to finance CHANGE!.Climate First Bank is a Florida Benefit Corporation, state chartered, FDIC insured commercial bank. We are the first commercial bank with a mission of redu...Show more
    Last updated: 30+ days ago • Promoted
    Lead Implementation Specialist

    Lead Implementation Specialist

    Zelis Healthcare, LLC • St. Petersburg, FL, United States
    Full-time
    Zelis is modernizing the healthcare financial experience across payers, providers, and healthcare consumers.We serve more than 750 payers, including the top five national health plans, regional hea...Show more
    Last updated: 19 days ago • Promoted
    COBOL Developer

    COBOL Developer

    RIT Solutions, Inc. • Tampa, FL, United States
    Full-time
    Designs and develops solutions on the System i (AS / 400i (AS / 400) environment, utilizing expertise in a wide range of AS / 400 products, including RPG, COBOL / 400, SYNON, and new age offerings on the p...Show more
    Last updated: 30+ days ago • Promoted
    DB2 DBA / RPG Programmer

    DB2 DBA / RPG Programmer

    NPAworldwide • Tampa, FL, United States
    Full-time +1
    Full-time | Direct Hire | Remote Position - Working Eastern Time Hours.We seek a production DB2 DBA to manage DB2 databases on the IBM i for a large enterprise client. This is a remote position work...Show more
    Last updated: 1 day ago • Promoted
    EMI / TEMPEST Analysis Engineer (ONSITE)

    EMI / TEMPEST Analysis Engineer (ONSITE)

    Collins Aerospace • Largo, FL, US
    Full-time
    FL410 : Largo FL MFG 7887 Bryan Dairy Road , Largo, FL, 33777 USA.Person, or Immigration Status Requirements : .The ability to obtain and maintain a U. Raytheon Company, Managed by Collins Aerospace.Co...Show more
    Last updated: 1 day ago • Promoted
    DevSecOps Engineer

    DevSecOps Engineer

    Raft • Tampa, FL, United States
    Full-time
    All of the programs we support require.All work must be conducted within the continental U.Distributed Data Systems, Platforms at Scale, and Complex Application Development, with headquarters in Mc...Show more
    Last updated: 30+ days ago • Promoted
    DAS Project Manager

    DAS Project Manager

    VirtualVocations • Tampa, Florida, United States
    Full-time
    A company is looking for a DAS Project Manager to oversee public safety and cellular DAS projects across the Southeast region. Key Responsibilities Manage multiple DAS projects (public safety and ...Show more
    Last updated: 1 day ago • Promoted
    Intl- India- Senior HP Non-Stop / Cobol Developer

    Intl- India- Senior HP Non-Stop / Cobol Developer

    Insight Global • St Petersburg, FL, United States
    Full-time
    Petersburg, Florida is looking for a Senior NonStop / COBOL Developer in India.Participating in requirement gathering processes as well as working with some predefined requirements to work off of.Par...Show more
    Last updated: 13 hours ago • Promoted • New!
    Principal Firmware Engineer (ONSITE)

    Principal Firmware Engineer (ONSITE)

    Collins Aerospace • Largo, FL, US
    Full-time
    FL410 : Largo FL MFG 7887 Bryan Dairy Road , Largo, FL, 33777 USA.Person, or Immigration Status Requirements : .The ability to obtain and maintain a U. Raytheon Company, Managed by Collins Aerospace.Co...Show more
    Last updated: 1 day ago • Promoted
    California Licensed MERN Stack Developer

    California Licensed MERN Stack Developer

    VirtualVocations • Lakeland, Florida, United States
    Full-time
    A company is looking for a MERN / MEAN Stack Developer.Key Responsibilities : Develop websites using HTML, CSS, Node.Angular2+ Create, deploy, and maintain automated system tests while collaboratin...Show more
    Last updated: 5 days ago • Promoted
    PowerBI Architect - Reporting

    PowerBI Architect - Reporting

    RIT Solutions, Inc. • Tampa, FL, United States
    Full-time
    REQUIRED : PowerBI architect with DAX and Hospital / healthcare - recent-.Title- PowerBI Architect - Reporting.Power BI Design, Power BI modeling, and DAX experience is a must.BI Developers offshore, ...Show more
    Last updated: 30+ days ago • Promoted
    ETL Developer

    ETL Developer

    Citi • Tampa, FL, United States
    Full-time
    The ETL Developer is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the...Show more
    Last updated: 1 day ago • Promoted
    Systems Administrator

    Systems Administrator

    Leonardo DRS • Largo, FL, United States
    Full-time
    The Leonardo DRS Naval Electronics business provides leading naval computing infrastructure, network and data distribution and middleware enterprise services, as well as world-class manufacturing a...Show more
    Last updated: 12 days ago • Promoted
    Senior Mirth Integration Analyst

    Senior Mirth Integration Analyst

    VirtualVocations • Lakeland, Florida, United States
    Full-time
    Mirth Integration Analyst to join their team on a remote, contract basis.Key Responsibilities Develop and deploy channels using Mirth Connect for healthcare data integration Convert legacy data ...Show more
    Last updated: 4 days ago • Promoted
    Senior UX Researcher / Designer

    Senior UX Researcher / Designer

    VirtualVocations • Lakeland, Florida, United States
    Full-time
    A company is looking for a Senior UX Researcher / Designer to shape the user experience of a federal health platform.Key Responsibilities Conduct user research to uncover insights and translate the...Show more
    Last updated: 1 day ago • Promoted
    Dynamics 365 CRM Architect

    Dynamics 365 CRM Architect

    VirtualVocations • Lakeland, Florida, United States
    Full-time
    A company is looking for a Microsoft Dynamics 365 CRM Product Architect / Lead.Key Responsibilities Evaluate and optimize the existing Dynamics 365 environment and customizations Streamline work...Show more
    Last updated: 30+ days ago • Promoted