Talent.com
Data Engineer - III

Data Engineer - III

Software Guidance and Assistance, Inc.San Francisco, CA, United States
1 day ago
Job type
  • Full-time
Job description

Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer - III for a contract assignment with one of our premier Financial Services clients in San Francisco, CA .

Responsibilities :

  • Responsible for collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into actionable insights.
  • They will work across multiple platforms to ensure that data pipelines are scalable, repeatable, and secure, capable of serving multiple users.
  • Design, develop, and maintain robust and efficient data pipelines to ingest, transform, catalog, and deliver curated, trusted, and quality data from disparate sources into our Common Data Platform.
  • ctively participate in Agile rituals and follow Scaled Agile processes as set forth by the CDP Program team.
  • Deliver high-quality data products and services following Safe Agile Practices.
  • Proactively identify and resolve issues with data pipelines and analytical data stores.
  • Deploy monitoring and alerting for data pipelines and data stores, implementing auto-remediation where possible to ensure system availability and reliability.
  • Employ a security-first, testing, and automation strategy, adhering to data engineering best practices.
  • Collaborate with cross-functional teams, including product management, data scientists, analysts, and business stakeholders, to understand their data requirements and provide them with the necessary infrastructure and tools.
  • Keep up with the latest trends and technologies, evaluating and recommending new tools, frameworks, and technologies to improve data engineering processes and efficiencies.

Required Skills :

  • Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent experience.
  • 2+ years' experience with tools such as Databricks, Collibra, and Starburst.
  • 3+ years' experience with Python and PySpark.
  • Experience using Jupyter notebooks, including coding and unit testing.
  • Recent accomplishments working with relational and NoSQL data stores, methods, and approaches (STAR, Dimensional Modeling).
  • 2+ years of experience with a modern data stack (Object stores like S3, Spark, Airflow, Lakehouse architectures, real-time databases) and cloud data warehouses such as RedShift, Snowflake.
  • Overall data engineering experience across traditional ETL & Big Data, either on-prem or Cloud.
  • Data engineering experience in AWS (any CFS2 / EDS) highlighting the services / tools used.
  • Experience building end-to-end data pipelines to ingest and process unstructured and semi-structured data using Spark architecture.
  • Requires access to confidential supervisory information
  • SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission : to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values : customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

    SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.

    Create a job alert for this search

    Data Engineer Iii • San Francisco, CA, United States

    Related jobs
    • Promoted
    Data Engineer II

    Data Engineer II

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Data Engineer II.Key Responsibilities Produce high-quality data models and maintain data integrity for analytics products Develop scalable ELT pipelines and business i...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Scale AI, Inc.San Francisco, CA, United States
    Full-time
    Software is eating the world, but AI is eating software.We live in unprecedented times - AI has the potential to exponentially augment human intelligence. Every person will have a personal tutor, co...Show moreLast updated: 30+ days ago
    • Promoted
    Lead AI Data Engineer

    Lead AI Data Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Lead AI and Data Solution Engineer (LLMs, MCP).Key Responsibilities Lead the design, development, and deployment of enterprise-scale data and AI solutions Architect an...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer II

    Software Engineer II

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Software Engineer II to tackle complex internet challenges and innovate customer-facing systems. Key Responsibilities Design and develop highly scalable software for cus...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    VirtualVocationsOakland, California, United States
    Full-time
    A company is looking for a Data Platform Engineer, Data Capture.Key Responsibilities Expand developer tools for capturing business events and operational data into the Lakehouse Enhance self-ser...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Lead Data Engineer to design, build, and manage enterprise-grade data pipelines.Key Responsibilities Design, develop, and optimize metadata-driven data pipelines in Fab...Show moreLast updated: 30+ days ago
    • Promoted
    Data Scientist II

    Data Scientist II

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Data Scientist II to support product, leadership, and clinical teams through data analysis and optimization methods. Key Responsibilities Gather business requirements an...Show moreLast updated: 30+ days ago
    • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for an EA-Data Pipeline.Key Responsibilities Process datasets from various data vendors and clients Identify and implement automation improvements for data processing Maint...Show moreLast updated: 30+ days ago
    • Promoted
    Data & AI Engineer

    Data & AI Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Data / AI Engineer (Gen AI, LLM, ML).Key Responsibilities Design, build, and maintain robust data pipelines and workflows for healthcare data Develop, train, and deploy ...Show moreLast updated: 1 day ago
    • Promoted
    Data Cloud Solution Engineer

    Data Cloud Solution Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Solution Engineer, Data Cloud.Key Responsibilities Conduct in-person and web-based meetings to drive technical discovery and close opportunities Collaborate with Accou...Show moreLast updated: 2 days ago
    • Promoted
    Data Analyst III

    Data Analyst III

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Data Analyst III responsible for handling complex data projects and leading other Data Analysts. Key Responsibilities Provide advanced analytical support for business op...Show moreLast updated: 30+ days ago
    • Promoted
    Data Warehouse Engineer

    Data Warehouse Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Data Warehouse Engineer III.Key Responsibilities Design, develop, and maintain scalable ELT workflows using Azure Data Factory, Fivetran, and dbt Partner with data ana...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsSanta Clara, California, United States
    Full-time
    A company is looking for a Senior Data Engineer to lead the data engineering function and enhance data capabilities.Key Responsibilities Design, build, and optimize data architecture, pipelines, ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Data Engineer to build, maintain, and optimize data pipelines for genealogy data products.Key Responsibilities Build and maintain scalable data pipelines for large gene...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer III

    Software Engineer III

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Software Engineer III.Key Responsibilities Develop business workflows using JBPM in XML and API endpoints using Apache Camel XML DSL Debug and troubleshoot software, c...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Data Engineer

    Staff Data Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Staff Data Engineer.Key Responsibilities Design and implement data pipelines and architectures Collaborate with cross-functional teams to optimize data usage Ensure d...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer II

    Senior Data Engineer II

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Senior Data Engineer II to join their data engineering team.Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks ...Show moreLast updated: 1 day ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    VirtualVocationsConcord, California, United States
    Full-time
    A company is looking for a Principal Platform Data Engineer (Databricks Platform).Key Responsibilities Collaborate with stakeholders to translate business requirements into technical specificatio...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer for AI

    Data Engineer for AI

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Data Engineer (AI Platforms).Key Responsibilities Design, build, and optimize scalable data pipelines and migrate from legacy systems to an AI-centric platform Evolve ...Show moreLast updated: 1 day ago
    • Promoted
    Business Data Analyst II

    Business Data Analyst II

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for an IT - Business Data Analyst II.Key Responsibilities Conduct data analysis and support data governance initiatives Create and maintain data governance scorecards and do...Show moreLast updated: 3 days ago