Talent.com
Data Engineer - III
Data Engineer - IIISoftware Guidance and Assistance, Inc. • San Francisco, CA, United States
Data Engineer - III

Data Engineer - III

Software Guidance and Assistance, Inc. • San Francisco, CA, United States
30+ days ago
Job type
  • Full-time
Job description

Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer - III for a contract assignment with one of our premier Financial Services clients in San Francisco, CA .

Responsibilities :

  • Responsible for collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into actionable insights.
  • They will work across multiple platforms to ensure that data pipelines are scalable, repeatable, and secure, capable of serving multiple users.
  • Design, develop, and maintain robust and efficient data pipelines to ingest, transform, catalog, and deliver curated, trusted, and quality data from disparate sources into our Common Data Platform.
  • Actively participate in Agile rituals and follow Scaled Agile processes as set forth by the CDP Program team.
  • Deliver high-quality data products and services following Safe Agile Practices.
  • Proactively identify and resolve issues with data pipelines and analytical data stores.
  • Deploy monitoring and alerting for data pipelines and data stores, implementing auto-remediation where possible to ensure system availability and reliability.
  • Employ a security-first, testing, and automation strategy, adhering to data engineering best practices.
  • Collaborate with cross-functional teams, including product management, data scientists, analysts, and business stakeholders, to understand their data requirements and provide them with the necessary infrastructure and tools.
  • Keep up with the latest trends and technologies, evaluating and recommending new tools, frameworks, and technologies to improve data engineering processes and efficiencies.

Required Skills :

  • Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent experience.
  • 2+ years' experience with tools such as Databricks, Collibra, and Starburst.
  • 3+ years' experience with Python and PySpark.
  • Experience using Jupyter notebooks, including coding and unit testing.
  • Recent accomplishments working with relational and NoSQL data stores, methods, and approaches (STAR, Dimensional Modeling).
  • 2+ years of experience with a modern data stack (Object stores like S3, Spark, Airflow, Lakehouse architectures, real-time databases) and cloud data warehouses such as RedShift, Snowflake.
  • Overall data engineering experience across traditional ETL & Big Data, either on-prem or Cloud.
  • Data engineering experience in AWS (any CFS2 / EDS) highlighting the services / tools used.
  • Experience building end-to-end data pipelines to ingest and process unstructured and semi-structured data using Spark architecture.
  • Requires access to confidential supervisory information
  • #LI-HV1
  • SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission : to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values : customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

    SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.

    Create a job alert for this search

    Data Engineer Iii • San Francisco, CA, United States

    Related jobs
    Databricks Data Engineer

    Databricks Data Engineer

    Tekfortune Inc • San Francisco, CA, United States
    Permanent
    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries.In this quickly ch...Show more
    Last updated: 30+ days ago • Promoted
    Solutions Engineer, Data Infra

    Solutions Engineer, Data Infra

    Foxglove Technologies Inc. • San Francisco, CA, United States
    Full-time
    Robotics will have a massive positive impact on the world economy and global human productivity over the coming decade.At Foxglove, we're excited for this future, and we're building powerful open s...Show more
    Last updated: 14 days ago • Promoted
    Platform Engineer (Data) - TrueMeter

    Platform Engineer (Data) - TrueMeter

    Matter Intelligence • San Francisco, CA, United States
    Full-time
    San Francisco Bay Area | Hybrid (3 Days Onsite, 2 Days Remote).AI Energy Agent that is becoming the default way any business pays for power. Power bills are growing 3x faster than inflation, our gri...Show more
    Last updated: 12 days ago • Promoted
    Senior Director, Data and AI Architecture Leader

    Senior Director, Data and AI Architecture Leader

    Dynavax Technologies • Emeryville, CA, United States
    Full-time
    This position can be 100% remote, but must be located in the United States.Dynavax is a commercial-stage biopharmaceutical company developing and commercializing novel vaccines to help protect the ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - III

    Data Engineer - III

    Varite • San Francisco, CA, United States
    Permanent
    Design, develop, and maintain robust and efficient data pipelines to ingest, transform, catalog, and deliver curated, trusted, and quality data from disparate sources into our Common Data Platform....Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer II - McKinsey Digital

    Data Engineer II - McKinsey Digital

    McKinsey & Company • San Francisco, CA, United States
    Full-time
    Data Engineer II - McKinsey Digital.Do you want to work on complex and pressing challenges-the kind that bring together curious, ambitious, and determined leaders who strive to become better every ...Show more
    Last updated: 8 days ago • Promoted
    Senior Data Engineer (1043)

    Senior Data Engineer (1043)

    City and County of San Francisco • San Francisco, California, USA
    Full-time
    DataSF is seeking a Senior Data Engineer with 3 years of experience to join our growing team.Reporting to the Principal Data Engineer you will be instrumental in designing building and maintaining ...Show more
    Last updated: 9 days ago • Promoted
    Data Engineer, III

    Data Engineer, III

    Verily Life Sciences • San Bruno, CA, United States
    Full-time
    Verily is a subsidiary of Alphabet that is using a data-driven approach to change the way people manage their health and the way healthcare is delivered. Launched from Google X in 2015, our purpose ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer-III

    Data Engineer-III

    Hire Talent • San Francisco, CA, United States
    Full-time
    Job Title : Data Engineer - III.We are looking to hire a contractor to support data and analytics work for a start-up team at • • • that works on building a point of sale system that we sell to restau...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer II / Senior Data Engineer

    Data Engineer II / Senior Data Engineer

    Circle • San Francisco, CA, United States
    Full-time
    Circle is a financial technology company at the epicenter of the emerging internet of money, where value can finally travel like other digital data - globally, nearly instantly and less expensively...Show more
    Last updated: 18 days ago • Promoted
    Data Platform Engineer II : Pipelines & Cloud Infra

    Data Platform Engineer II : Pipelines & Cloud Infra

    Australian Competition and Consumer Commission • San Francisco, CA, United States
    Full-time
    A leading technology firm in San Francisco is seeking a talented Software Engineer to join its data engineering and infrastructure team. You will design and build scalable data pipelines and manage ...Show more
    Last updated: 16 hours ago • Promoted • New!
    Data Engineer III

    Data Engineer III

    Amazon • San Francisco, CA, United States
    Full-time
    Design, develop, implement, test, document, and operate large-scale, high-volume, high-performance data structures for business intelligence analytics. Implement data structures using best practices...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer II, Data Engineering & Infrastructure

    Software Engineer II, Data Engineering & Infrastructure

    Aurora Innovation • San Francisco, CA, United States
    Full-time
    Aurora's mission is to deliver the benefits of self-driving technology safely, quickly, and broadly.The Aurora Driver will create a new era in mobility and logistics, one that will bring a safer, m...Show more
    Last updated: 30+ days ago • Promoted
    Data Infrastructure Engineer II — Scale Data Pipelines

    Data Infrastructure Engineer II — Scale Data Pipelines

    Aurora • San Francisco, CA, United States
    Full-time
    A pioneering technology company in San Francisco is seeking a skilled Software Engineer to enhance their data engineering and infrastructure team. In this role, you will design, build, and maintain ...Show more
    Last updated: 5 days ago • Promoted
    Solutions Engineer, Data Infra

    Solutions Engineer, Data Infra

    Foxglove • San Francisco, CA, United States
    Full-time
    Robotics will have a massive positive impact on the world economy and global human productivity over the coming decade.At Foxglove, we're excited for this future, and we're building powerful open s...Show more
    Last updated: 7 days ago • Promoted
    Production Planner III

    Production Planner III

    Bio-Rad Laboratories • Richmond, CA, United States
    Full-time
    Richmond Chemical Plant that produces process chromatography resins, liquid buffers, monomer solutions, oils, and other specialized life science products. The Richmond Chemical plant has over 3000 S...Show more
    Last updated: 10 days ago • Promoted
    Software Engineer III - Analytics

    Software Engineer III - Analytics

    Guidewire • San Mateo, CA, United States
    Full-time +1
    Guidewire is widely recognized as the leading provider of software solutions for the property and casualty insurance industry. Our software empowers insurance companies to support their customers du...Show more
    Last updated: 14 days ago • Promoted
    Senior Data Engineer, Data Lakehouse Infrastructure

    Senior Data Engineer, Data Lakehouse Infrastructure

    TRM Labs • San Francisco, CA, United States
    Part-time
    Senior Software Engineer - Data Lakehouse Infrastructure.Senior Software Engineer - Data Lakehouse Infrastructure.Be among the first 25 applicants. Get AI-powered advice on this job and more exclusi...Show more
    Last updated: 30+ days ago • Promoted