Talent.com
Data Engineer - III
Data Engineer - IIISoftware Guidance and Assistance, Inc. • San Francisco, CA, United States
Data Engineer - III

Data Engineer - III

Software Guidance and Assistance, Inc. • San Francisco, CA, United States
30+ days ago
Job type
  • Full-time
Job description

Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer - III for a contract assignment with one of our premier Financial Services clients in San Francisco, CA .

Responsibilities :

  • Responsible for collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into actionable insights.
  • They will work across multiple platforms to ensure that data pipelines are scalable, repeatable, and secure, capable of serving multiple users.
  • Design, develop, and maintain robust and efficient data pipelines to ingest, transform, catalog, and deliver curated, trusted, and quality data from disparate sources into our Common Data Platform.
  • Actively participate in Agile rituals and follow Scaled Agile processes as set forth by the CDP Program team.
  • Deliver high-quality data products and services following Safe Agile Practices.
  • Proactively identify and resolve issues with data pipelines and analytical data stores.
  • Deploy monitoring and alerting for data pipelines and data stores, implementing auto-remediation where possible to ensure system availability and reliability.
  • Employ a security-first, testing, and automation strategy, adhering to data engineering best practices.
  • Collaborate with cross-functional teams, including product management, data scientists, analysts, and business stakeholders, to understand their data requirements and provide them with the necessary infrastructure and tools.
  • Keep up with the latest trends and technologies, evaluating and recommending new tools, frameworks, and technologies to improve data engineering processes and efficiencies.

Required Skills :

  • Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent experience.
  • 2+ years' experience with tools such as Databricks, Collibra, and Starburst.
  • 3+ years' experience with Python and PySpark.
  • Experience using Jupyter notebooks, including coding and unit testing.
  • Recent accomplishments working with relational and NoSQL data stores, methods, and approaches (STAR, Dimensional Modeling).
  • 2+ years of experience with a modern data stack (Object stores like S3, Spark, Airflow, Lakehouse architectures, real-time databases) and cloud data warehouses such as RedShift, Snowflake.
  • Overall data engineering experience across traditional ETL & Big Data, either on-prem or Cloud.
  • Data engineering experience in AWS (any CFS2 / EDS) highlighting the services / tools used.
  • Experience building end-to-end data pipelines to ingest and process unstructured and semi-structured data using Spark architecture.
  • Requires access to confidential supervisory information
  • #LI-HV1
  • SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission : to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values : customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

    SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.

    Create a job alert for this search

    Data Engineer Iii • San Francisco, CA, United States

    Related jobs
    Data Engineer

    Data Engineer

    Veterans Sourcing Group LLC • Menlo Park, CA, United States
    Full-time
    Menlo Park, CA - Hybrid 3 Days a Week Onsite.Open to Alpharetta, GA or Menlo Park, CA locations.Please put at the top of the resume which location the candidate is being considered for.Must be loca...Show more
    Last updated: 14 days ago • Promoted
    Solutions Engineer, Data Infra

    Solutions Engineer, Data Infra

    Foxglove Technologies Inc. • San Francisco, CA, United States
    Full-time
    Robotics will have a massive positive impact on the world economy and global human productivity over the coming decade.At Foxglove, we're excited for this future, and we're building powerful open s...Show more
    Last updated: 14 days ago • Promoted
    Data Engineer - III

    Data Engineer - III

    Varite • San Francisco, CA, United States
    Permanent
    Design, develop, and maintain robust and efficient data pipelines to ingest, transform, catalog, and deliver curated, trusted, and quality data from disparate sources into our Common Data Platform....Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer II - McKinsey Digital

    Data Engineer II - McKinsey Digital

    McKinsey & Company • San Francisco, CA, United States
    Full-time
    Data Engineer II - McKinsey Digital.Do you want to work on complex and pressing challenges-the kind that bring together curious, ambitious, and determined leaders who strive to become better every ...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Engineer (1043)

    Senior Data Engineer (1043)

    City and County of San Francisco • San Francisco, California, USA
    Full-time
    DataSF is seeking a Senior Data Engineer with 3 years of experience to join our growing team.Reporting to the Principal Data Engineer you will be instrumental in designing building and maintaining ...Show more
    Last updated: 9 days ago • Promoted
    Data Engineer

    Data Engineer

    Apptad Inc • Menlo Park, California, USA
    Full-time
    Prior Meta Must have prior Meta experience.Must have following information while sharing CVs.Please ensure below information is procured ( same is updated in the Beeline request to ) kindly fill...Show more
    Last updated: 14 days ago • Promoted
    Data Engineer, III

    Data Engineer, III

    Verily Life Sciences • San Bruno, CA, United States
    Full-time
    Verily is a subsidiary of Alphabet that is using a data-driven approach to change the way people manage their health and the way healthcare is delivered. Launched from Google X in 2015, our purpose ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer-III

    Data Engineer-III

    Hire Talent • San Francisco, CA, United States
    Full-time
    Job Title : Data Engineer - III.We are looking to hire a contractor to support data and analytics work for a start-up team at • • • that works on building a point of sale system that we sell to restau...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer II / Senior Data Engineer

    Data Engineer II / Senior Data Engineer

    Circle • San Francisco, CA, United States
    Full-time
    Circle is a financial technology company at the epicenter of the emerging internet of money, where value can finally travel like other digital data - globally, nearly instantly and less expensively...Show more
    Last updated: 18 days ago • Promoted
    Data Platform Engineer II : Pipelines & Cloud Infra

    Data Platform Engineer II : Pipelines & Cloud Infra

    Australian Competition and Consumer Commission • San Francisco, CA, United States
    Full-time
    A leading technology firm in San Francisco is seeking a talented Software Engineer to join its data engineering and infrastructure team. You will design and build scalable data pipelines and manage ...Show more
    Last updated: 13 hours ago • Promoted • New!
    Data Engineer III

    Data Engineer III

    Amazon • San Francisco, CA, United States
    Full-time
    Design, develop, implement, test, document, and operate large-scale, high-volume, high-performance data structures for business intelligence analytics. Implement data structures using best practices...Show more
    Last updated: 30+ days ago • Promoted
    Staff Data Infra Engineer — Petabyte-Scale Robotics Pipelines

    Staff Data Infra Engineer — Petabyte-Scale Robotics Pipelines

    Watneyrobotics • San Francisco, CA, United States
    Full-time
    A cutting-edge robotics company in San Francisco is seeking an experienced software engineer to architect and build robust petabyte-scale data pipelines. Ideal candidates will have 7+ years of softw...Show more
    Last updated: 7 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    PG Forsta • Emeryville, CA, United States
    Full-time
    PG Forsta is the leading experience measurement, data analytics, and insights provider for complex industries-a status we earned over decades of deep partnership with clients to help them understan...Show more
    Last updated: 29 days ago • Promoted
    Software Engineer II, Data Engineering & Infrastructure

    Software Engineer II, Data Engineering & Infrastructure

    Aurora Innovation • San Francisco, CA, United States
    Full-time
    Aurora's mission is to deliver the benefits of self-driving technology safely, quickly, and broadly.The Aurora Driver will create a new era in mobility and logistics, one that will bring a safer, m...Show more
    Last updated: 30+ days ago • Promoted
    Solutions Engineer, Data Infra

    Solutions Engineer, Data Infra

    Foxglove • San Francisco, CA, United States
    Full-time
    Robotics will have a massive positive impact on the world economy and global human productivity over the coming decade.At Foxglove, we're excited for this future, and we're building powerful open s...Show more
    Last updated: 7 days ago • Promoted
    Data Platform Engineer III — Lakehouse & Analytics Leader

    Data Platform Engineer III — Lakehouse & Analytics Leader

    GlossGenius • San Francisco, CA, United States
    Full-time
    A tech company in New York is seeking an experienced Software Engineer III for their Data Platform to reimagine their data infrastructure supporting an AI platform. The role requires 5+ years in dat...Show more
    Last updated: 1 day ago • Promoted
    Data Infrastructure Engineer II — Scale Data Pipelines

    Data Infrastructure Engineer II — Scale Data Pipelines

    Aurora • San Francisco, CA, United States
    Full-time
    A pioneering technology company in San Francisco is seeking a skilled Software Engineer to enhance their data engineering and infrastructure team. In this role, you will design, build, and maintain ...Show more
    Last updated: 5 days ago • Promoted
    Software Engineer III - Analytics

    Software Engineer III - Analytics

    Guidewire • San Mateo, CA, United States
    Full-time +1
    Guidewire is widely recognized as the leading provider of software solutions for the property and casualty insurance industry. Our software empowers insurance companies to support their customers du...Show more
    Last updated: 14 days ago • Promoted