Talent.com
Data Engineer - III
Data Engineer - IIISoftware Guidance and Assistance, Inc. • San Francisco, CA, United States
Data Engineer - III

Data Engineer - III

Software Guidance and Assistance, Inc. • San Francisco, CA, United States
Hace más de 30 días
Tipo de contrato
  • A tiempo completo
Descripción del trabajo

Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer - III for a contract assignment with one of our premier Financial Services clients in San Francisco, CA .

Responsibilities :

  • Responsible for collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into actionable insights.
  • They will work across multiple platforms to ensure that data pipelines are scalable, repeatable, and secure, capable of serving multiple users.
  • Design, develop, and maintain robust and efficient data pipelines to ingest, transform, catalog, and deliver curated, trusted, and quality data from disparate sources into our Common Data Platform.
  • Actively participate in Agile rituals and follow Scaled Agile processes as set forth by the CDP Program team.
  • Deliver high-quality data products and services following Safe Agile Practices.
  • Proactively identify and resolve issues with data pipelines and analytical data stores.
  • Deploy monitoring and alerting for data pipelines and data stores, implementing auto-remediation where possible to ensure system availability and reliability.
  • Employ a security-first, testing, and automation strategy, adhering to data engineering best practices.
  • Collaborate with cross-functional teams, including product management, data scientists, analysts, and business stakeholders, to understand their data requirements and provide them with the necessary infrastructure and tools.
  • Keep up with the latest trends and technologies, evaluating and recommending new tools, frameworks, and technologies to improve data engineering processes and efficiencies.

Required Skills :

  • Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent experience.
  • 2+ years' experience with tools such as Databricks, Collibra, and Starburst.
  • 3+ years' experience with Python and PySpark.
  • Experience using Jupyter notebooks, including coding and unit testing.
  • Recent accomplishments working with relational and NoSQL data stores, methods, and approaches (STAR, Dimensional Modeling).
  • 2+ years of experience with a modern data stack (Object stores like S3, Spark, Airflow, Lakehouse architectures, real-time databases) and cloud data warehouses such as RedShift, Snowflake.
  • Overall data engineering experience across traditional ETL & Big Data, either on-prem or Cloud.
  • Data engineering experience in AWS (any CFS2 / EDS) highlighting the services / tools used.
  • Experience building end-to-end data pipelines to ingest and process unstructured and semi-structured data using Spark architecture.
  • Requires access to confidential supervisory information
  • #LI-HV1
  • SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission : to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values : customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

    SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.

    Crear una alerta de empleo para esta búsqueda

    Data Engineer Iii • San Francisco, CA, United States

    Ofertas relacionadas
    Data Engineer

    Data Engineer

    Veterans Sourcing Group LLC • Menlo Park, CA, United States
    A tiempo completo
    Menlo Park, CA - Hybrid 3 Days a Week Onsite.Open to Alpharetta, GA or Menlo Park, CA locations.Please put at the top of the resume which location the candidate is being considered for.Must be loca...Mostrar más
    Última actualización: hace 14 días • Oferta promocionada
    Solutions Engineer, Data Infra

    Solutions Engineer, Data Infra

    Foxglove Technologies Inc. • San Francisco, CA, United States
    A tiempo completo
    Robotics will have a massive positive impact on the world economy and global human productivity over the coming decade.At Foxglove, we're excited for this future, and we're building powerful open s...Mostrar más
    Última actualización: hace 14 días • Oferta promocionada
    Databricks Data Engineer

    Databricks Data Engineer

    Tekfortune Inc • San Francisco, CA, United States
    Indefinido
    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries.In this quickly ch...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Data Engineer

    Data Engineer

    META • Menlo Park, CA, United States
    A tiempo completo
    Meta), formerly known as Facebook Inc.When Facebook launched in 2004, it changed the way people connect.Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around t...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Data Engineer - III

    Data Engineer - III

    Varite • San Francisco, CA, United States
    Indefinido
    Design, develop, and maintain robust and efficient data pipelines to ingest, transform, catalog, and deliver curated, trusted, and quality data from disparate sources into our Common Data Platform....Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Data Engineer II - McKinsey Digital

    Data Engineer II - McKinsey Digital

    McKinsey & Company • San Francisco, CA, United States
    A tiempo completo
    Data Engineer II - McKinsey Digital.Do you want to work on complex and pressing challenges-the kind that bring together curious, ambitious, and determined leaders who strive to become better every ...Mostrar más
    Última actualización: hace 8 días • Oferta promocionada
    Data engineer

    Data engineer

    Tata Consultancy Services • San Francisco, CA, United States
    A tiempo completo
    Must Have Technical / Functional Skills.Proficiency in AWS ETL services (AWS Glue, S3, Redshift, Lambda, Step Functions). Strong SQL skills for data manipulation and querying.Experience with scripting...Mostrar más
    Última actualización: hace 19 días • Oferta promocionada
    Data Engineer, III

    Data Engineer, III

    Verily Life Sciences • San Bruno, CA, United States
    A tiempo completo
    Verily is a subsidiary of Alphabet that is using a data-driven approach to change the way people manage their health and the way healthcare is delivered. Launched from Google X in 2015, our purpose ...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Data Engineer-III

    Data Engineer-III

    Hire Talent • San Francisco, CA, United States
    A tiempo completo
    Job Title : Data Engineer - III.We are looking to hire a contractor to support data and analytics work for a start-up team at • • • that works on building a point of sale system that we sell to restau...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Data Engineer II / Senior Data Engineer

    Data Engineer II / Senior Data Engineer

    Circle • San Francisco, CA, United States
    A tiempo completo
    Circle is a financial technology company at the epicenter of the emerging internet of money, where value can finally travel like other digital data - globally, nearly instantly and less expensively...Mostrar más
    Última actualización: hace 19 días • Oferta promocionada
    Data Engineer III

    Data Engineer III

    Amazon • San Francisco, CA, United States
    A tiempo completo
    Design, develop, implement, test, document, and operate large-scale, high-volume, high-performance data structures for business intelligence analytics. Implement data structures using best practices...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Senior Data Engineer

    Senior Data Engineer

    PG Forsta • Emeryville, CA, United States
    A tiempo completo
    PG Forsta is the leading experience measurement, data analytics, and insights provider for complex industries-a status we earned over decades of deep partnership with clients to help them understan...Mostrar más
    Última actualización: hace 29 días • Oferta promocionada
    Software Engineer II, Data Engineering & Infrastructure

    Software Engineer II, Data Engineering & Infrastructure

    Aurora Innovation • San Francisco, CA, United States
    A tiempo completo
    Aurora's mission is to deliver the benefits of self-driving technology safely, quickly, and broadly.The Aurora Driver will create a new era in mobility and logistics, one that will bring a safer, m...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Solutions Engineer, Data Infra

    Solutions Engineer, Data Infra

    Foxglove • San Francisco, CA, United States
    A tiempo completo
    Robotics will have a massive positive impact on the world economy and global human productivity over the coming decade.At Foxglove, we're excited for this future, and we're building powerful open s...Mostrar más
    Última actualización: hace 7 días • Oferta promocionada
    Data Infrastructure Engineer II — Scale Data Pipelines

    Data Infrastructure Engineer II — Scale Data Pipelines

    Aurora • San Francisco, CA, United States
    A tiempo completo
    A pioneering technology company in San Francisco is seeking a skilled Software Engineer to enhance their data engineering and infrastructure team. In this role, you will design, build, and maintain ...Mostrar más
    Última actualización: hace 6 días • Oferta promocionada
    Senior AI & Data Platform Engineer (Onsite)

    Senior AI & Data Platform Engineer (Onsite)

    Icon Ventures • San Francisco, CA, United States
    A tiempo completo
    A leading technology firm in San Francisco is looking for a Staff AI & Data Platform Engineer to design and develop scalable machine learning infrastructure. This role involves cross-functional coll...Mostrar más
    Última actualización: hace 4 días • Oferta promocionada
    Platform Data Engineer

    Platform Data Engineer

    Ohalo • South San Francisco, CA, United States
    A tiempo completo
    Ohalo is seeking an experienced.This role involves building and maintaining data pipelines to support our machine learning engineering activities and managing data related to plant phenotypes and g...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Software Engineer III - Analytics

    Software Engineer III - Analytics

    Guidewire • San Mateo, CA, United States
    A tiempo completo +1
    Guidewire is widely recognized as the leading provider of software solutions for the property and casualty insurance industry. Our software empowers insurance companies to support their customers du...Mostrar más
    Última actualización: hace 15 días • Oferta promocionada