Talent.com
Data Engineer

Data Engineer

Software Guidance and Assistance, Inc.San Jose, CA, United States
3 days ago
Job type
  • Full-time
Job description

Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer for a CONTRACT assignment with one of our premier SaaS clients in San Jose, CA. This role is hybrid with 3 days onsite per week.

Responsibilities :

  • Design, develop, and maintain scalable and reliable data pipelines to support large-scale data processing.
  • Build and optimize data workflows using orchestration tools like Apache Airflow and Spark to support scheduled and event-driven ETL / ELT processes.
  • Implement complex parsing, cleansing, and transformation logic to normalize data from a variety of structured and unstructured sources.
  • Collaborate with data scientists, analysts, and application teams to integrate, test, and validate data products and pipelines.
  • Operate and maintain pipelines running on cloud platforms (AWS) and distributed compute environments (e.g., Databricks).
  • Monitor pipeline performance, perform root cause analysis, and troubleshoot failures to ensure high data quality and uptime.
  • Ensure proper security, compliance, and governance of data across systems and environments.
  • Contribute to the automation and standardization of data engineering processes to improve development velocity and operational efficiency.

Required Skills :

  • Proficient in Python and PySpark for data processing and scripting.
  • Strong experience with SQL for data manipulation and performance tuning.
  • Deep understanding of distributed data processing with Apache Spark.
  • Hands-on experience with Airflow or similar orchestration tools.
  • Experience with cloud services and data tools in AWS (e.g., S3, Lambda, SQS, Gateway, Networking).
  • Expertise with Databricks for collaborative data engineering and analytics.
  • Solid understanding of data modeling, data warehousing, and best practices in data pipeline architecture.
  • Strong problem-solving skills with the ability to work independently on complex tasks.
  • Familiarity with CI / CD practices and version control (e.g., Git) in data engineering workflows.
  • SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission : to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values : customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

    SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.

    Create a job alert for this search

    Data Engineer • San Jose, CA, United States

    Related jobs
    • Promoted
    Lead AI Data Engineer

    Lead AI Data Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Lead AI and Data Solution Engineer (LLMs, MCP).Key Responsibilities Lead the design, development, and deployment of enterprise-scale data and AI solutions Architect an...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Management Engineer

    Senior Data Management Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Senior Engineer, Data Management (Remote).Key Responsibilities Build and automate data ingestion, transformation, and aggregation pipelines Conduct complex data analys...Show moreLast updated: 2 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Principal Platform Data Engineer (Databricks Platform).Key Responsibilities Collaborate with stakeholders to translate business requirements into technical specificatio...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Data Engineer

    Staff Data Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Staff Data Engineer.Key Responsibilities Design and implement data pipelines and architectures Collaborate with cross-functional teams to optimize data usage Ensure d...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer II

    Senior Data Engineer II

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Senior Data Engineer II to join their data engineering team.Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks ...Show moreLast updated: 1 day ago
    • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for an EA-Data Pipeline.Key Responsibilities Process datasets from various data vendors and clients Identify and implement automation improvements for data processing Maint...Show moreLast updated: 30+ days ago
    • Promoted
    Data Cloud Solution Engineer

    Data Cloud Solution Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Solution Engineer, Data Cloud.Key Responsibilities Conduct in-person and web-based meetings to drive technical discovery and close opportunities Collaborate with Accou...Show moreLast updated: 2 days ago
    • Promoted
    Analytics Engineer

    Analytics Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for an Analytics Engineer II (REMOTE).Key Responsibilities Design and build data models and BI dashboards to solve business problems Collaborate with Agile teams to understa...Show moreLast updated: 30+ days ago
    • Promoted
    Snowflake Deployment Engineer

    Snowflake Deployment Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Snowflake Deployment Engineer to design, implement, and optimize Snowflake environments for data platforms. Key Responsibilities Lead the deployment, configuration, and ...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    VirtualVocationsSan Jose, California, United States
    Full-time
    A company is looking for a Data Engineer II.Key Responsibilities Produce high-quality data models and maintain data integrity for analytics products Develop scalable ELT pipelines and business i...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Lead Data Engineer to design, build, and manage enterprise-grade data pipelines.Key Responsibilities Design, develop, and optimize metadata-driven data pipelines in Fab...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Data Platform Engineer, Data Capture.Key Responsibilities Expand developer tools for capturing business events and operational data into the Lakehouse Enhance self-ser...Show moreLast updated: 30+ days ago
    • Promoted
    Data Governance Engineer

    Data Governance Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Data Governance Customer Engineer to assist enterprise customers in implementing Microsoft Purview across complex data environments. Key Responsibilities Guide customers...Show moreLast updated: 1 day ago
    • Promoted
    Data Warehouse Engineer

    Data Warehouse Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Data Warehouse Engineer III.Key Responsibilities Design, develop, and maintain scalable ELT workflows using Azure Data Factory, Fivetran, and dbt Partner with data ana...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VirtualVocationsSanta Clara, California, United States
    Full-time
    A company is looking for a Data Engineer to build, maintain, and optimize data pipelines for genealogy data products.Key Responsibilities Build and maintain scalable data pipelines for large gene...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for an AI Engineer who has experience architecting and shipping robust multi-agent systems in production. Key Responsibilities Design, develop, and deploy AI Coach capabilitie...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Senior Data Engineer to lead the data engineering function and enhance data capabilities.Key Responsibilities Design, build, and optimize data architecture, pipelines, ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer for AI

    Data Engineer for AI

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Data Engineer (AI Platforms).Key Responsibilities Design, build, and optimize scalable data pipelines and migrate from legacy systems to an AI-centric platform Evolve ...Show moreLast updated: 1 day ago
    • Promoted
    Data & AI Engineer

    Data & AI Engineer

    VirtualVocationsHayward, California, United States
    Full-time
    A company is looking for a Data / AI Engineer (Gen AI, LLM, ML).Key Responsibilities Design, build, and maintain robust data pipelines and workflows for healthcare data Develop, train, and deploy ...Show moreLast updated: 1 day ago
    • Promoted
    Data Retention Engineer

    Data Retention Engineer

    VirtualVocationsFremont, California, United States
    Full-time
    A company is looking for a Data Retention and Protection Engineer.Key Responsibilities Manage data classifiers and ensure data security and compliance Oversee the administration of security soft...Show moreLast updated: 3 days ago