Talent.com
Lead Data Engineer Hybrid

Lead Data Engineer Hybrid

V-Soft Consulting GroupSan Francisco, CA, United States
16 hours ago
Job type
  • Full-time
Job description

Lead Data Engineer (Hybrid)

Primary Location : San Francisco, California

V-Soft Consulting is currently hiring for a Lead Data Engineer for our premier client in San Francisco, California .

Education and Experience "

  • Data Engineer with 7-10 years of experience in building scalable, cloud-native data solutions.
  • Must have strong expertise in Google Cloud Platform (BigQuery, Composer (airflow) Dataflow, Data Pipeline, Pub / Sub, Cloud Storage, etc.), as well as solid skills in SQL, Python, and modern data modelling (medallion architecture, star schema).
  • Experience with data warehousing, orchestration (Airflow, Dataflow), ingestion via APIs and modern DevOps practices are expected.
  • Bachelor's degree in computer science, Engineering, or related field.
  • Proven experience as a Data Engineer with expertise in GCP.
  • Strong understanding of data warehousing concepts and ETL processes.
  • Experience with BigQuery, Dataflow, and other GCP data services.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration abilities.

Knowledge, Skills and Abilities "

  • Google Cloud Platform (GCP).
  • BigQuery.
  • Dataflow.
  • Data pipeline.
  • SQL.
  • Python.
  • ETL processes.
  • Data warehousing.
  • Data modeling.
  • Apache Beam.
  • Cloud Storage.
  • WHAT YOU'LL DO :

    Job Responsibilities :

  • Design and implement data ingestion, transformation, and orchestration pipelines.
  • Design, develop, and maintain data pipelines on GCP.
  • Ensure data integrity, scalability, security, and reliability.
  • Leverage CI / CD practices, test automation, and monitoring to ensure robust delivery.
  • Implement data storage solutions and optimize data processing workflows.
  • Ensure data quality and integrity throughout the data lifecycle.
  • Collaborate with data scientists and analysts to understand data requirements.
  • Monitor and maintain the health of the data infrastructure.
  • Troubleshoot and resolve data-related issues.
  • Stay updated with the latest GCP features and best practices.
  • Interested?

    Qualified candidates should send their resumes to kkomaravolu@vsoftconsulting.com

    V-Soft Consulting Group is recognized among the top 100 fastest growing staffing companies in North America, V-Soft Consulting Group is headquartered in Louisville, KY with strategic locations in India, Canada and the U.S. V-Soft is known as an agile, innovative technology services company holding several awards and distinctions and has a wide variety of partnerships across diverse technology stacks.

    As a valued V-Soft Consultant, you're eligible for full benefits (Medical, Dental, Vision), a 401(k) plan, competitive compensation and more. V-Soft is partnered with numerous Fortune 500 companies, exceptionally positioned to advance your career growth.

    V-Soft Consulting provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

    For more information or to view all our open jobs, please visit www.vsoftconsulting.com or call (844) 425-8425.

    #LI-KK1

    #INDSP

    #MonsterPost

    Create a job alert for this search

    Lead Data Engineer • San Francisco, CA, United States

    Related jobs
    • Promoted
    Senior AI & Data Platform Engineer

    Senior AI & Data Platform Engineer

    QuizletSan Francisco, CA, United States
    Full-time
    At Quizlet, our mission is to help every learner achieve their outcomes in the most effective and delightful way.Our $1B+ learning platform serves tens of millions of students every month, includin...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    ROKTSan Francisco, CA, United States
    Full-time
    We are Rokt, a hyper-growth ecommerce leader.Rokt is the global leader in ecommerce, unlocking real-time relevance in the moment that matters most. Rokt’s AI Brain and ecommerce Network powers billi...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    GENIES INCSan Francisco, CA, United States
    Full-time
    Genies is an AI avatar and games technology company powering the next generation of digital experiences through Smart Avatars. Genies' technology stack is rooted in empowering user generated content...Show moreLast updated: 4 hours ago
    • Promoted
    Data Engineer, Analytics

    Data Engineer, Analytics

    OpenAISan Francisco, CA, United States
    Full-time
    The Applied team works across research, engineering, product, and design to bring OpenAI’s technology to consumers and businesses. We seek to learn from deployment and distribute the benefits of AI,...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Lead Engineer - Remote : Decentralized Data Layer & AI

    Lead Engineer - Remote : Decentralized Data Layer & AI

    PlaceholderSan Francisco, CA, US
    Remote
    Full-time
    A leading decentralized technology firm in California seeks an experienced Software Engineer to spearhead innovations in data management. You will expand software functionalities, lead a growing eng...Show moreLast updated: 16 hours ago
    • Promoted
    • New!
    Senior ML Data Engineer

    Senior ML Data Engineer

    MidjourneySan Francisco, CA, United States
    Full-time
    Were the data team behind Midjourney's image generation models.We handle the dataset side : processing, filtering, scoring, captioning, and all the distributed compute that makes high-quality traini...Show moreLast updated: 4 hours ago
    • Promoted
    Senior / Lead Data Solution Engineer

    Senior / Lead Data Solution Engineer

    MeltwaterRedwood City, CA, United States
    Full-time
    We're thrilled to embark on the search for a seasoned.Senior / Lead Data Solution Engineer.This pivotal role offers an exciting opportunity to shape the future of technology within our organization.A...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Database Engineer

    Principal Database Engineer

    Informatica LLCRedwood City, CA, United States
    Full-time
    Build Your Career at Informatica.We seek innovative thinkers who believe in the power of data to drive meaningful change. At Informatica, we welcome adventurous minds eager to solve the world's most...Show moreLast updated: 17 days ago
    • Promoted
    • New!
    Senior Data Engineer - Growth Data Pipelines

    Senior Data Engineer - Growth Data Pipelines

    MixpanelSan Francisco, CA, US
    Full-time
    A leading analytics platform provider in San Francisco is seeking a Data Engineer to collaborate with teams in Data Science, Product, and Finance. The ideal candidate has a strong background in both...Show moreLast updated: 16 hours ago
    • Promoted
    • New!
    Lead Engineer

    Lead Engineer

    PlaceholderSan Francisco, CA, United States
    Full-time
    Filecoin ecosystem leads from Protocol Labs have taken the opportunity to address the biggest pain points of using decentralized storage by. Software Expansion : Strategically expand and refine softw...Show moreLast updated: 22 hours ago
    • Promoted
    Data Engineer, Data Lake & Governance

    Data Engineer, Data Lake & Governance

    GridwareSan Francisco, CA, United States
    Full-time
    Get AI-powered advice on this job and more exclusive features.Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid.We pioneered a groundbre...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    Solutions Engineer, Data Infra

    Solutions Engineer, Data Infra

    FoxgloveSan Francisco, CA, United States
    Full-time
    Robotics will have a massive positive impact on the world economy and global human productivity over the coming decade.At Foxglove, we're excited for this future, and we're building powerful open s...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    iO AssociatesSan Francisco, CA, United States
    Full-time
    Job Title : Senior Data Engineer.Our Client is a leading company in the technology industry, dedicated to innovation, growth, and creating a dynamic work culture. With a strong reputation for excelle...Show moreLast updated: 14 hours ago
    • Promoted
    Analytics Data Engineer

    Analytics Data Engineer

    OpenAISan Francisco, CA, United States
    Full-time
    The Applied team works across research, engineering, product, and design to bring OpenAI's technology to consumers and businesses. We seek to learn from deployment and distribute the benefits of AI,...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    Lead Engineer — Remote : Decentralized Data Layer & AI

    Lead Engineer — Remote : Decentralized Data Layer & AI

    PlaceholderSan Francisco, CA, United States
    Remote
    Full-time
    A leading decentralized technology firm in California seeks an experienced Software Engineer to spearhead innovations in data management. You will expand software functionalities, lead a growing eng...Show moreLast updated: 22 hours ago
    • Promoted
    • New!
    Senior AI & Data Platform Engineer

    Senior AI & Data Platform Engineer

    Icon VenturesSan Francisco, CA, United States
    Full-time
    At Quizlet, our mission is to help every learner achieve their outcomes in the most effective and delightful way.Our $1B+ learning platform serves tens of millions of students every month, includin...Show moreLast updated: 3 hours ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Crustdata (YC F24)San Francisco, CA, United States
    Full-time
    This range is provided by Crustdata (YC F24).Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. We are looking for a foundational member of our eng...Show moreLast updated: 2 days ago
    • Promoted
    Databricks Data Engineer - Senior - Consulting - Location Open

    Databricks Data Engineer - Senior - Consulting - Location Open

    EYSan Francisco, CA, United States
    Full-time
    At EY, we’re all in to shape your future with confidence.We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...Show moreLast updated: 30+ days ago