Talent.com
Big Data Engineer
Big Data EngineerOpenkyber • CA, United States
Big Data Engineer

Big Data Engineer

Openkyber • CA, United States
7 hours ago
Job type
  • Full-time
  • Quick Apply
Job description

Position : Senior Big Data Engineer Location : Costa Mesa, CA Duration : 12+ Months Our team is responsible of dealing with huge amount of data and also have an integration from various systems, create a required pipeline, and schedule, also team is dealing with steaming data for Realtime applications.

What you will do here :

  • Design & build all batch / Realtime components / data pipelines lines / integrations for our MLOps platform on AWS.
  • Collaborate with geographically distributed cross-functional teams.
  • Participate in on-call rotation with the rest of the team to handle production incidents.

About the Role :

  • Big Data Experience 4+ years experience.
  • Strong in Python / SCALA / Java programming
  • Strong understanding / experience in SPARK.
  • Good exposure on Kafka / streaming.
  • AWS Experience is a must EMR, ECS, Elastic Search, S3, Cloud Watch, Lambda, Step Functions,
  • Good communication skills to work with various stakeholders on operational support work
  • DEVOPS Experience is a must CI / CD, Jenkins Build, Docker, ECR Repo

    • Nice to have skills :

  • Experience with AWS
  • Experience Terraform is good to have.
  • Experience with various Python packaging options such as Wheel, PEX or Conda.
  • Experience with various automated testing framework is plus.
    • Create a job alert for this search

    Big Data Engineer • CA, United States

    Related jobs
    Power Generation Project Engineer

    Power Generation Project Engineer

    Pacific Gas and Electric Company • Auberry, CA, United States
    Full-time
    Job Category : Power Generation; Engineering / Science.Job Level : Individual Contributor.Business Unit : Operations - Other. Power Generation operates and maintains PG&E's hydroelectric, fossil, solar...Show more
    Last updated: 11 days ago • Promoted
    Field Artillery Recruit

    Field Artillery Recruit

    United States Army • Auberry, CA, US
    Part-time +1
    Field Artillery Recruit Now Hiring Full and Part Time Positions Job Overview : Your role is vital in defending our country and ensuring victory on the battlefield. As a Field Artillery Specialist, yo...Show more
    Last updated: 30+ days ago • Promoted
    Data Integration Engineer

    Data Integration Engineer

    Openkyber • CA, United States
    Full-time
    Quick Apply
    Description : Hybrid | Los Angeles, CA The Integration Team Lead is responsible for planning, coordinating, and executing system an...Show more
    Last updated: 18 days ago
    Snowflake Data Architect with Healthcare

    Snowflake Data Architect with Healthcare

    E-Solutions INC • CA, United States
    Temporary
    Quick Apply
    Hi Professionals, Title : Snowflake Data Architect with Healthcare Location : Remote Duration : Long Term Contract ...Show more
    Last updated: 4 days ago
    Social / Community Services Coordinator

    Social / Community Services Coordinator

    Big Sandy Rancheria • Auberry, CA, US
    Full-time
    Position Summary : The Social / Community Services Coordinator will be have the primary responsibility to assist in the oversight of the funded programs under the Social / Community Services Departm...Show more
    Last updated: 30+ days ago • Promoted
    Electronic Warfare Specialist

    Electronic Warfare Specialist

    United States Army • Auberry, CA, US
    Part-time +1
    Electromagnetic Spectrum Manager Job Overview : You will immerse yourself in the forefront of technology, becoming an expert in identifying and controlling all ranges of the electromagnetic spectrum...Show more
    Last updated: 30+ days ago • Promoted
    Petroleum Supply Specialist

    Petroleum Supply Specialist

    United States Army • Auberry, CA, US
    Full-time
    ELIGIBLE FOR UP TO A $16K SIGNING BONUS.Talk to your recruiter for details.As a Petroleum Supply Specialist, you'll ensure the Army has the fuel it needs to maintain operational readiness.You'll ma...Show more
    Last updated: 30+ days ago • Promoted
    Cryptologic Linguist - Up To $22.5k Signing Bonus

    Cryptologic Linguist - Up To $22.5k Signing Bonus

    United States Army • Cimarron, CA, US
    Full-time
    As a Signals Intelligence Voice Interceptor, you’ll use your skills as a linguist to identify, categorize, translate, and summarize foreign language communications from a specific location.You’ll a...Show more
    Last updated: 25 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Akaasa Technologies • CA, United States
    Full-time
    Quick Apply
    Job Title : Data Engineer Location : Pleasanton, CA Length : 6-10 months BigQuery(Advanced prof...Show more
    Last updated: 5 days ago
    CSV Engineer

    CSV Engineer

    Stark Pharma Solutions Inc • CA, United States
    Full-time
    Quick Apply
    Job Title : CSV Engineer Lcation : CA United States Experience : <...Show more
    Last updated: 30+ days ago
    Combat Engineer

    Combat Engineer

    United States Army • Auberry, CA, US
    Temporary
    Combat Engineer Job Overview : Jump start your career in engineering with our world class training program earning up to 45 advanced certifications. As a Combat Engineer, you will gain construction a...Show more
    Last updated: 30+ days ago • Promoted
    Human Intelligence Collector

    Human Intelligence Collector

    United States Army • Cimarron, CA, US
    Full-time
    As a Human Intelligence Collector, you’ll collect intelligence about an adversary’s intentions, strengths, vulnerabilities, and capabilities, and you’ll share this critical information to help Army...Show more
    Last updated: 25 days ago • Promoted
    Senior Data Engineer (Remote)

    Senior Data Engineer (Remote)

    vidIQ • California, CA, US
    Remote
    Full-time
    IQ builds software to help YouTube creators achieve their goals.Our mission is to advance the creator's journey with actionable data-driven insights and AI-powered tools. We are dedicated to our val...Show more
    Last updated: 30+ days ago
    Human Intelligence Collector - Up To $22.5k Signing Bonus

    Human Intelligence Collector - Up To $22.5k Signing Bonus

    United States Army • Cimarron, CA, US
    Full-time
    As a Human Intelligence Collector, you’ll collect intelligence about an adversary’s intentions, strengths, vulnerabilities, and capabilities, and you’ll share this critical information to help Army...Show more
    Last updated: 25 days ago • Promoted
    Looking for the ultimate side hustle?

    Looking for the ultimate side hustle?

    Survey Authority • Lemoore, CA, US
    Full-time
    Earn cash by matching with real companies that pay you for your opinions.Show more
    Last updated: 18 days ago • Promoted
    Online Survey Taker. Earn up to $25 per survey. - Remote

    Online Survey Taker. Earn up to $25 per survey. - Remote

    Earn Haus • Friant, California, US
    Remote
    Full-time +1
    We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...Show more
    Last updated: 30+ days ago • Promoted
    Apptad - Senior Data Engineer

    Apptad - Senior Data Engineer

    Apptad Inc • CA, United States
    Full-time
    Quick Apply
    Table" style="width : 480.Skill set Show more
    Last updated: 6 days ago
    Senior AI / ML Data Engineer

    Senior AI / ML Data Engineer

    Simarn Solutions • California, California, United States
    Full-time
    Quick Apply
    Job Title : Senior AI / ML Data Engineer .We are seeking a highly skilled Senior AI / ML Data Engineer with expertise in multimodal AI models, vector databases, and Azure-based data engineerin...Show more
    Last updated: 26 days ago