Talent.com
Cloud Data Engineer
Cloud Data EngineerGovx • Florida, United States, Florida, United States
Cloud Data Engineer

Cloud Data Engineer

Govx • Florida, United States, Florida, United States
1 day ago
Job type
  • Full-time
  • Remote
Job description

POSITION DESCRIPTION

The Cloud Data Engineer is part of a Data team that is responsible for supporting, modernizing, and transforming our data and reporting capabilities across our products by implementing a new modernized data architecture. The position will be responsible for day-to-day data collection, transportation, maintenance / curation, and access to the GOVX corporate data assets. The Cloud Data Engineer will work cross-functionally across the enterprise to centralize data and standardize it for use by business reporting, machine learning, AI, data science, and other stakeholders. This position plays a critical role in increasing awareness about available data and democratizing access to it across GOVX and our data partners.

This position will be under the supervision of the Business Intelligence Manager.

RESPONSIBLITIES

  • Supporting and modernizing existing data integrations.
  • Crafting and maintaining efficient data pipeline architecture.
  • Assembling large, complex data sets that meet business requirements.
  • Create and maintain optimal data pipeline / flow architecture.
  • Identifying, crafting, and implementing internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Partner with business analysts, data scientists, and IT teams to translate business requirements into scalable data solutions using Fabric, Spark, using Delta Lake. Develop Spark notebooks for both batch and streaming ETL pipelines leveraging Delta Lake.
  • Implement and optimize Delta Lake features including schema enforcement, schema evolution, and time travel for robust data management. Optimize Delta Lake tables for performance using Z-ordering, compaction, and partitioning strategies.
  • Working with the team to strive for clean and meaningful data, and greater functionality and flexibility within the team’s data systems.
  • Design processes supporting data transformation, data structures, metadata, dependency, and workload management.

SKILL / REQUIREMENTS

  • Hands-on experience developing, debugging, and optimizing Spark notebooks for ETL and analytics in Microsoft Fabric and Azure.
  • Deep expertise in Microsoft Fabric, Dataflows Gen2, and Power BI integration.
  • Hands-on experience with Delta Lake table management, including schema evolution, versioning, and data compaction
  • Experience with Data Lakehouse and Medallion Architecture.
  • Experience with CI / CD and version control using Git.
  • Advanced SQL and NoSQL query authoring; Python and Spark scripting.
  • Proficiency with object-oriented / object function scripting languages : Python, Spark, etc.
  • Proficiency with Metadata-Driven Design and JSON.
  • Experience working with streams such as Event Hubs and Event Driven Architectures.
  • Experience building, maintaining, and optimizing ‘big data’ data pipelines, architectures, and data sets.
  • Experience cleaning, testing, and evaluating data quality from a wide variety of ingestible data sources.
  • Knowledge Microsoft Power Platform including Copilot Studio and Power Apps.
  • Strong collaboration and communication skills with business and technical teams.
  • SUPERVISORY RESPONSIBILITY

    This position has no supervisory responsibilities.

    WORK ENVIRONMENT

    This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets and fax machines. This role occasionally must lift and carry the office equipment. Occasional evening, night and weekend shifts are required.

    Work Location

    Due to state law and tax implications, remote work candidates must live and work in one of the following states : California, Texas, Washington, Florida, Tennessee, New York, or Colorado.

    PHYSICAL / MENTAL DEMANDS

  • Physical - This is a sedentary role.
  • Mental – Problem solving, making decisions, interpreting data, organize, read / write.
  • Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
  • TRAVEL

    Annual travel to the San Diego office headquarters is expected for this position.

    PREFERRED EDUCATION AND EXPERIENCE

  • Bachelor’s degree or equivalent experience.
  • 7+ years of proven experience deploying and maintaining always-on data services.
  • 2+ years building and maintaining Spark notebook-based pipelines in Microsoft Fabric.
  • 2+ years of experience working with Microsoft Fabric
  • 2+ years of experience working with Microsoft Azure
  • 2+ years of experience with Delta Lake.
  • 1+ years of experience with SQL Server.
  • Paid Time Off, Paid Sick Leave, Paid Holidays
  • Competitive Medical, Dental, Vision, Short Term Disability, and Life Insurance
  • 401(k) plan with discretionary match available
  • Flexible Spending Account (FSA), Health Savings Account (HSA)
  • Voluntary benefits including Critical Illness, Group Accident, and Voluntary Life
  • Employee Referral Program
  • Exposure to a growing ecommerce company
  • Discounts on the GOVX website
  • Salary Range

    $120,000 - 140,000 Annually

    AAP / EEO Statement

    EOE. Veterans / Disabled.  Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.

    Position will require successful completion of a background check and drug testing prior to starting employment.

    About GOVX, Inc.

    Savings for Those Who Serve

    GOVX was founded in 2011 to offer exclusive benefits to those who serve our country. The GOVX membership is comprised of current and former members of the United States military, law enforcement, firefighting, medical services, and government personnel. We are dedicated to supporting these communities and to offering unique value to our members, while delivering an authentic platform for brands to reach our growing customer base. As the largest and fastest growing digital platform serving this deserving audience, we are committed to stretching the limits of ecommerce to deliver the best assortment for our members’ on-duty and off-duty needs.

    Create a job alert for this search

    Cloud Data Engineer • Florida, United States, Florida, United States

    Related jobs
    Data Engineer

    Data Engineer

    Openkyber • FL, United States
    Full-time
    Quick Apply
    Company Description : Local government municipality.Role Description : The Database Analyst position is a 6+ month hybrid contract role based in Deland, FL, with...Show more
    Last updated: 30+ days ago
    AI Writing Reviewer - Remote

    AI Writing Reviewer - Remote

    Outlier • Remote, FL, United States
    Remote
    Full-time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show more
    Last updated: 1 day ago • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Prophasys • Fort Meade, Florida, United States
    Full-time
    This position supports the research and development of entity, event, and topic identification and correlation across multimedia inputs (image, audio, and text in multiple languages).Experience as ...Show more
    Last updated: 30+ days ago • Promoted
    Remote Side Hustle Developer

    Remote Side Hustle Developer

    Finance Buzz • Avon Park, Florida, US
    Remote
    Full-time +1
    This position is for individuals who want to develop a side income stream while still working full time.You will test different small-scale remote opportunities, learn what works, and grow what pro...Show more
    Last updated: 30+ days ago • Promoted
    Senior Managed Care Analytics Lead

    Senior Managed Care Analytics Lead

    Pediatrix Medical Group • Town of Florida, NY, United States
    Full-time
    A leading healthcare provider in New York seeks a Managed Care Data Analyst to handle complex data analytics, modeling, and reporting functions. The ideal candidate will have 4-7 years of experience...Show more
    Last updated: 9 days ago • Promoted
    Hybrid Primary Research Analyst - Consumer Insights

    Hybrid Primary Research Analyst - Consumer Insights

    Texas Health Huguley FWS • Town of Florida, NY, United States
    Full-time
    A healthcare organization is seeking a Primary Research Analyst to collect, process, and interpret key research data.This role requires experience in both qualitative and quantitative research meth...Show more
    Last updated: 11 days ago • Promoted
    Remote AI Content Proofreader

    Remote AI Content Proofreader

    Outlier • Remote, FL, United States
    Remote
    Full-time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...Show more
    Last updated: 1 day ago • Promoted
    Mid-level Imagery Analyst - MacDill AFB, Florida (APOGEE)

    Mid-level Imagery Analyst - MacDill AFB, Florida (APOGEE)

    Kinsley Power Systems • Town of Florida, NY, United States
    Full-time
    Celestar Corporation is seeking a.Army Persistent Overhead Geospatial Intelligence (GEOINT) Exploitation Enterprise Support Services (APOGEE). The primary place of performance will be.If interested ...Show more
    Last updated: 18 days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    Openkyber • FL, United States
    Full-time
    Quick Apply
    Job Posting : Oracle Cloud Financials Functional Consultant-W2 Only Location : 5 days Onsite (as required), Palm Beach Gardens, Florida T...Show more
    Last updated: 8 days ago
    Cloud AI Architect

    Cloud AI Architect

    Openkyber • FL, United States
    Full-time
    Quick Apply
    Job Title : Cloud Applications Architect (Azure + AWS) - Healthcare Exp & State client exp Must Location : Tallahassee, FL - OnsiteShow more
    Last updated: 2 days ago
    ML Support Engineer

    ML Support Engineer

    Openkyber • FL, United States
    Full-time
    Quick Apply
    Principal Data Scientist( GenAI , LLMs , NLP techniques, and ML strongly) St Petersburg, Florida OR Denver, CO (Hybrid) Long Term Contract Only W2 Candidates NOTES FROM MANAGER : &...Show more
    Last updated: 7 hours ago • New!
    Cloud Data Engineer

    Cloud Data Engineer

    GOVX • FL, US
    Remote
    Full-time
    Quick Apply
    The Cloud Data Engineer is part of a Data team that is responsible for supporting, modernizing, and transforming our data and reporting capabilities across our products by implementing a new modern...Show more
    Last updated: 2 days ago
    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Finance Buzz • Fort Meade, Florida, US
    Remote
    Temporary
    Are you looking to earn extra income from the comfort of your home? We're seeking motivated individuals to explore and test a variety of remote side hustle opportunities featured on FinanceBuzz.Thi...Show more
    Last updated: 30+ days ago • Promoted
    Fractional CFOs USA

    Fractional CFOs USA

    The CFO Centre - Italy • Town of Florida, NY, United States
    Part-time
    We’re looking for top quality CFOs.Are you a driven and entrepreneurial CFO looking to be part of a global business?.We are hiring across the USA, with operations currently in Georgia, Washington S...Show more
    Last updated: 8 days ago • Promoted
    Enterprise Cloud Architect

    Enterprise Cloud Architect

    Openkyber • FL, United States
    Full-time
    Quick Apply
    Job Title : Solution Architect Automation & Observability Location : Miramar, FL Hybrid Contract-to-Hir...Show more
    Last updated: 7 days ago
    Teamlead Consulting & Support (m / f / d)

    Teamlead Consulting & Support (m / f / d)

    itara GmbH • Town Of Florida, NY, United States
    Full-time
    You meet with your team in a daily meeting.You talk about important tasks and make sure everyone’s on track.You advise our partners and customers on implementing HR for Dynamics, make sure it’s clo...Show more
    Last updated: 21 days ago • Promoted
    Head of Investor Relations

    Head of Investor Relations

    DataAnnotation • Town of Florida, NY, United States
    Full-time +1
    Head of Investor Relations at DataAnnotation.We are looking for a Head of Investor Relations to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their l...Show more
    Last updated: 18 days ago • Promoted
    Fixed Income Capital Markets Associate

    Fixed Income Capital Markets Associate

    DataAnnotation • Town of Florida, NY, United States
    Full-time +1
    Fixed Income Capital Markets Associate.We are looking for a Fixed Income Capital Markets Associate to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate t...Show more
    Last updated: 18 days ago • Promoted