Talent.com
Data Engineer

Data Engineer

HonorVet TechnologiesAppleton, WI, United States
30+ days ago
Job type
  • Full-time
Job description

Job Title : Data Engineer

Location : Appleton, WI

Job Description

  • Must have : PySpark, Python Databricks

Job Description :

We are building out an Enterprise Data Platform (EDP) entirely on the cloud, utilizing Databricks on AWS. The project involves two teams focused on data ingestion, with a framework already established using Python and Spark for processing. The platform leverages DBT for data modeling. Our goal is to enhance data transformation capabilities while maintaining high standards for testing and data quality.

Key Responsibilities :

  • Lead Data Ingestion : Oversee and guide the data ingestion process, ensuring efficient and accurate data integration.
  • Mentorship : Mentor junior engineers, promoting engineering excellence and improving delivery processes.
  • Data Expertise : Utilize extensive knowledge of various data structures (Oracle, DB2, Mainframe, MongoDB, DynamoDB) to optimize data ingestion and transformation.
  • Data Profiling : Analyze structured, unstructured, and semi-structured data to determine the best methods for profiling and ingestion.
  • Ownership : Take full ownership of data sources and datasets, determining the best methods for ingestion and understanding the data thoroughly.
  • Collaboration : Work closely with staff engineers and other team members to schedule and conduct interviews, ensuring a collaborative and proactive work environment.

    • Required Skills and Experience :

  • Technical Proficiency : Strong experience with Databricks, AWS, Python, Spark, and DBT.
  • Cloud Migration : Proven track record in cloud migration projects, particularly moving on-premises systems to the cloud.
  • Data Modeling : Expertise in data modeling and transformation, with a focus on the Medallion architecture.
  • Leadership : Demonstrated ability to lead teams, mentor junior engineers, and drive engineering excellence.
  • Data Structures : In-depth knowledge of various data structures, including Oracle, DB2, Mainframe, MongoDB, and DynamoDB.
  • Data Profiling : Experience with profiling structured, unstructured, and semi-structured data to optimize ingestion processes.
  • Soft Skills : Accountable, collaborative, and proactive, with strong communication and interpersonal skills.

    • Interview Process :

  • Round 1 : Technical interview with staff engineers.
    • Create a job alert for this search

    Data Engineer • Appleton, WI, United States

    Related jobs
    • Promoted
    Staff / Lead Data Engineer

    Staff / Lead Data Engineer

    Manpower Group Inc.Appleton, WI, United States
    Full-time
    As Staff Engineer you will work independently and with your peers to translate customer needs into technical solutions.You will do this through leveraging internal resources as well as prior indust...Show moreLast updated: 4 days ago
    • Promoted
    Survey Taker : Earn up to $25 per survey (Remote)

    Survey Taker : Earn up to $25 per survey (Remote)

    Earn HausGreenville, WI, United States
    Remote
    Full-time +1
    Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion. You will help influence brand decisions on se...Show moreLast updated: 30+ days ago
    • Promoted
    Shipping & Warehouse Area Manager

    Shipping & Warehouse Area Manager

    Forward March Inc.Chilton, WI, US
    Full-time
    Shipping / Receiving Area Manager.Responsible for facility inventory accuracy, maintaining RMA inbounds and the damage / hold area, organizing and conducting yearly physical inventory, and improving cu...Show moreLast updated: 6 days ago
    • Promoted
    Civil Engineer

    Civil Engineer

    Payne & Dolan IncorporatedGreenville, WI, United States
    Full-time
    Do you enjoy working on a wide variety of private development site civil design and land surveying projects?.Are you someone who is ready to put your stamp on the future of community growth and dev...Show moreLast updated: 30+ days ago
    • Promoted
    Staff / Lead Data Engineer

    Staff / Lead Data Engineer

    ExperisAppleton, WI, United States
    Full-time
    As Staff Engineer you will work independently and with your peers to translate customer needs into technical solutions.You will do this through leveraging internal resources as well as prior indust...Show moreLast updated: 4 days ago
    • Promoted
    Solution Engineer - IGEN

    Solution Engineer - IGEN

    U.S. VentureGrand Chute, WI, United States
    Permanent
    IGEN is seeking a Solution Engineer (SE) with a SaaS background.The Solutions Engineer is a client-focused technical professional helping clients connect significant business outcomes to the Comply...Show moreLast updated: 26 days ago
    • Promoted
    Process Engineer Co-op

    Process Engineer Co-op

    Green Bay PackagingGreen Bay, WI, United States
    Full-time
    This is a paid co-op opportunity for a college student currently pursuing a degree.The co-op will support departmental tasks and gain hands-on experience in a professional setting.This role offers ...Show moreLast updated: 5 days ago
    • Promoted
    Customer Solutions Associate

    Customer Solutions Associate

    AMMEGAGreenville, WI, United States
    Full-time
    For our MIR and AMMEGA Customer Service team, we are currently looking for a.As a customer support specialist, you will be responsible for facilitating customer requests for information, quotations...Show moreLast updated: 30+ days ago
    • Promoted
    Supplier Data Quality Specialist

    Supplier Data Quality Specialist

    Treehouse FoodsGreen Bay Willowbrook, WI, United States of America
    Full-time
    Supplier Data Quality Specialist.TreeHouse Foods (NYSE : THS) is a leading manufacturer of private label packaged foods and beverages, operating a network of over 20 production facilities and severa...Show moreLast updated: 2 days ago
    • Promoted
    Senior Project Engineer

    Senior Project Engineer

    Axelon Services CorporationOshkosh, WI, US
    Full-time
    Hybrid requirement : Must be based in Wisconsin, hybrid schedule required (min of Tuesday-Thursday onsite).Description : Program Supported : JLTV platform, specifically Dutch Expeditionary Patrol Vehi...Show moreLast updated: 1 day ago
    • Promoted
    Data Solutions Engineer

    Data Solutions Engineer

    Nicolet National BankGreen Bay, WI, United States
    Full-time
    At Nicolet National Bank, our culture is based on the principles of community banking, putting the needs of our customers at the forefront of our decision-making. Our Core Values drive everything we...Show moreLast updated: 30+ days ago
    • Promoted
    Structural Engineer - Local Travel - Company vehicle!!

    Structural Engineer - Local Travel - Company vehicle!!

    JobotGreen Bay, WI, US
    Full-time
    This Jobot Job is hosted by : Brandon DeDeker.Are you a fit? Easy Apply now by clicking the "Apply Now" buttonand sending us your resume. Salary : $100,000 - $175,000 per year.Since 2007, we...Show moreLast updated: 22 days ago
    • Promoted
    Data Intern - Summer 2026

    Data Intern - Summer 2026

    Nicolet National BankGreen Bay, WI, United States
    Full-time
    At Nicolet National Bank, our culture is based on the principles of community banking, putting the needs of our customers at the forefront of our decision-making. Our Core Values drive everything we...Show moreLast updated: 4 days ago
    • Promoted
    Design Engineer

    Design Engineer

    Axelon Services CorporationOshkosh, WI, US
    Full-time
    Oshkosh, WI - Will Consider Fully Remote.Approximate contract length is 5+ Months.Contract Length : 6 months through March 2026 with potential extensions. Location : Shortlisting local and hybrid cand...Show moreLast updated: 1 day ago
    • Promoted
    Project Engineer - Heavy Civil

    Project Engineer - Heavy Civil

    Northeast Asphalt, Inc.Greenville, WI, United States
    Full-time
    Are you looking for an exciting career in road, highway, and bridge construction? Northeast Asphalt Inc.Walbec Group has a place for hard working, loyal, and driven people like you.Come work with u...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    Optimization Engineer

    Optimization Engineer

    AgropurReedsville, WI, Manitowoc County, WI; Wisconsin, United States
    Full-time
    Medical, Dental, Vision, Life, Short and Long-term Disability Insurance .Paid holidays and 2 floating holidays.Salary range 005 : $81,400 - $101,800. Salary will be determined based on skills, educat...Show moreLast updated: 3 hours ago
    • Promoted
    Project Engineer

    Project Engineer

    Genesis10Oshkosh, WI, US
    Permanent +1
    Genesis10 is seeking a Project Engineer – Mechanical for a 6-month contract position with a client located in Milwaukee, WI. This is a hybrid role requiring to be onsite from Tuesday - Thursday.Summ...Show moreLast updated: 2 days ago
    Sr. Genesys Cloud Implementation Engineer

    Sr. Genesys Cloud Implementation Engineer

    EDCiAppleton, WI, US
    Full-time
    Quick Apply
    Back to Career Opportunities Sr.Remote EDCi provides infrastructure and call center technology services and solutions to clients throughout the United States. Through our partnership and certificati...Show moreLast updated: 30+ days ago