Talent.com
Data Engineer ID43228
Data Engineer ID43228AgileEngine • Blacksburg, VA, US
No longer accepting applications
Data Engineer ID43228

Data Engineer ID43228

AgileEngine • Blacksburg, VA, US
19 hours ago
Job type
  • Full-time
Job description

Why Join Us

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Best Place to Work awards.

About the Role

As a Middle Data Engineer, you'll build and optimize ETL pipelines and cloud data solutions that provide reliable insights for data scientists and analysts. You'll tackle complex data challenges, collaborate with cross-functional teams, and grow your expertise in Python, Airflow, Spark, and AWS in a dynamic, innovative environment.

What You'll Do

  • Build and support ETL pipelines.
  • Monitor data pipelines, identify bottlenecks, and optimize data processing and storage for performance and cost-effectiveness.
  • Collaborate effectively with cross-functional teams including data scientists, analysts, software engineers, and business stakeholders.
  • Work with Terraform to build AWS infrastructure.
  • Analyze sources and build Cloud Data Warehouse and Data Lake solution.

Must Haves

  • You must be authorized to work for any employer in the US (e.g., Green card holders, TN visa holders, GC EAD, H4 EAD, U4U with EAD). We are unable to sponsor or take over employment visa sponsorship at this time.
  • 3+ years of professional experience with Python.
  • 3+ years of professional experience in a Data Engineering role.
  • Proficiency in programming languages commonly used in data engineering such as Python, SQL, and optionally Scala.
  • Proficiency in designing, deploying, and managing data pipelines using Apache Airflow.
  • Ability to design, develop, and optimize ETL processes to move and transform data from various sources into the data warehouse, ensuring data quality, reliability, and efficiency.
  • Knowledge of big data technologies and frameworks such as Apache Spark.
  • Extensive hands-on experience with various AWS services relevant to data engineering.
  • Deep understanding and practical experience in building and optimizing cloud data warehousing solutions.
  • Ability to monitor data pipelines, identify bottlenecks, and optimize data processing and storage for performance and cost-effectiveness.
  • Excellent communication skills to collaborate effectively with cross-functional teams.
  • Bachelor's degree in computer science / engineering or other technical field, or equivalent experience.
  • Upper-intermediate English level.

    • Nice to Haves

  • Familiarity with the fintech industry, understanding of financial data, regulatory requirements, and business processes specific to the domain.
  • Documentation skills to document data pipelines, architecture designs, and best practices.
  • GCP services relevant to data engineering.
  • Snowflake.
  • OpenSearch, Elasticsearch.
  • Jupyter for analyze data.
  • Bitbucket, Bamboo.
  • Terraform.

    • Perks and Benefits

  • Professional growth : Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
  • Competitive compensation : We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
  • A selection of exciting projects : Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
  • Flextime : Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.

    • J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • Blacksburg, VA, US

    Related jobs
    Data Engineer ID43228

    Data Engineer ID43228

    AgileEngine • Blacksburg, VA, us
    Full-time
    Quick Apply
    Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Bes...Show more
    Last updated: 6 days ago
    Principle Software Engineer

    Principle Software Engineer

    System One • Christiansburg, VA, US
    Permanent
    Job Title : Principle Software Engineer Location : Christiansburg, Virginia Type : Direct Hire Contractor Work Model : Hybrid Overview : Are you a visionary software engineer with a passion for designin...Show more
    Last updated: 30+ days ago • Promoted
    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Remote Side Hustle Evaluator - Flexible Online Gig Work

    Finance Buzz • White Sulphur Springs, West Virginia, US
    Remote
    Temporary
    Are you looking to earn extra income from the comfort of your home? We're seeking motivated individuals to explore and test a variety of remote side hustle opportunities featured on FinanceBuzz.Thi...Show more
    Last updated: 30+ days ago • Promoted
    Remote Side Hustle Developer

    Remote Side Hustle Developer

    Finance Buzz • Pearisburg, Virginia, US
    Remote
    Full-time +1
    This position is for individuals who want to develop a side income stream while still working full time.You will test different small-scale remote opportunities, learn what works, and grow what pro...Show more
    Last updated: 9 days ago • Promoted
    Work-from-Home Tester - Try Online Side Gigs and Give Feedback

    Work-from-Home Tester - Try Online Side Gigs and Give Feedback

    Finance Buzz • New Castle, Virginia, US
    Remote
    Temporary
    We're on the hunt for curious, motivated individuals to test and review online money-making opportunities featured on FinanceBuzz. If you enjoy discovering new platforms and sharing your experience,...Show more
    Last updated: 30+ days ago • Promoted
    Side Hustle Project Lead

    Side Hustle Project Lead

    Finance Buzz • Covington, Virginia, US
    Full-time +1
    We’re offering a role for someone who wants to lead their own side-income project in their spare time.You’ll explore various proven side hustles, select the ones that fit your lifestyle, and run th...Show more
    Last updated: 9 days ago • Promoted
    Data Systems Engineer

    Data Systems Engineer

    TEKsystems • Roanoke, VA, United States
    Full-time
    Candidates must reside in one of the following states : Alabama, Florida, Georgia, Arkansas, Kentucky, Louisiana, Mississippi, North Carolina, South Carolina, Tennessee, West Virginia, and Virginia •...Show more
    Last updated: 1 day ago • Promoted
    CDL-A Drivers : Historic Pay Increase! Earn Up To $0.66 Per Mile!

    CDL-A Drivers : Historic Pay Increase! Earn Up To $0.66 Per Mile!

    Millis Transfer Inc • Christiansburg, VA, USA
    Full-time
    STOP WHAT YOU’RE DOING — THIS IS BIG.Millis Just Launched a Historic Pay Raise for ALL Drivers!.Just more money in your pocket. Millis is raising the bar — and your paycheck.Orientation Now Offered ...Show more
    Last updated: 11 hours ago • Promoted • New!
    Remote Senior Financial Analyst - AI Trainer

    Remote Senior Financial Analyst - AI Trainer

    Data Annotation • Blacksburg, Virginia
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show more
    Last updated: 30+ days ago • Promoted
    Active Social Worker

    Active Social Worker

    United States Army • Ronceverte, WV, US
    Permanent
    Army Social Workers use their skills to enhance unit readiness and the well-being of Soldiers and their families If you are a practicing professional as a social worker and want to combine your spe...Show more
    Last updated: 19 hours ago • Promoted • New!
    Remote Financial Planner - AI Trainer

    Remote Financial Planner - AI Trainer

    Data Annotation • Blacksburg, Virginia
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...Show more
    Last updated: 30+ days ago • Promoted
    Remote Product Tester – $45 / hr + Free Products – Start Now!

    Remote Product Tester – $45 / hr + Free Products – Start Now!

    OCPA • Alderson, West Virginia, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show more
    Last updated: 30+ days ago • Promoted
    Independent Online Earner - Flexible and Remote

    Independent Online Earner - Flexible and Remote

    Finance Buzz • Christiansburg, Virginia, US
    Remote
    Temporary
    We’re seeking proactive and independent individuals interested in learning how to earn money online.This opportunity is ideal for those who want a self-directed, flexible way to build extra income....Show more
    Last updated: 9 days ago • Promoted
    Receiving / Sourcing Inspector

    Receiving / Sourcing Inspector

    Spectraforce Technologies • Blacksburg, VA, United States
    Full-time
    Job Title : Receiving / Sourcing Inspector.Location : Blacksburg Virginia 24060.Shift Monday to Thursday 6 : 00am to 3 : 30pm Friday 06 : 00 to 10 : 00. Perform inspection and test procedures.Demonstrates knowl...Show more
    Last updated: 19 days ago • Promoted
    Test Products from Home – $25-$45 / hr + Freebies

    Test Products from Home – $25-$45 / hr + Freebies

    OCPA • Alderson, West Virginia, us
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show more
    Last updated: 30+ days ago • Promoted
    Part-Time Side Work - Earn on Top of Your Day Job

    Part-Time Side Work - Earn on Top of Your Day Job

    Finance Buzz • White Sulphur Springs, West Virginia, US
    Part-time +1
    We’re looking for people interested in a part-time remote opportunity to supplement their main income.This position is ideal for professionals, freelancers, and anyone who wants to improve their fi...Show more
    Last updated: 9 days ago • Promoted
    ObGyn

    ObGyn

    LocumTenens.com • Christiansburg, Virginia, US
    Full-time
    ObGyn physician job in Virginia : .Job Reference Id : ORD-203446-MD-VA.Dates Needed : As soon as credentialed.Board Certification Required : Yes. The facility averages 72 deliveries per month, with b...Show more
    Last updated: 4 days ago • Promoted
    Material Analyst

    Material Analyst

    Spectraforce Technologies • Blacksburg, VA, United States
    Full-time
    Location : Blacksburg Virginia 24060.Duration : 12 months' Assignment.Shift / Hours : Monday-Thursday from 7 : 00am-4 : 30pm (9 hours with a lunch at 12 : 30), and Friday from 7 : 00am-11 : 00am (4 hours).High Sc...Show more
    Last updated: 30+ days ago • Promoted
    Work from Home

    Work from Home

    HomeJobFinder • Rocky Mount, VA
    Remote
    Full-time
    Remote Opportunity : Link Posting Marketing Rep (No Experience Needed!) Are you self-driven, reliable, and ready to earn from anywhere? We’re looking for motivated individuals to jo...Show more
    Last updated: 18 days ago • Promoted
    Mechanical Engineer

    Mechanical Engineer

    FootBridge • Narrows, VA, US
    Full-time
    Mechanical Project Manager Pay $58-$68 per hour Location : Narrows, VA The Role The Mechanical Project Manager will coordinate front-end work leading up to the capital design phase, develop overall ...Show more
    Last updated: 3 days ago • Promoted