Talent.com
Data Engineer

Data Engineer

Compunnel, Inc.Tempe, AZ, US
1 day ago
Job type
  • Full-time
Job description

We are seeking an experienced Data Engineer to collaborate with business stakeholders and technical teams to acquire and migrate data sources critical to business objectives. This role involves designing, developing, and managing robust ETL pipelines, working with both structured and unstructured data, and ensuring efficient data management across various platforms. The candidate will also be expected to build cross-platform data strategies, automate processes, and optimize data delivery.

Key Responsibilities :

  • Data Acquisition and Migration : Collaborate with business stakeholders and technical teams to acquire and migrate relevant data sources for business needs and goals.
  • Database Expertise : Demonstrate deep technical knowledge of relational and non-relational databases, Data Warehouses, and Data Lakes, including structured and unstructured storage options.
  • Develop data flow pipelines to extract, transform, and load (ETL) data from various sources. This includes custom ETL pipelines that enable model and product development.
  • Data Extraction : Write custom scripts to extract data from unstructured or semi-structured data sources.
  • Documentation and Communication : Provide clear documentation for all delivered solutions and processes, and ensure integration with relevant corporate stakeholders.
  • Process Improvement : Identify and implement internal process improvements for data management, including automating manual processes, optimizing data delivery, and re-designing infrastructure for better scalability.
  • Adoption of New Tools : Stay current with emerging tools and applications to ensure the development of high-quality and efficient solutions.
  • Build cross-platform data strategies to aggregate multiple data sources and streamline development datasets.

Required Qualifications :

  • Education : Bachelor's degree in Computer Engineering, Computer Science, or a related discipline (Master's Degree preferred).
  • Experience :

  • 7+ years of experience in ETL design, development, and performance tuning using tools such as SSIS or Azure Data Factory (ADF) in a multi-dimensional Data Warehousing environment.
  • 3+ years of experience with Python or SQL to set up and operate data pipelines.
  • 7+ years of advanced SQL programming experience (PL / SQL, T-SQL).
  • 5+ years of experience in Enterprise Data & Analytics solution architecture.
  • 3+ years of extensive hands-on experience with Azure, especially in data-heavy / analytics applications involving relational and NoSQL databases, Data Warehouses, and Big Data technologies.
  • 3+ years of experience with Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Azure Databricks, Blob Storage, Azure SQL DW / Synapse, and Azure Functions.
  • 2+ years of experience in defining and enabling data quality standards for auditing and monitoring.
  • Strong analytical abilities and intellectual curiosity.
  • In-depth knowledge of relational database design, data warehousing, and dimensional data modeling concepts.
  • Deep understanding of REST and API design principles.
  • Excellent collaboration, communication, and teamwork skills.
  • Self-starter with the ability to thrive in a fast-paced development environment.
  • Agile experience is highly desirable.
  • Proficiency in the development environment, including IDEs, database servers, GIT, Continuous Integration, unit testing, and defect management tools.
  • Strong experience with Python, Spark, and Pyspark.
  • Strong leadership capabilities.
  • Preferred Qualifications :

  • 2+ years of experience with Big Data Management (BDM) for relational and non-relational data formats such as JSON, XML, Avro, Parquet, and Copybook.
  • Knowledge of DevOps processes (CI / CD) and infrastructure as code.
  • Experience with Master Data Management (MDM) and Data Quality tools.
  • Familiarity with Kafka.
  • Knowledge of key machine learning concepts and MLOps.
  • Technologies We Use :

    J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • Tempe, AZ, US

    Related jobs
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    VirtualVocationsTempe, Arizona, United States
    Full-time
    A company is looking for an Azure Data Engineer to implement data solutions in Azure and support Infrastructure as Code initiatives. Key Responsibilities : Design, develop, and implement integratio...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    VirtualVocationsMesa, Arizona, United States
    Full-time
    A company is looking for an AI Engineer focused on FinTech workflow automation.Key Responsibilities Design, build, and deploy AI models into production Develop and maintain backend Python servic...Show moreLast updated: 30+ days ago
    • Promoted
    Data Warehouse Architect

    Data Warehouse Architect

    VirtualVocationsMesa, Arizona, United States
    Full-time
    A company is looking for a Data Warehouse Architect & AI Analytics Lead.Key Responsibilities Lead the design and implementation of extensions to a Data Vault 2. Architect and pilot predictive anal...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer - Data Platform

    Senior Software Engineer - Data Platform

    RelativityPhoenix, AZ, United States
    Full-time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Data Model (DDM)-a foundational component of our platf...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineering Lead

    Data Engineering Lead

    VirtualVocationsGlendale, Arizona, United States
    Full-time
    A company is looking for a Data Engineering Lead.Key Responsibilities Own and evolve the data pipeline to ensure accuracy and reliability of metrics and dashboards Modernize the data stack and e...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    Purple DriveTEMPE, New Jersey, USA
    Full-time
    Data Engineer Need 8+ years of experienced resource with Data analytics skills including data science, AI, ML and data engineering .Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsPhoenix, Arizona, United States
    Full-time
    A company is looking for a Senior Data Engineer.Key Responsibilities Design, build, and maintain reliable ETL pipelines Work with large datasets using Python or Java and raw SQL Collaborate wit...Show moreLast updated: 30+ days ago
    • Promoted
    Junior Data Engineer

    Junior Data Engineer

    ContexturePhoenix, AZ, United States
    Full-time +1
    Director, Data Operations & Engineering.Minimum Starting Monthly Range : .Exempt / Non-Exempt : Exempt.Risk Designation : Extremely High.The Jun...Show moreLast updated: 24 days ago
    Big Data Engineer

    Big Data Engineer

    iSoftTek Solutions IncPhoenix, AZ, US
    Full-time
    Quick Apply
    SoftTek Solutions Inc is seeking a talented Big Data Engineer to join our team.In this role, you will be responsible for developing and maintaining big data solutions and frameworks.You will work c...Show moreLast updated: 30+ days ago
    GCP Cloud Data Engineer

    GCP Cloud Data Engineer

    Purple DrivePhoenix, AZ, Arizona, USA
    Full-time
    Calibri,sans-serif"> Job title : Show moreLast updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    GradGuardPhoenix, AZ, US
    Full-time
    Quick Apply
    Senior Data Engineer As the Senior Data Engineer , you will help build, maintain, and optimize the data infrastructure that powers our decision-making and product development.You'll work with moder...Show moreLast updated: 24 days ago
    Big data / Hadoop Developer

    Big data / Hadoop Developer

    Innova SolutionsChandler, AZ,Arizona,United States
    Full-time
    Quick Apply
    Innova Solutions has a client that is immediately hiring for a.Position type : Full-time / Contract.Location : Chandler, AZ (Hybrid). As a Big Data Engineer, you will : .Design, develop, and maintain scal...Show moreLast updated: 30+ days ago
    Big Data Engineer / Data Engineer

    Big Data Engineer / Data Engineer

    CrackaJack Digital Solutions LLCPhoenix, AZ, US
    Full-time
    Quick Apply
    In-Person round of interview mandatory.Big Data, Spark, Python, SQL, GCP is must.Need a hardcore, heavy hitting Data Engineer who is extremely skilled and is able to function independently and mana...Show moreLast updated: 30+ days ago
    Big Data Engineer

    Big Data Engineer

    OmegaHiresphoenix, AZ, US
    Full-time
    Quick Apply
    Big Data Engineer Location : Phoenix, AZ (Onsite / Hybrid) Job Description : We are looking for an experienced Big Data Engineer skilled in Google Cloud Platform (GCP) and...Show moreLast updated: 6 days ago
    • Promoted
    Lead Software Engineer - Data Platform

    Lead Software Engineer - Data Platform

    RelativityPhoenix, AZ, United States
    Full-time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Domain - a foundational component of our platform-into...Show moreLast updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    KindsightScottsdale, AZ, US
    Full-time
    Quick Apply
    Kindsight builds technology that helps fundraisers make a difference.For decades, Kindsight has supported the education, healthcare, and nonprofit sectors with fundraising tools and the largest cha...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VirtualVocationsGlendale, Arizona, United States
    Full-time
    A company is looking for a Data Engineer - Databricks.Key Responsibilities Lead technical direction for data engineering initiatives Architect scalable data pipelines and systems using PySpark, ...Show moreLast updated: 30+ days ago
    data engineer

    data engineer

    Purple DrivePHOENIX, Arizona, USA
    Full-time
    GCP Cloud Data Engineer Design, develop, and maintain Big Data solutions using Hadoop ecosystem tools and frameworks.Leverage advanced Java programming concept...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    ValenzPhoenix, AZ, US
    Full-time
    Vālenz® Health is the platform to simplify healthcare – the destination for employers, payers, providers and members to reduce costs, improve quality, and elevate the healthcare exp...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer - Azure

    Data Engineer - Azure

    Savas Management Center LLCScottsdale, AZ, US
    Full-time
    Location : Scottsdale, AZ (Hybrid 3 days Onsite), $100K to $150K, must be authorized to work in USA, no visa sponsorship available. Savas Software is a leading provider of transdisciplinary pain mana...Show moreLast updated: 2 days ago