Search jobs > Charlotte, NC > Data engineer

Data Engineer

McGriff Insurance Services
Charlotte NC
Full-time
Part-time

ESSENTIAL DUTIES AND RESPONSIBILITIES

Following is a summary of the essential functions for this job. Other duties may be performed, both major and minor, which are not mentioned below.

Specific activities may change from time to time.

  • Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services.
  • Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse.
  • Developing data models and maintaining data architecture to support data analytics and business intelligence reporting.
  • Ensuring data quality and consistency through data cleaning, transformation, and integration processes.
  • Monitoring and troubleshooting data-related issues within the Azure environment to maintain high availability and performance.
  • Collaborating with data scientists, business analysts, and other stakeholders to understand data requirements and implement appropriate data solutions.
  • Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information.
  • Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks.
  • Utilizing Azure's analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making.
  • Keeping abreast of the latest Azure features and technologies to enhance data engineering processes and capabilities.
  • Documenting data procedures, systems, and architectures to maintain clarity and ensure compliance with regulatory standards.
  • Providing guidance and support for data governance, including metadata management, data lineage, and data cataloging.

1. Works with teammates to solve problems and engineer innovative software solutions.

2. Supports systems integration testing (SIT) and user acceptance testing (UAT) for large, complex, cross-functional application initiatives by providing insight to testing teams in order to ensure the appropriate depth of test coverage.

3. Communicates changes in software architecture and resolves escalated issues.

4. Demonstrate an ability to learn and adopt relevant new technologies, tools, methods and processes to leverage in your solutions.

QUALIFICATIONS

Required Qualifications :

The requirements listed below are representative of the knowledge, skill and / or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

  • As an Azure Data Engineer, master data integration and ETL tools crucial for seamless data processing. Azure Data Factory stands at the forefront, orchestrating data workflows.
  • In-depth knowledge of Azure cloud data solutions, relational databases, ETL / ELT architecture and concepts, data integration concepts and big data concepts
  • Proficiency in languages like Python for data manipulation and SQL for database querying, enabling efficient data processing and analysis
  • A strong grasp of Microsoft Azure, covering a spectrum of services for seamless deployment, scaling, and management of data solutions, leveraging the power of the cloud
  • Participate in cross-functional teams to comprehend project requirements and translate them into technical solutions. Communicate complicated concepts, designs, and progress to both technical and non-technical stakeholders clearly and concisely.
  • Advanced working SQL knowledge and experience working with relational databases
  • Strong analytic skills related to working with unstructured datasets.

1. Bachelor's Degree in Computer Science, CIS, or related field

2. Three to five years of experience in software development or a related field

3. Three to five years of experience in database technologies

4. Three to five years of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)

Preferred Qualifications : :

Any Microsoft Azure Certification

OTHER JOB REQUIREMENTS / WORKING CONDITIONS

SittingFrequently (

25% -

50% of the time)LiftingUp to

25 lbs.Visual / Audio / SpeakingAble to access and interpret client information received from the computer and able to hear and speak with individuals in person and on the phone.

Manual Dexterity / KeyboardingAble to work standard office equipment, including PC keyboard and mouse, copy / fax machines, and printers.

AvailabilityAble to work all hours scheduled, including overtime as directed by manager / supervisor and required by business need.TravelUp to

General Description of Available Benefits for Eligible Employees of Truist Financial Corporation : All regular teammates (not temporary or contingent workers) working 20 hours or more per week are eligible for benefits, though eligibility for specific benefits may be determined by the division of Truist offering the position.

Truist offers medical, dental, vision, life insurance, disability, accidental death and dismemberment, tax-preferred savings accounts, and a 401k plan to teammates.

Teammates also receive no less than 10 days of vacation (prorated based on date of hire and by full-time or part-time status) during their first year of employment, along with 10 sick days (also prorated), and paid holidays.

10 days ago
Related jobs
Promoted
PMI (Project Management Institute)
Charlotte, North Carolina

JobPosting","title":"Data Engineer II","datePosted":"2024-04-15T00:00:00","validThrough":null,"description":"Data Engineer II (Multiple Openings), Project Management Institute, Inc. Data Engineer II (Multiple Openings), Project Management Institute, Inc. The position requires a minimum of a Bachelor...

Promoted
Addison Group
Charlotte, North Carolina

Due to continued growth we are looking for an experienced Data Engineer to join our team. With offices in Colorado and North Carolina we are one of the leading teams on providing Data Solutions in the US. ...

Promoted
WSP
Charlotte, North Carolina

W Mission Critical Engineering, a WSP company, is a high-performance, fast-paced consulting engineering firm designing data centers and mission critical environments across the globe. Bachelor's degree in Mechanical Engineering or Architectural Engineering with mechanical building systems emphasis. ...

Promoted
NTT DATA Services
Charlotte, North Carolina

We are currently seeking a Data Engineer - Python to join our team in Charlotte, South Carolina (US-SC), United States (US). NTT DATA Services is a recognized leader in IT and business services, including cloud, data and applications, headquartered in Texas. As part of NTT DATA, a $30 billion truste...

Promoted
System Soft Technologies
Charlotte, North Carolina
Remote

This position will support data management platforms including data warehousing, master data management (MDM), data integration, analytics and reporting. This is a hands on technical role that will handle the design, implementation, and optimization of data processes. MSSQL, Oracle) or cloud-based d...

Promoted
Insight Global
Charlotte, North Carolina

Job DescriptionInsight Global is looking for a Data Engineer for a large company based out of Charlotte, NC. We are looking for a problem solver and someone who has a passion for data engineering. This person will be working on a green field implementation and responsible for migrating current data ...

Promoted
Accenture
Charlotte, North Carolina

You will have an opportunity to work in roles such as Data Scientist, Data Engineer, or Chief Data Officer covering all aspects of Data including Data Management, Data Governance, Data Intelligence, Knowledge Graphs, and IoT. As a Mid-Level Data Engineer, you'll use your IBM DataStage expertise to d...

PamTen
Charlotte, North Carolina

Expert knowledge of Linux operating systems and environment and Scripting (Shell and Python preferred) • A deep expertise in your field of Software Engineering • Expert at troubleshooting complex system and application stacks • Operational Experience in Big Data Stacks ( Hadoop ecosystem, Spark is a...

Amazee Global Ventures Inc
Charlotte, North Carolina

Role- AWS Data Engineer Location- Charlotte, NC Experience Level: 15+ years Job Description: We are seeking a highly skilled individual with robust hands-on experience across various domains: Comprehensive proficiency in Python and PySpark programming languages is essential, as is a deep...

CyberCoders
Charlotte, North Carolina

Design and develop data pipelines, ETL processes, and data models using Azure, Azure Data Factory, and DataBricks. We are looking for an experienced Data Engineer to join our growing team! You will be responsible for developing, testing, and deploying data pipelines and ETL processes. You will work ...