Data Engineer Manager

Data Engineer Manager

Charlotte NC (Hybrid Onsite) or Remote for someone who has worked earlier with Grant Thorton

The Data Engineer manager is responsible for designing developing and maintaining the infrastructure and systems required for data storage processing and analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration transformation and delivery for all data users across the enterprise. You will collaborate with various groups within the Technology organization and across the firm to deliver high-value technology solutions and achieve organizational success.

Designs and develops data pipelines that extract data from various sources transform it into the desired format and load it into the appropriate data storage systems

Collaborates with architects data scientists AI engineers and analysts to manage data as an asset and optimize models and algorithms for data quality security and governance

Integrates data from different sources including databases data warehouses APIs and external systems

Ensures data consistency and integrity during the integration process performing data validation and cleaning as needed

Transforms raw data into a usable format by applying data cleansing aggregation filtering and enrichment techniques

Optimizes data pipelines and data processing workflows for performance scalability and efficiency

Monitors and tunes data systems identifies and resolves performance bottlenecks and implements caching and indexing strategies to enhance query performance

Implements data quality checks and validations within data pipelines to ensure the accuracy consistency and completeness of data

Takes authority responsibility and accountability for exploiting the value of enterprise information assets and of the analytics used to render insights for decision making automated decisions and augmentation of human performance

Overall Scope : -

• A bachelors degree in computer science data science software engineering information systems or related quantitative field;

8 years of overall experience in data engineering primarily within data including experience with data modelling ETL / ELT data integration master data management / entity management data quality data warehousing analytics (prescriptive predictive) business intelligence data science and governance.

Proficiency in programming languages such as C# Python SQL and Java.

Experience with Microsoft technologies (SQL Server (IaaS PaaS) Synapse CosmosDB HDInsight Azure Data Factory Azure Databricks Power BI Fabric) Informatica cloud technologies (CIH DIH CDGC Master Data Management Data Quality) Snowflake and other relevant industry leaders.

Communicate clearly and concisely with others including senior leadership in and outside of the organization in a credible engaging and confident manner. Possess the ability to adapt communication style and method as necessary using the most effective communication method for each situation.

Summarize and translate complex technical information into straightforward language that is simple memorable and engaging for various technical and non-technical audiences helping with interpretation based on anticipated use of the information.

Ability to think critically and creatively. Demonstrate skill at using a variety of tools and processes to conduct research and analyses; Recognize trends in complex data and information; Use these insights to identify opportunities and make timely decisions taking into consideration the short and long-term implications of decisions. Advise key decision makers and influence others using persuasion and negotiation tactics.

Take the initiative to make things happen. Proactively look for solutions and help others to think ahead. Accept and seek challenges; Step outside of your comfort zone. Think and act strategically to drive the success of the business and enhance our client experience. Be innovative and share ideas for continuous improvement. Look for efficiencies in the way work is completed.

Be flexible and work effectively across various types of situations to achieve goals. Navigate through unexpected issues and be responsive to others needs. Prioritize different work streams and balance short-term versus long-term objectives.

Value individual differences and treat everyone with respect and kindness. Be appreciative of others; Strive for humility. Respect diverse backgrounds and ways of thinking. Listen to understand and express genuine interest in other perspectives. Strive to understand and take ownership of how your emotions and actions impact others.

Align actions with words and approach work and interactions with others with a positive attitude and an optimistic outlook. Assume positive intent. Stay composed and resilient during challenging times. Respond productively to conflict and have difficult conversations when needed.

Distinguish yourself with stakeholders in and outside the firm by growing your personal brand. Look for ways to share knowledge make an impact and leverage talents.

Desirable Characteristics

Certifications in relevant technologies listed above.

Previous experience in the professional services or accounting industry.

Previous client service or consultative experience.

Previous experience working in a managed services provider environment.

Reporting Relationship

If you are interested or have any references please share resume at

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1