Data Engineer Senior

Miracle Software Systems
Michigan, USA
Full-time

Skills Required :

  • Experience in working in an implementation team from concept to operations, providing deep technical subject matter expertise for successful deployment.
  • Implement methods for automation of all parts of the pipeline to minimize labor in development and production
  • Experience in analyzing complex data, organizing raw data, and integrating massive datasets from multiple data sources to build analytical domains and reusable data products
  • Experience in working with architects to evaluate and productionalize data pipelines for data ingestion, curation, and consumption
  • Experience in working with stakeholders to formulate business problems as technical data requirements, identify and implement technical solutions while ensuring key business drivers are captured in collaboration with product management

Experience Required :

  • 5+ years of SQL development experience
  • 5+ years of analytics / data product development experience required
  • 3+ years of cloud experience (GCP preferred) with solutions designed and implemented at production scale
  • Experience working in GCP native (or equivalent) services like Big Query, Google Cloud Storage, PubSub, Dataflow, Dataproc, Cloud Build, etc.
  • Experience working with Airflow for scheduling and orchestration of data pipelines
  • Experience working with Terraform to provision Infrastructure as Code
  • 2 + years professional development experience in Java or Python

Experience Preferred :

  • In-depth understanding of Google’s product technology (or other cloud platform) and underlying architectures
  • Experience in working with DBT / Dataform
  • Experience with DataPlex or other data catalogs is preferred
  • Experience with development eco-system such as Tekton, Git, Jenkins for CI / CD pipelines
  • Exceptional problem solving and communication skills
  • Experience in working with Agile and Lean methodologies
  • Team player and attention to detail
  • Experience with performance tuning SQL queries

Education Required :

  • Bachelor’s degree in computer science or related scientific field
  • 30+ days ago
Related jobs
Promoted
VirtualVocations
Warren, Michigan

A company is looking for a Senior Data Engineer II to develop and maintain data products and pipelines for healthcare services. ...

Systems Technology Group, Inc. (STG)
Dearborn, Michigan

Title: Senior GCP (Google Cloud Platform) Data Engineer. Senior GCP (Google Cloud Platform) Data Engineer. Design and implement data-centric solutions on Google Cloud Platform (GCP) using various GCP tools like Big Query, Google Cloud Storage, Cloud SQL, Memory Store, Dataflow, Dataproc, Artifact Re...

Promoted
VirtualVocations
Warren, Michigan

A company is looking for a Senior Software Engineer, Data Quality. ...

V2Soft
Dearborn, Michigan

Experience with designing and developing end-to-end data and analytics solutions leveraging Azure Data Lake, Azure Databricks, and Data Factory. Azure Data Engineering or Databricks Certification. Design and implementation of complex cloud solutions using Microsoft Azure, focusing on integration wit...

Promoted
VirtualVocations
Warren, Michigan

A company is looking for a Senior Software Engineer, ML Data Pipeline. Key Responsibilities:Collaborate with perception experts and roboticists to scale solutions for L3 driving systemsArchitect and implement state-of-the-art solutions in machine learning domainsDevelop cloud services for data manag...

KION Group
Grand Rapids, Michigan

Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions. Solid experience implementing data lineage, data quality and data observability for big data workflows. Strong experience with modern data modeling, data archite...

Ally
Detroit, Michigan

The Senior Data Engineer will be a part of the Enterprise Data & Analytics team. The individual will be a part of the engineering team that develops data pipelines & objects in the warehouse. The cloud based warehouse is expected to contains the data, historical & transactional, for several up-strea...

GE Aerospace
Grand Rapids, Michigan

The Senior Systems Engineer is responsible for leading a team through all parts of the systems engineering lifecycle throughout the development of Flight Data Recorders. The Senior Systems Engineer must have broad and deep level of expertise that relates to Flight Data Recorders. Lead Systems Engine...

Labor Staffing Solutions
Detroit, Michigan
Remote

Entech Staffing Solutions is seeking a Senior Data Engineer for a remote position based out of Detroit, MI! This position is paying up to $75/hour and begins right away. Lead data analysis required to troubleshoot data related technical issues and resolution. Computer Science, Engineering, Mathemati...

BDO
Grand Rapids, Michigan

Net, C#, Qlik, Power BI, Machine Learning, Azure Data Factory, RedShift, UiPath, Cloud, RPA, AWS, Redshift, Kinesis, QuickSight, SageMaker, S3, Databricks, AWS Lake Formation, Snowflake, Python, Qlik, Athena, Data Pipeline, Glue, Star Schema, Data Modeling, SQL, SSIS, SSAS, SSRS, PySpark, Microsoft ...