GCP DATA ENGINEER

Senior Data Engineer With GCP

Long Term

Nashville TN

Skillset Required.

Project is for Migration of SQL Server on Prem to PostgreSQL on GCP.

• .. SQL Server
• ... Stored Procedure
• ... SSIS
• ... SSRS
• .. PostgreSQL
• ... Stored procedure
• .. GCP Data services

PostgreSQL on GCP

Job Description

Need to Know :

SQL Server

Intermediate level

Knowledge required : Tables views stored procedure user functions)

Why : Need to understand the source structure to be able to check in the target if the respective structure was created and the data was correct ingested

SSIS

Junior leve (basic understanding is enough)

Knowledge required : now how to use open the packages and identify the stored procedures database connections and other dependencies.

Why : to help Shannon map design the new solution with cloud run jobs

PostgreSQL

intermediate level.

Knowledge required : tables views stored procedure user functions

Why : the client is using a tool called ISPIRER ( MsSQL to PostgreSQL Migration Tool by Ispirer Free Trial) the tool was suppose to migrate all objects from SQL Server to PostgreSQL. However all item that face erros during the migration process will need to be done manually. Based on my tests until now this tool migrate tables and data perfectly but face some issues with stored procedures views user functions). At least 80% fof the job is done by the tool

Google Platform

Basic to intermediate level

Knowledge required : knows how to use the platform find the services like cloud run database instances etc.

Why : the migration is to GCP platform.

Database management tools

Intermediate level

Knowledge required : know how to use PGAdmin Dbeaver or any other tool to connect to the database and make any validation required

Nice to have

ISpirer

Why : tool used by the client to migrate databases from onprem to cloud (will be used in other projects as well)

Programming like go / python

Why : help Shannon if needed in the SSIS packages recreation

GCP Big Query

Why : the client is moving into the direction to have bigquery as the source of true. I believe this project will have a phase 2 and this knowledge will be important.

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1