Responsibilities :
- Design and implement Data ingestion and pipeline workflows as per business needs and technical specifications.
- Works independently and collaboratively with team; keeping the project team and leaders in the loop.
- Prepares detailed specifications from which data ingestion and pipeline processes are developed.
- Develops and implements technical solutions by code development and tool configuration.
- Querying databases using SQL (Structured Query Language) to extract relevant data for analysis and troubleshooting of defects / bugs.
- Responsible for the development and execution of testing and implementation plans. Can perform unit, system, integration and user acceptance testing. Documents results.
- Participates in project planning and development or assumes responsibility for a project of limited scope.
- Provides options for and estimates of possible coding.
- May be responsible for the completion of a phase of a project or small projects depending on complexity.
- Estimates and tracks time required to complete work, for project budgeting and financial tracking.
- Conducts and participates in reviews of solution designs, configurations and code.
- Provides technical expertise for project and baseline support teams.
- Adheres to security standards to comply in the handling / processing / storing of sensitive data.
- Adheres to development standards and provides development standards recommendations.
Education Level : 4-Year Bachelor's Degree
Years of Experience : 3+ years of professional experience
Technical Skills and Qualifications :
Must have :Google Pub / Sub
BigQueryGoogle DataformData ingestion to Big Query experienceGoogle Cloud StorageCloud ComposerGitHubSQLGood to have :Cloud Data fusion
DBMS connectivity and interaction experience (SQL Server, DB2, Oracle)Experience calling RESTful API's and SOAP WebservicesExperience integrating with other Google resources, databases, and servicesJiraConfluence