Consultant SME (Data Scientist-Data Bricks)

Consultant SME (Data Scientist-Data Bricks)

Description :

Our Client is seeking a resource well skilled in Cloud architecture to support the following technologies (Delta Lake storage / Big Data and Machine Learning analytics ( Apache Spark) to help meet organization priorities. As a technical expert, provides advice and assistance in state-of-the-art software / hardware solutions involving hardware of various capacities, multiple operating environments, database management systems specialized software, data communications facilities and protocols including Value Added Networks, fourth generation technologies, and complex software tools or packages. As a business expert, works with senior client officials to identify enterprise improvement goals, assess organizational and process effectiveness, and implement change strategies.

Roles and Responsibilities include but not limited to :

• Minimum 15 year’s IT Architecture / Systems experience
• 10 years experience designing technical and business solutions, mentors, and trains client staff, and oversees implementation.
• Highly diverse technical and industry experience related to studying and analyzing system’s needs, systems development, and systems process analysis, design, and reengineering.
• Possesses skills and experience related to business management, systems engineering, operations research, and management engineering. Typically has specialization in a particular technology or business application. Keeps abreast of technological developments and industry trends.
• Assist with deployment, configuration, and management Azure Cloud environment.
• Assist with migration efforts of existing ETL jobs into Azure / Databricks cloud environment.
• Assist ETL staff with following best practices for Cloud, maximizing efficiency of cloud resources, and general knowledge sharing of cloud expertise with AA Cloud Staff
• Assist with Operationalizing deployments and support of Cloud services for ETL Operations. This will include standardizing and automating processes and workflows, creating documentation / knowledge articles, and overall assist Operations staff who have limited experience in Cloud.

Basic Qualifications :

• Strong skills and experience in regards to Cloud Operations support in Azure.
• Strong Experience supporting large scale / enterprise level Cloud environments.
• Strong Experience supporting several cloud services related to compute, network, databases, etc…
• Experience in using Databricks or other Spark-based platforms.
• Knowledge of or experience in using any of the following : Sqoop, Oozie, Flume
• Fluency in at least one scripting language (Python, Perl, Ruby or equivalent)
• Ability to troubleshoot cloud resource problems and perform complex system tests.
• Develop and maintain accurate documentation for internal procedures and services.
• Ability to automate solutions to repetitive problems / tasks.
• Ability to use a wide variety of open-source technologies and cloud services.
• Integration of Git, in continuous deployment
• Experience with DevOps monitoring tools
• Knowledge of best practices and IT operations in an always-up, always-available service
• Creative thinking skills
• Detail-oriented personality
• Ability to communicate well to other members of the development team.
• Significant experience with SAS, Python, C++, Hadoop, SQL Database / Coding, Apache Spark, Machine Learning, Natural Language Processing, and visualization tools such as Tableau
• Demonstrated experience working with unstructured data.

Desired Skills :

• Strong understanding of cloud networking at scale
• Ability to break down complex networking concepts and present them in a concise way.
• Shell scripting experience
• PowerShell

Data Transfer :

The selected resource will be required to conduct knowledge-transfer sessions as necessary to share best practices and template code / scripts in each of the following areas :

• Monitoring (Infrastructure and Application-specific)
• Troubleshooting
• Incident Alerting
• Incident Avoidance
• Development of dashboards
• Settings and configuration
• Security
• How to test the platform and / or application(s)
• Preparing audit compliance reports

Reporting :

Expertise producing and deliver of monthly status reports to inform the Client of its progress and identify any anticipated problems. The progress reports shall include, but are not limited to, the following :

• Work progress
• Identified risks or technical issues with associated recommendations and proposed contingency.
• Schedule deviations and proposed plans to recover.

Education :

• A Master ‘s Degree from an accredited College / University in the applicable field of services