Search jobs > St Louis, MO > Remote > Temporary > Technical lead remote

AWS Data Lake Technical Lead - REMOTE with Vocational Onsite Visits at Waterbury, VT (Travel Expense

My3Tech
Saint Louis, MO, US
Remote
Full-time

Job Title : AWS Data Lake Technical Lead

Job Location : REMOTE with Vocational Onsite Visits at Waterbury, VT (Travel Expenses will be reimbursed)

Duration : 3+ Years Contract

Job Description : Background :

Background :

Client is seeking to improve statewide law enforcement data access. The purpose is to design and implement a state-controlled system to access de-identified, aggregated law enforcement and related data currently housed in a record management system.

Client in collaboration with the Agency of Digital (ADS) Services, is seeking to procure Amazon Web Service (AWS) professional services to work with the ADS Technical Lead to build out the Public Services Lakehouse environment.

Existing Technology Environment

Client currently uses a Computer Aided Dispatch Records Management System (CAD RMS) system that is currently running in a MySQL instance that will be used in the first phase of the Data Lake build.

The supplemental data ranges from SQL server instances and flat file sources that are currently housed internally either in SharePoint or internal file stores.

Requirements :

Design and implement the Clients’ Data Lake in the AWS Environment

  • Store Data in AWS CJIS compliant environment.
  • Implement and design the lake house technologies with the IT Tech Lead
  • assigned to the project.
  • Design and implement using latest AWS Lake House standards.
  • Data Security Layer
  • Implement and design security Identity and Access Management roles and processes.
  • Design and Create security IAM templates.
  • Data Ingestion Layer
  • Ingestion Design for variety of sources
  • Operational Database Sources
  • MySQL, SQL Server
  • SaaS Applications
  • File Shares (SharePoint and one drive)
  • Stream Data Sources
  • System Templates of ingestion processes
  • Data Storage Layer
  • AWS S3 CJIS compliant S3 buckets
  • AWS Redshift Infrastructure
  • Power BI Connector process
  • Data Processing Layer
  • Data Extract, Load and Transform (ELT) process for loading from source to S3 and Transforming data from S3 to Redshift for reporting and analytics.
  • Templates for creating ELT processes for future processes.
  • Data Catalog Layer
  • Design and implement solution to solve data schema drift in AWS Glue for use with reporting and analytical needs.
  • Design and build crawlers for schema and build catalog that stores schema information.
  • Meta data store in catalog for consumption in data warehouse
  • Create Catalog crawler templates for data sources.
  • Create Templates for expansion of the data lake for future agencies.
  • Base data warehouse implemented environment for reporting / dashboard use.
  • Template designs for future data Lakehouse implementations.
  • Lake House design needs to be able to be used by Power BI
  • Design each layer for scaling based on usage.

Professional Service Requirements :

  • AWS Lakehouse Certification
  • AWS Design and Implementation Lake House Technologies
  • AWS IAM
  • AWS Lakehouse Technology
  • AWS Glue Knowledge
  • Data Catalog and Crawler
  • AWS Redshift
  • AWS Athena
  • CJIS certified data storage
  • AWS CJIS Data location
  • CJIS Security Background Check (See Additional Attachments / Assurances)
  • 1 day ago
Related jobs
Promoted
Calance
St. Louis, Missouri
Remote

Epic Unified Communications: strategic planning and analysis and vendor standardization for Epic’s suite of features including, Staff Directory, Secure Chat, Push Notifications,. On-Call Scheduling and Messaging, Alert Communicator and VOIP integration with Epic. Previous Experience leading Rover im...

Promoted
Vaco
St. Louis, Missouri

Vaco is an Equal Opportunity Employer and does not discriminate against any employee or applicant for employment because of race (including but not limited to traits historically associated with race such as hair texture and hair style), color, sex (includes pregnancy or related conditions), religio...

Promoted
VirtualVocations
Florissant, Missouri
Remote

A company is looking for a Remote AWS Cloud Engineer Lead. ...

Promoted
Confidential
St. Louis, Missouri
Remote

The company considers all qualified candidates for employment and does not discriminate based on race, color, gender (including pregnancy), sexual orientation, religion, creed, age, national origin, physical or mental disability, gender identity/expression, marital status, veteran status, or any oth...

Promoted
VirtualVocations
Florissant, Missouri
Remote

A company is looking for a Salesforce Technical Architect with Loyalty Management for a remote working opportunity. ...

Promoted
apexanalytix
St. Louis, Missouri
Remote

Desired candidate will possess extensive experience selling financial software solutions and consulting services to Accounting, Finance, Treasury, and Procurement organizations within Fortune 1000 Companies. Experience with financial software solutions and consulting services to Accounting, Finance,...

Promoted
JPMorgan Chase
St. Louis, Missouri
Remote

Perform call monitoring and assessment of agents for inbound calls and participate in call calibration exercises Conduct team meetings to update members on best practices and continuing expectations and administer corrective action when needed, following all departmental guidelines and established t...

Promoted
tekHouse
St. Louis, Missouri
Remote

Integration of user-facing elements developed by front-end developers with server-side logic Writing reusable, testable, and efficient code Design and implementation of low-latency, high-availability, and performant applications Skills: Strong proficiency with TypeScript and Node. You will also be r...

Professional At Home Jobs
St. Louis, Missouri
Remote

Documents must translate into easy to consume data that can be leveraged by various team levels across the organization to assist with technical architecture, engineering, and operational support. Research, create, and maintain information architecture templates that uphold organizational and legal ...

MiTek
Chester, MO, USA
Remote

Maintain records of daily data communication transactions, problems, and remedial actions taken, or installation activities with use of Heat and Test Track. MiTek is a platform innovator and enabler that exists to transform the building industry with better building solutions. In 1955, MiTek transfo...