Talent.com
Certified Cloud Engineer
Certified Cloud EngineerKaav Inc. • Madison, WI, United States
Certified Cloud Engineer

Certified Cloud Engineer

Kaav Inc. • Madison, WI, United States
12 days ago
Job type
  • Full-time
Job description

Candidates MUST be WI residents or willing to relocate to WI at their own expense prior to starting. This position can work 100% remotely (within the state of WI).

AWS Engineer

The Universities of Wisconsin Enterprise Analytics Platform (EAP) team supports the development and support of the data lake for the UW System Office and member universities. We are seeking an experienced AWS Redshift Data Engineer to assist our team in designing, developing, and optimizing data pipelines for our AWS Redshift-based data lake house. Priority needs are cloud formation and event-based data processing utilizing SQS to support ingestion and movement of data from Workday to AWS Redshift for consumer and analytic use.

Key Responsibilities :

  • Collaborate with data engineering, business analysts, and development teams to design, develop, test, and maintain robust and scalable data pipelines from Workday to AWS Redshift.
  • Architect, implement, and manage end-to-end data pipelines, ensuring data accuracy, reliability, data quality, performance, and timeliness.
  • Provide expertise in Redshift database optimization, performance tuning, and query optimization.
  • Assist with design and implementation of workflows using Airflow.
  • Perform data profiling and analysis to troubleshoot data-related challenges / issues and build solutions to address those concerns.
  • Proactively identify opportunities to automate tasks and develop reusable frameworks.
  • Work closely with version control team to maintain a well-organized and documented repository of codes, scripts, and configurations using Git / Bitbucket.
  • Provide technical guidance and mentorship to fellow developers, sharing insights into best practices, tips, and techniques for optimizing Redshift-based data solutions.

Required Qualifications and Skills :

  • Advanced hands-on experience designing AWS data lake solutions.
  • Experience integrating Redshift with other AWS services, such as DMS, Glue, Lambda, S3, Athena, Airflow.
  • Proficiency in Python programming with a focus on developing efficient Airflow DAGs and operators.
  • Experience with Pyspark and Glue ETL scripting including functions like relationalize, performing joins and transforming dataframes with pyspark code.
  • Competency developing CloudFormation templates to deploy AWS infrastructure, including YAML defined IAM policies and roles.
  • Experience with Airflow DAG creation.
  • Familiarity with debugging serverless applications using AWS tooling like Cloudwatch Logs & Log Insights, Cloudtrail, IAM.
  • Ability to work in a highly complex python object oriented platform.
  • Strong understanding of ETL best practices, data integration, data modeling, and data transformation.
  • Proficiency in identifying and resolving performance bottleneck and fine-tuning Redshift queries.
  • Familiarity with version control systems, particularly Git, for maintaining a structured code repository.
  • Strong coding and problem-solving skills, and attention to detail in data quality and accuracy.
  • Ability to work collaboratively in a fast-paced, agile environment and effectively communicate technical concepts to non-technical stakeholders.
  • Additional Useful Experience :

  • Docker
  • Airflow Server Administration
  • Parquet file formats
  • AWS Security
  • Jupyter Notebooks
  • API Best Practices, API Gateway, Route Structuring and standard API authentication protocols including tokens
  • Git, Git flow best practices
  • Release management and DevOps
  • Shell scripting
  • AWS certifications related to data engineering or databases are a plus.
  • Experience with DevOps technologies and processes.
  • Experience with complex ETL scenarios, such as CDC and SCD logics, and integrating data from multiple source systems.
  • Experience in converting Oracle scripts and Stored Procedures to Redshift equivalents.
  • Experience working with large-scale, high-volume data environments.
  • Exposure to higher education, finance, and / or human resources data is a plus.
  • Proficiency in SQL programming and Redshift stored procedures for efficient data manipulation and transformation.
  • Required Skills : Cloud SQL,AWS Cloud Formation

    Additional Skills : Cloud Engineer,AWS Engineer

    Create a job alert for this search

    Cloud Engineer • Madison, WI, United States

    Related jobs
    Senior Cloud Solutions Engineer

    Senior Cloud Solutions Engineer

    Humana • Madison, WI, United States
    Full-time
    Become a part of our caring community and help us put health first.The Senior Cloud Solutions Engineer participates in the design and development of cloud-based solutions and applications in the bi...Show more
    Last updated: 12 days ago • Promoted
    Restaurant Delivery - Flexible Onboarding

    Restaurant Delivery - Flexible Onboarding

    DoorDash • Brodhead, WI, United States
    Full-time +1
    DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day. As a Dasher, you’ll stay busy with a variety o...Show more
    Last updated: 26 days ago • Promoted
    Lead Knowledge and Request Analyst

    Lead Knowledge and Request Analyst

    American Family Insurance • Madison, WI, United States
    Full-time
    The Team Lead for Knowledge and Request Management plays a crucial role in overseeing and guiding the team responsible for managing the organization's knowledge base and handling service requests e...Show more
    Last updated: 30+ days ago • Promoted
    Lead Cloud Architect with LIS or LIMS

    Lead Cloud Architect with LIS or LIMS

    Mitchell Martin • Madison, WI, United States
    Full-time
    Lead Cloud Architect with LIS or LIMS.Pay Range : $150,000-$170,000 Per Year.This full-time role located in Madison, WI, requires designing and supporting cloud services and platforms.The position in...Show more
    Last updated: 18 days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    GovCIO • Madison, WI, United States
    Full-time
    GovCIO is currently hiring for a Cloud Engineer tomanage service provider for Army and DoD IT systems.This position will be located in Radford,VA and will be a remote position.The cloud engineer de...Show more
    Last updated: 30+ days ago • Promoted
    IT / Cloud Architect

    IT / Cloud Architect

    Syntricate Technologies • Madison, WI, United States
    Full-time
    The Wisconsin Historical Society (WHS) in Wisconsin is looking for an IT / Cloud Architect for an ongoing contract position. State Street, Madison, WI, 53706.Remote work is allowed and encouraged when...Show more
    Last updated: 30+ days ago • Promoted
    Senior SaaS Cloud Capacity Engineer

    Senior SaaS Cloud Capacity Engineer

    Oracle • Madison, WI, United States
    Full-time
    Act as a strategic capacity partner, immersing in the end-to-end architecture and performance of SaaS production services. Ensure mission-critical workloads-including emerging.OCI cloud capacity at ...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    Cardinal Health • Madison, WI, United States
    Full-time
    What Cloud Engineering contributes to Cardinal Health.This position will be responsible for performing special projects or tasks in a timely manner, as assigned by Product Owner, Technology leader ...Show more
    Last updated: 12 days ago • Promoted
    Lead Knowledge and Request Analyst

    Lead Knowledge and Request Analyst

    American Family Mutual Insurance Company • Madison, WI, United States
    Full-time
    The Team Lead for Knowledge and Request Management plays a crucial role in overseeing and guiding the team responsible for managing the organization's knowledge base and handling service requests e...Show more
    Last updated: 19 days ago • Promoted
    Travel MRI Tech - $2,392 per week in Janesville, WI

    Travel MRI Tech - $2,392 per week in Janesville, WI

    Flexcare • Orfordville, WI, United States
    Full-time
    FlexCare is a nationwide leader in the staffing of travel nurses and clinicians.With access to thousands of facilities around the country, our mission is to deliver premier travel staffing solution...Show more
    Last updated: 12 days ago • Promoted
    Certified Cloud Engineer AWS

    Certified Cloud Engineer AWS

    Nava Software Solutions • Madison, WI, United States
    Full-time
    NAVA Software solutions is looking for a Certified Cloud Engineer / AWS Engineer.Certified Cloud Engineer / AWS Engineer. Location : Remote project (Need to be based in WI state).The Enterprise Analyti...Show more
    Last updated: 12 days ago • Promoted
    Sr Infrastructure Engineer

    Sr Infrastructure Engineer

    Promega Corporation • Madison, WI, United States
    Full-time
    At Promega, our IT team is dedicated to delivering exceptional customer service, ensuring the stability of our systems, and driving operational efficiency across the organization.We operate as both...Show more
    Last updated: 30+ days ago • Promoted
    Software Development Engineer

    Software Development Engineer

    Amazon • Sun Prairie, WI, USA
    Full-time
    Join Amazon's engineering team and help us build innovative solutions to complex problems.As a Software Development Engineer, you will design, develop, and test software applications and services.W...Show more
    Last updated: 23 days ago • Promoted
    Cloud Architect

    Cloud Architect

    Ryder • Madison, WI, United States
    Full-time
    Job Seekers can review the Job Applicant Privacy Policy by clicking here ().The Cloud Architect will play a pivotal role in shaping Ryder's cloud strategy and operational excellence.This individual...Show more
    Last updated: 30+ days ago • Promoted
    Entry Level Cloud Engineer

    Entry Level Cloud Engineer

    SynergisticIT • Madison, WI, United States
    Full-time
    For more than 14 years Synergisticit has helped Jobseekers stand out from other Jobseekers by providing candidates the requisite skills, experience and technical competence to outperform at intervi...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Computing Specialist (CCS) SME

    Cloud Computing Specialist (CCS) SME

    ASM Research, An Accenture Federal Services Company • Madison, WI, United States
    Full-time
    Serves as an Information Assurance and Cloud computing SME with regards to Certification and Accreditation (C&A) and a broad coverage of the application of the National Institute of Standards and T...Show more
    Last updated: 30+ days ago • Promoted
    FedRAMP Senior Cyber Engineer (Multiple Levels)

    FedRAMP Senior Cyber Engineer (Multiple Levels)

    Noblis • Madison, WI, United States
    Full-time +1
    Are you a Cyber Security professional or a Cloud Computing Engineer / Architect interested in Cyber Security? Are you looking to make an impact across the entire federal government? Do you want to he...Show more
    Last updated: 18 days ago • Promoted
    Certified Cloud Engineer

    Certified Cloud Engineer

    Concord IT Systems • Madison, WI, United States
    Full-time
    Collaborate with data engineering and development teams to design, develop, test, and maintain robust and scalable ELT / ETL pipelines using SQL scripts, Redshift stored procedures, and other AWS too...Show more
    Last updated: 5 days ago • Promoted