No longer accepting applications
MRC Confluent Kafka Senior Architect
Ness Digital EngineeringChicago, IL, United States12 days ago
Job type
- Full-time
Job descriptionWe need someone who's good at setting up CI / CD pipelines using DevOps tools like Jenkins, Artifactory, Confluent CFK, Kubernetes, Vault, SonarQube, GitHub, Terraform, Ansible, Rancher, and Harness. It's also important that DevOps Architect has experience with deploying the applications on Kubernetes using Rancher, Helm Charts and Harness. Plus, he / she should know about deploying Kafka MRC or CFK and the use of monitoring tools like Logic Monitor and Splunk. And it'd be great if he / she has experience with AWS services and on-prem as hybrid environment, especially setting up Confluent CFK or MRC, and know how to do S3 replication with Cloudian. Kubernetes Administration : Helm CRDs K8 Operators All general things in K8 including PVCs CFK Administration : Kafka Kraft / Zookeeper Kafka Connect Kafka Monitoring like consumer lag, broker health, topics growth, etc. Kafka Cluster Management (Topics, Partitions, Brokers, etc.) Kafka Backup Solution and Support Pilot Kafka data replication between AWS and On-Prem Experience with Rancher RKE2 K8s clusters and orchestration platform K8S cluster management, Monitoring, operational tools integration K8s cluster and secrets management integration K8s CSI plug-ins with object, file and block storage vendors Kubernetes backup solution and support S3 / Cloudian object storage for shared infrastructure Specializing in Cloud Infrastructure Modernization, virtualization, data center setup, DR & BC Strategies, and DevOps Experience in on-premises data center operations, AWS hosted data center and operations management Hands on experience with migrations tools Experience with continuous deployment tools, techniques, and automation frameworks - especially Terraform Enterprise and Ansible. Hands-on experience writing testable scripts using Python or other languages. Experience managing helm charts and deploying into Kubernetes (K8s) Expertise with monitoring related tools and frameworks like Splunk, LogicMonitor, SignalFX, and Prometheus. Worked on projects involving deployment and management of micro services, and hybrid cloud / on-prem infrastructure Intermediate working knowledge of development tools like Maven / Gradle, Java, and distributed message brokers like Kafka, RabbitMQ, ActiveMQ, Amazon Kinesis, etc. Good to Have Knowledge of setting up CI / CD pipelines for streaming Flink based applications is an added advantage
Description
Position at Ness Digital Engineering
Ness is seeking an DevOps Architect with Confluent Kafka (MRC / CFK), Kubernetes expertise. Customer is required by regulators to demonstrate the ability to run all clearing and risk systems through internal datacenter ("On-Prem") and to be able to switch all production functionality running through On-Prem within the predefined SLA. The newly developed clearing and risk systems takes advantage of scalability, ease of provision, and the reduced cost offered by cloud services (AWS) and the cloud offered Multi-Region as Disaster Recovery (DC) strategy.
Responsibilities :
- As a DevOps Architect, setup CI / CD pipeline for application deployment in Kubernetes
- Setup Confluent Kafka (MRC or CFK) across all the regions in hybrid environment
- Setup Rancher and downstream Kubernetes clusters in multiple environments and regions
- Setup IaC pipelines using TFE and Ansible to automate the Kafka cluster deployments
- Setup IaC pipelines using TFE and Ansible to automate the Rancher and downstream K8 cluster deployments
- Work in the DevOps team, to build new shared infrastructure services for on premises failover environment : S3, Confluent Kafka, Data Store
- Work with DevOps team to establish connectivity between new failover shared services and existing shared services : Secret, identity, LDA, DNS, Artifactory, Jenkins, Splunk services
- Work with DevOps team to automate deployment DR strategy Automation of data replication between Cloud and failover environment required between all applications and shared services CI / CD deployment tools
- Continuously improve the processes and the DevOps team using thoughtful, calculated approaches to identify opportunities, and challenge those around you to strive for perfection.
- Ideate solutions to complex technical challenges; code, test, troubleshoot, debug, and document the solutions you develop. Use agile software development model to produce well-designed programs, scripts, and tools required to provision, configure, and monitor new shared infrastructure services for on premises failover environment
Must have :
Create a job alert for this search
Senior Architect • Chicago, IL, United States
Related jobs
We are seeking an experienced Enterprise Architect with deep expertise in cloud and SaaS architectures to lead resiliency assessments and ensure alignment with organizational standards for reliabil...Show moreLast updated: 24 days ago
Coalfire is on a mission to make the world a safer place by solving our clients’ hardest cybersecurity challenges.We work at the cutting edge of technology to advise, assess, automate, and ultimate...Show moreLast updated: 2 days ago
You have a clear vision of where your career can go.And we have the leadership to help you get there.At CNA, we strive to create a culture in which people know they matter and are part of something...Show moreLast updated: 30+ days ago
This award-winning international architecture, interiors and planning firm has designed iconic structures and spaces across the US, Asia, Europe, and globally.
With an extensive portfolio encompassi...Show moreLast updated: 10 days ago
Our client is seeking a Senior Solution Architect, Data Platforms (Financial Risk Focus) to join their team! This position is located in Chicago, Illinois.
Provide strategic vision for data architec...Show moreLast updated: 23 hours ago
Senior Architect AI and Cloud (Azure) Solutions.In this role, you will be a key leader in designing and building the next generation of our AI-driven products and services.You will bridge the gap b...Show moreLast updated: 30+ days ago
Hitachi Solutions is a global Microsoft solutions integrator focused on industry-focused solutions and business transformation through Microsoft technologies.
We support clients to unify, automate, ...Show moreLast updated: 30+ days ago
AECOM is seeking a Technical Architect to be based in Chicago, IL.AECOM is a globally recognized architecture and engineering design firm.
This global presence allows our creative designers to have ...Show moreLast updated: 7 hours ago
FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers.Powered by premium video content, robust data, and advanced technology, we’re making ...Show moreLast updated: 12 days ago
Every dollar earned, relationship formed, and advantage gained comes down to the contract that makes it real.But getting a contract done is more complicated than it should be.And when contract data...Show moreLast updated: 9 days ago
We're building a relationship-oriented bank for the modern world.We need talented, passionate professionals who are dedicated to doing what's right for our clients.
At CIBC, we embrace your strength...Show moreLast updated: 7 hours ago
AArete is one-of-a-kind when it comes to consulting firm culture.We're a global, innovative management and technology consulting firm, with offices in the U.
Our name comes from the Greek word for e...Show moreLast updated: 4 days ago
Every dollar earned, relationship formed, and advantage gained comes down to the contract that makes it real.But getting a contract done is more complicated than it should be.And when contract data...Show moreLast updated: 8 days ago
Develop a business-aligned integration architecture strategy covering all aspects of integration (API, data, files, B2B, and more), ensuring designs adhere to security, compliance, and data governa...Show moreLast updated: 1 day ago
We are seeking a dynamic and experienced Databricks professional to join our client, a growing Chicago-based Data & AI consultancy, as a Senior Databricks Data Architect.Databricks Data Archite...Show moreLast updated: 23 hours ago
Responsible for promoting use of industry and Company technology standards.Monitors emerging technologies / technology practices for potential use within the company.
Designs and develops updated infr...Show moreLast updated: 15 days ago
Expedia Group brands power global travel for everyone, everywhere.We design cutting-edge tech to make travel smoother and more memorable, and we create groundbreaking solutions for our partners.Our...Show moreLast updated: 1 day ago
We are seeking a highly skilled Oracle Applications Solution Architect to join our team.The ideal candidate will have extensive experience in implementing Oracle applications and a deep understandi...Show moreLast updated: 4 days ago
Senior Product Specialist In Sap S / 4Hana Financial Accounting.The Senior Product Specialist in SAP S / 4HANA Financial Accounting plays a crucial role in the effective implementation, customization, ...Show moreLast updated: 7 hours ago
Huron is a global consultancy that collaborates with clients to drive strategic growth, ignite innovation and navigate constant change.
Through a combination of strategy, expertise and creativity, w...Show moreLast updated: 7 hours ago
- Promoted
Enterprise Architect
Compunnel, Inc.Chicago, IL, United StatesFull-time
- Promoted
Enterprise Architect Consultant
MediumChicago, IL, United StatesFull-time
- Promoted
Enterprise Architect – Underwriting Portfolio(s)
CNAChicago, IL, United StatesFull-time
- Promoted
Senior Project Architect
API Partners, LLCChicago, IL, USFull-time
- Promoted
Senior Solution Architect, Data Platforms (Financial Risk Focus)
KellyMitchell GroupChicago, IL, USFull-time
- Promoted
Senior Architect AI and Cloud (Azure) Solutions
Publicis SapientChicago, IL, United StatesFull-time
- Promoted
D365 F&O Senior Solution Architect
Hitachi Vantara CorporationChicago, IL, United StatesFull-time
- Promoted
- New!
Senior Technical Architect (Chicago)
AECOMChicago, IL, United StatesFull-time
- Promoted
Software Architect 6
ComcastChicago, IL, United StatesFull-time
- Promoted
Enterprise Architect
Ironclad Inc.Chicago, IL, United StatesFull-time
- Promoted
- New!
Senior Technical Architect (Chicago)
CIBCChicago, IL, United StatesFull-time
- Promoted
Senior Solutions Architect (Chicago)
AAreteChicago, IL, United StatesFull-time
- Promoted
Enterprise Architect
IroncladChicago, IL, United StatesFull-time
- Promoted
Director Enterprise Integration Architect
KPMG CareersChicago, IL, United StatesFull-time
- Promoted
Senior Architect - Databricks
ON Data StaffingChicago, IL, USFull-time
- Promoted
Architect 6, Enterprise Architecture
ComcastChicago, IL, United StatesFull-time
- Promoted
Senior Solution Architect
Expedia, Inc.Chicago, IL, United StatesFull-time
- Promoted
Oracle Enterprise Solution Architect
iteria.usSchaumburg, IL, United StatesFull-time
- Promoted
- New!
Senior Technical Architect (Chicago)
eTeamChicago, IL, United StatesFull-time
- Promoted
- New!
Digital Consulting Director - Oracle Cloud Technical Architect (Nationwide, Flexible Location) (Chicago)
Huron Consulting GroupChicago, IL, United StatesFull-time