Talent.com
Senior Database Engineer(Elastic/Mongo/Hadoop)
Senior Database Engineer(Elastic/Mongo/Hadoop)CatchProbe Intelligence Technologies • San Francisco, California, United States
Senior Database Engineer(Elastic / Mongo / Hadoop)

Senior Database Engineer(Elastic / Mongo / Hadoop)

CatchProbe Intelligence Technologies • San Francisco, California, United States
Hace 17 días
Tipo de contrato
  • A tiempo completo
Descripción del trabajo

Senior Database Engineer(Elastic / Mongo / Hadoop)

Senior Database Engineer(Elastic / Mongo / Hadoop)

Workplace Type : Remote - Region :

San Francisco, CA

Job Description

  • Must have experience with MongoDB installations, upgrades, support on MongoDB
  • Responsible for administration, maintenance, Performance analysis, and Capacity planning for Mongo dB / Elastic / Hadoop clusters.
  • Coordinate and plan with Application teams on Mongodb capacity planning for new applications.
  • Should have knowledge of using mongo base tools - like mongodump , mongoexport ,mongorestore, mongoimport , mongostat , mongotop
  • Must be well-versed with JSON scripting , writing queries in mongo in shell scripts and in the mongo shell
  • Should be able to support sharded clusters and perform upgrades and other config maintenance on sharded clusters
  • Must be able to address , monitor and manage capacity requirements - all aspects CPU , memory and storage .
  • Must be able to assist application teams with assessment and / or resolution of performance bottlenecks observed in the MongoDB Database tier of their stack
  • Must be aware of different authentication / authorization methods used in Mongo - SCRAM-SHA1 , X509 , LDAP - including reconfiguration of instances with TLS / SSL and / or LDAP
  • Candidate must also be able to develop automated solutions for ad-hoc script execution requests, ad-hoc report generation, upgrades , installs
  • Experienced in NoSQL DB technologies
  • Must be aware of how to use Cloud manager and share relevant metrics for a given deployment when an issue arises
  • Must have experience with docker, deploying Mongo containers running on docker and supporting all aspects of MongoDB administration needs within a docker container
  • Knowledge of administration and support of Hadoop systems will be an added advance.
  • Deploy Hadoop(Bigdata) cluster, Comm / decommissioning of nodes, track jobs, monitor services like zookeeper, hbase, SOLR indexing, configure name-node HA, schedule, configuring backups & restore
  • To develop script to review logs and alert us in case of long running queries.
  • Demonstrable expertise (deployment, use) in some of the following data storage technologies : Postgres / MySQL (“on-prem”, RDS, Aurora), Kafka / Kinesis (“on-prem” or managed),
  • Strong scripting experience with Python (preferred), and Shell (secondary).
  • Individually build services, and expose internal APIs for these services that allow other teams, and workflows to use data infrastructure automation components.

Required Skills

  • Strong Understanding of various relational and non-relational database technologies along with their benefits, downsides and best use-case and help application teams to use the correct database technology based on their specific business use case.
  • 5+ year installing, automating, scaling and supporting NoSQL databases such as MongoDB, ElasticSearch, Hadoop, among other emerging technologies.
  • 1-2 years Experience working with the databases in public Clouds like Hetzner, AWS, Azure and GCP.
  • Proficiency in automation
  • Knowledge of Ansible, Python, Terraform
  • Willingness and commitment to learn other database, automation, and Cloud technologies
  • Great communication and collaboration skills
  • Software development experience and knowledge of modern software development processes.
  • Knowledge / experience in development programming languages such as Java, Go, Nodejs, html, CSS, bootstrap etc. is a plus.
  • Knowledge / experience on AI / ML is a big plus.
  • Ability to multi-task and prioritize with little to no supervision, providing team leadership skills.
  • Ability to work well under pressure
  • Consistent exercise of independent judgment and discretion in matters of significance
  • Excellent communication skills
  • Highly driven, highly involved, highly proactive
  • Datalake cluster ownership and Technical point of contact for all applications on Hadoop cluster
  • Responsible for new application on-boarding in Datalake by reviewing requirement and design.
  • Assist existing and new applications to come up with most optimized and suitable solutions for their requirement
  • L3 point of contact for issues related to Hadoop platform
  • Core Responsibilities

  • Develops solutions for very complex and wide reaching systems engineering problems. Sets new policies and procedures to handle future issues. Creates systems engineering and architectural documentation to be used by others to build and maintain systems.
  • Operating Systems & Disk Management : Provides in-depth knowledge of Operating System internals to aid in solving complex problems. Acts as an authority on at least one supported Operating System. Mentors and trains more junior team members on Operating System concepts, configuration, tuning and troubleshooting techniques. Creates basic task automation scripts in Shell, Perl, VBscript, or similar. May manage servers remotely in a distributed environment.
  • Database Platform Management : Masters understanding of database concepts, availability, performance, usage and configuration. Sets up, fixes and tunes complex standard and non-standard replication. Uses knowledge of existing database platforms to evaluate and recommend new technologies. Uses database knowledge to solve issues on unfamiliar products. Creates and maintains database policies, standards and overall documentation including availability, replication, availability and backup and recovery policy, service level agreement, baseline architecture, change management, access to production, unsupported HW / SW, security & audit violations and risk acceptance.
  • Storage and Backup : Sets up, solves problems and tunes complex SAN software issues. Uses knowledge of existing storage platforms to evaluate and recommend new technologies. Uses storage knowledge to solve issues on unfamiliar products. Creates and maintain policies, standards and overall documentation including availability and backup & recovery, service level agreement, baseline architecture, change management, access to production, unsupported HW / SW, security & audit violations and risk acceptance.
  • Scripting and Development : Develops software in several modern languages. Develops database-backed systems and has a solid grasp of DB schema and query performance. Designs horizontally-scalable solutions with innovative use of storage and networking, including solid APIs for integration with other systems. Applies professional standard methodologies in day-to-day work like revision control, unit testing, or other. Applies statistical data analysis techniques.
  • Networking : Recommends or helps architect an entire system, including network design and topology. Authority in understanding and performing TCP dumps, snoop and other network sniffers. Understands and applies knowledge of most protocols (TCP / IP, HTTP, UDP etc.)
  • Application Technologies (Web Servers, J2EE, Applications Servers) : Provides authoritative recommendations and advice to the team and / or department in the areas of web services, OS and storage, including being an active liaison to Development, QA and the Business. Provides scaling, design, costing, troubleshooting and impact analysis consultation.
  • Analyzes systems and makes recommendations to prevent possible problems. Takes lead on issue resolution activities using knowledge of complex and company-wide systems.
  • Leads end-to end audit of monitors and alarms based on subsystem knowledge. Takes the lead on defining the requirements for new tools required for operations.
  • Applies time management and project management skills to lead the resolution of issues in a timely and organized manner, effectively communicating necessary information. May consult directly with clients or third party vendors; provides domain expertise.
  • Consistent exercise of independent judgment and discretion in matters of significance.
  • Regular, consistent and punctual attendance.
  • #J-18808-Ljbffr

    Crear una alerta de empleo para esta búsqueda

    Senior Database EngineerElasticMongoHadoop • San Francisco, California, United States

    Ofertas similares
    Senior Platform Engineer - Database Systems

    Senior Platform Engineer - Database Systems

    Quizlet • San Francisco, California, US
    A tiempo completo
    Job Description Job Description About Quizlet : At Quizlet, our mission is to help every learner achieve their outcomes in the most effective and delightful way. Our $1B+ learning platform serves ...Mostrar más
    Última actualización: hace 1 día • Oferta promocionada
    Senior Software Engineer- Database Infrastructure

    Senior Software Engineer- Database Infrastructure

    King River Capital Group • San Francisco, CA, United States
    A tiempo completo
    Discord is used by over 200 million people every month for many different reasons, but there’s one thing that nearly everyone does on our platform : . Over 90% of our users play games, spending a comb...Mostrar más
    Última actualización: hace 14 días • Oferta promocionada
    Senior Database Engineer

    Senior Database Engineer

    ALLTECH CONSULTING SVC INC • Menlo Park, CA, United States
    A tiempo completo
    Analyzes complex information, designs, develops and troubleshoots database applications.Reviews functional requirements and prepares and documents technical program, subsystem and system designs an...Mostrar más
    Última actualización: hace 17 días • Oferta promocionada
    Senior Cloud Data & Database Solutions Engineer

    Senior Cloud Data & Database Solutions Engineer

    Amazon • San Francisco, CA, United States
    A tiempo completo
    A leading cloud services provider is seeking a Senior Software Solutions Engineer in San Francisco to develop innovative cloud-based solutions and optimize manufacturing processes.The ideal candida...Mostrar más
    Última actualización: hace 17 días • Oferta promocionada
    Senior Database Reliability Engineer (DBRE)

    Senior Database Reliability Engineer (DBRE)

    Okta for Developers • San Francisco, CA, United States
    Indefinido
    Senior Database Reliability Engineer (DBRE).Senior Database Reliability Engineer (DBRE).We are looking for a highly skilled Database Reliability Engineer (DBRE) with deep expertise in PostgreSQL at...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Senior Database Reliability Engineer

    Senior Database Reliability Engineer

    Gridware • San Francisco, CA, US
    A tiempo completo
    Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid.We pioneered a groundbreaking new class of grid management called active grid response...Mostrar más
    Última actualización: hace 7 días • Oferta promocionada
    Senior Platform Engineer - Database Systems

    Senior Platform Engineer - Database Systems

    Icon Ventures • San Francisco, CA, United States
    A tiempo completo
    At Quizlet, our mission is to help every learner achieve their outcomes in the most effective and delightful way.Our $1B+ learning platform serves tens of millions of students every month, includin...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Database Engineer (AWS Infrastructure)

    Database Engineer (AWS Infrastructure)

    Vertex Sigma Software • Foster City, CA, US
    A tiempo completo
    Quick Apply
    As a Database Engineer at Sigma Software, you will design, build, and operate scalable, secure data stores that power our applications and analytics. You’ll partner closely with application and data...Mostrar más
    Última actualización: hace 18 horas • Nueva oferta
    Senior Database Engineer(Elastic / Mongo / Hadoop)

    Senior Database Engineer(Elastic / Mongo / Hadoop)

    CatchProbe Intelligence Technologies • San Francisco, California, US
    A tiempo completo
    Senior Database Engineer(Elastic / Mongo / Hadoop).Senior Database Engineer(Elastic / Mongo / Hadoop).Scroll down for a complete overview of what this job will require Are you the right candidate for this ...Mostrar más
    Última actualización: hace 17 días • Oferta promocionada
    Senior Software Engineer, Database Infrastructure

    Senior Software Engineer, Database Infrastructure

    Slack Enterprise • San Francisco, CA, United States
    A tiempo completo
    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job CategorySoftware EngineeringJob Details • • • •Abo...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Senior Database Reliability Engineer (DBRE)

    Senior Database Reliability Engineer (DBRE)

    Okta • San Francisco, CA, United States
    A tiempo completo +1
    Okta is The World’s Identity Company.We free everyone to safely use any technology, anywhere, on any device or app.Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secur...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Senior Database Reliability Engineer (DBRE)

    Senior Database Reliability Engineer (DBRE)

    Okta, Inc. • San Francisco, CA, United States
    A tiempo completo +1
    Okta# Senior Database Reliability Engineer (DBRE)San Francisco, California • •Get to know Okta • •Okta is The World’s Identity Company. We free everyone to safely use any technology, anywhere, on any de...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Senior Database Engineer

    Senior Database Engineer

    Ellation, Inc. • San Francisco, CA, United States
    A tiempo completo
    Founded by fans, Crunchyroll delivers the art and culture of anime to a passionate community.We super‑serve over 100 million anime and manga fans across 200+ countries and territories, helping them...Mostrar más
    Última actualización: hace 12 días • Oferta promocionada
    Database Engineer

    Database Engineer

    Zoox • Foster City, CA, US
    A tiempo completo
    Zoox is seeking an experienced Database Engineeer to take a lead role in managing a portfolio of over 500+ Zoox databases. Working closely with developers and business partners, you will drive the d...Mostrar más
    Última actualización: hace 1 día • Oferta promocionada
    Senior Database Engineer

    Senior Database Engineer

    Crunchyroll • San Francisco, CA, United States
    A tiempo completo
    Join our team and help us shape the future of anime!.Founded by fans, Crunchyroll delivers the art and culture of anime to a passionate community. We serve over 100 million anime and manga fans acro...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Senior Database Infrastructure Engineer

    Senior Database Infrastructure Engineer

    Slack • San Francisco, CA, United States
    A tiempo completo
    A leading collaboration platform in San Francisco is seeking a Senior Software Engineer for Database Infrastructure.The successful candidate will enhance highly-available database systems and colla...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Senior Software Engineer, Database Infrastructure

    Senior Software Engineer, Database Infrastructure

    salesforce.com, inc. • San Francisco, CA, United States
    A tiempo completo
    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Salesforce is the #1 AI CRM, where humans with age...Mostrar más
    Última actualización: hace más de 30 días • Oferta promocionada
    Senior Oracle DB Engineer - Hybrid in Menlo Park

    Senior Oracle DB Engineer - Hybrid in Menlo Park

    LOGIXtech Solutions • Menlo Park, CA, United States
    A tiempo completo
    A leading technology solutions provider is seeking a Senior Oracle Database Developer for a long-term contract in Menlo Park, California. The ideal candidate will have over 10 years of experience in...Mostrar más
    Última actualización: hace 15 días • Oferta promocionada