Observability Engineer (US)

Work Location :

Mount Laurel, New Jersey, United States of America

Hours : 40

Pay Details :

$113,000 - $214,000 USD

TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth opportunities and skill development are defining features of the colleague experience at TD. Our compensation policies and practices have been designed to allow colleagues to progress through the salary range over time as they progress in their role. The base pay actually offered may vary based upon the candidate's skills and experience, job-related knowledge, geographic location, and other specific business and organizational needs.

As a candidate, you are encouraged to ask compensation related questions and have an open dialogue with your recruiter who can provide you more specific details for this role.

Line of Business : Technology Solutions

Job Description :

The Observability Engineer provides technical leadership to improve the design and operation of systems in alignment to reliability engineering best practices and overall Technology and Bank strategies, applying the practices of computer science and software engineering to the design and development of large, complex systems.

Depth & Scope :

Expert Observability Engineer role with comprehensive expertise in leading-edge theories, engineering practices, extensive coding and scripting

Advanced and highly specialized knowledge of applications, systems, networks, innovation models, design activities, best practices, business / organization, Bank standards, and may fulfill a governance role

Engineering specialist assigned to work autonomously on high profile, complex and / or high-risk technology initiatives with significant impact to the organization

Provides technical leadership / consulting / direction to multiple businesses and product teams, growing capability across the organization

Resolves unique and complex problems that have a broad impact on the business

Authoritative expert on site reliability issues within area of specialization

Understands the journey of an enterprise transformation where there is a hybrid cloud / non-cloud operating model.

Drives end / end accountability of products and services across the enterprise through collaboration and transparency

Primarily works at the product umbrella, segment, LOB or Product Family level

Education & Experience :

University degree in Computer Science or related technical field involving systems engineering or equivalent practical experience.

10+ years of engineering experience (e.g. Software or platform)

Customer Accountabilities :

Provides technical leadership to improve the design and operation of systems in alignment to reliability engineering best practices and overall Technology and Bank strategies, applying the practices of computer science and software engineering to the design and development of large, complex systems

Drives and influences integrated DevOps solutions across business, product, platform, infrastructure, development, support / DevOps teams that improve the design and operation of systems, making them scalable, reliable, and efficient while ensuring performance and high availability of products / services

Ensures availability, latency, performance, efficiency, change management, monitoring, emergency response, and capacity planning of products / service(s) including enterprise systems that may serve multiple services and applications / segments

Influences and partners with key technology and product team members in the design and development of solutions that promote automation and the elimination of toil; identify optimal ways to improve the design and operation of systems to make them more scalable, more reliable, and more efficient and have the ability to implement the required changes

Defines and prioritizes problems to solve with applications / products / services and respective systems and drive the resolution / remediation with technology teams across design, implementation, and support.

Develops deep relationships with Product Owners, Tech Leads and Ops to build transparency and help foster end to end accountability of products and services

Works in close partnership with technology teams to support TD's business objectives and operational support goals providing domain expertise on strategic Infrastructure as well as Business project related activities

Reviews technical deliverables throughout the design and development phase to ensure systems adhere to SRE best practices

Shareholder Accountabilities :

Ensures adherence of Operational (Production) Readiness practices of respective products and services

Sets service-level objectives (SLO) that defines availability of a particular product or service and exercise key decision rights of the SRE role (e.g. supporting release to production, rejecting software that is operationally substandard and directing developers to improve the code etc.)

Implements the observability requirements to monitor and assure that our systems measure to the expected service levels and perform with the appropriate operational characteristics

Focuses on reliability, scalability, and the development of the production computing infrastructure, including highly complex and scalable systems

Develops observability standards to ensure that production systems operate under known conditions and transparently provides these measurements to anticipate when errors or failures can arise.

Engineers solutions through problem post-mortem reviews to ensure that problem solutions are complete and that errors will not manifest again.

Anticipates internal and external business challenges, helping teams find solutions through continuously improving on process and technologies

Leads interaction with governance and control groups, (e.g. regulatory / operational risk, compliance and audit) to provide subject matter expertise and consult on risk issues related to Engineering technology and tools

Leads or contributes to cross-functional / enterprise initiatives as an organizational or subject matter expert helping to identify risk / provide guidance for significant and complex situations

Proactively identifies emerging technologies and innovative solutions for building more robust platform domains; keep abreast of emerging issues, trends, and evolving regulatory requirements and assess potential impacts

Protects the interests of the organization – identify and manage risks, and escalate non-standard, high-risk transactions / activities as necessary

Maintains a culture of risk management and control, supported by effective processes in alignment with risk appetite

Employee / Team Accountabilities :

Participates fully as a member of the team, support a positive work environment that promotes service to the business, quality, innovation, and teamwork and ensure timely communication of issues / points of interest

Provides thought leadership and / or industry knowledge for own area of expertise in own area and participate in knowledge transfer within the team and business unit

Keeps current on emerging trends / developments and grow knowledge of the business, related tools, and techniques

Participates in personal performance management and development activities, including cross training within own team

Keeps others informed and up to date about the status / progress of projects and / or all relevant or useful information related to day-to-day activities

Contributes to team development of skills and capabilities through mentorship of others, by sharing knowledge and experiences and leveraging best practices

Leads, motivates and develops relationships with internal and external business partners / stakeholders to develop productive working relationships

Contributes to a fair, positive and equitable environment that supports a diverse workforce

Acts as a brand ambassador for your business area / function and the bank, both internally and / or externally

Preferred Qualifications :

Strong SRE foundations

Expertise in reliability engineering concepts including SLI, SLO, error budget, incident and problem management, resiliency patterns, etc.

Experience with observability platforms including Dynatrace, Splunk, Datadog, etc.

Experience with automated monitoring and alerting : building monitoring frameworks, dashboards, alert tuning.

Advanced understanding of distributed and cloud native systems engineering including scalability, high availability, and performance optimization

Strong hands on experience with Azure and infrastructure as code using Terraform

Experience with CI / CD pipelines and automated testing frameworks

Proficiency in at least one modern language (Python or Java) with strong scripting skills

Strong technical leadership and cross functional influencing experience with ability to communicate abstract technical concepts in business meaningful terms.

Technical strategy and roadmap development experience

3 + years of design, build, and deployment of cloud native solutions on public and private cloud, including AWS and Azure.

3+ years of design, review, and coding experience integrating various application requirements (non-functional, security, integration, performance, quality, operations etc.).

Infrastructure as code experience with Terraform, AWS Cloud Formation,

3+ years of demonstrated experience with Virtual networks, Load Balancing, VPN's, VPC's, etc.

3+ years of Dockers and Kubernetes.

3+ years of Monitoring and logging with cloud watch, data dog, Grafana, etc.

Cloud Certifications such as AWS, Azure are highly desired.

Physical Requirements :

Never : 0%; Occasional : 1-33%; Frequent : 34-66%; Continuous : 67-100%

Domestic Travel – Occasional

International Travel – Never

Performing sedentary work – Continuous

Performing multiple tasks – Continuous

Operating standard office equipment - Continuous

Responding quickly to sounds – Occasional

Sitting – Continuous

Standing – Occasional

Walking – Occasional

Moving safely in confined spaces – Occasional

Lifting / Carrying (under 25 lbs.) – Occasional

Lifting / Carrying (over 25 lbs.) – Never

Squatting – Occasional

Bending – Occasional

Kneeling – Never

Crawling – Never

Climbing – Never

Reaching overhead – Never

Reaching forward – Occasional

Pushing – Never

Pulling – Never

Twisting – Never

Concentrating for long periods of time – Continuous

Applying common sense to deal with problems involving standardized situations – Continuous

Reading, writing and comprehending instructions – Continuous

Adding, subtracting, multiplying and dividing – Continuous

The above statements are intended to describe the general nature and level of work being performed by people assigned to this job. They are not intended to be an exhaustive list of all responsibilities, duties and skills required. The listed or specified responsibilities & duties are considered essential functions for ADA purpose

Who We Are :

TD is one of the world's leading global financial institutions and is the fifth largest bank in North America by branches / stores. Every day, we deliver legendary customer experiences to over 27 million households and businesses in Canada, the United States and around the world. More than 95,000 TD colleagues bring their skills, talent, and creativity to the Bank, those we serve, and the economies we support. We are guided by our vision to Be the Better Bank and our purpose to enrich the lives of our customers, communities and colleagues.

TD is deeply committed to being a leader in customer experience, that is why we believe that all colleagues, no matter where they work, are customer facing. As we build our business and deliver on our strategy, we are innovating to enhance the customer experience and build capabilities to shape the future of banking. Whether you’ve got years of banking experience or are just starting your career in financial services, we can help you realize your potential. Through regular leadership and development conversations to mentorship and training programs, we’re here to support you towards your goals. As an organization, we keep growing – and so will you.

Our Total Rewards Package

Our Total Rewards package reflects the investments we make in our colleagues to help them and their families achieve their financial, physical and mental well-being goals. Total Rewards at TD includes base salary and variable compensation / incentive awards (e.g., eligibility for cash and / or equity incentive awards, generally through participation in an incentive plan) and several other key plans such as health and well-being benefits, savings and retirement programs, paid time off (including Vacation PTO, Flex PTO, and Holiday PTO), banking benefits and discounts, career development, and reward and recognition. Learn more ()

Additional Information :

We’re delighted that you’re considering building a career with TD. Through regular development conversations, training programs, and a competitive benefits plan, we’re committed to providing the support our colleagues need to thrive both at work and at home.

Colleague Development

If you’re interested in a specific career path or are looking to build certain skills, we want to help you succeed. You’ll have regular career, development, and performance conversations with your manager, as well as access to an online learning platform and a variety of mentoring programs to help you unlock future opportunities. Whether you have a passion for helping customers and want to expand your experience, or you want to coach and inspire your colleagues, there are many different career paths within our organization at TD – and we’re committed to helping you identify opportunities that support your goals.

Training & Onboarding

We will provide training and onboarding sessions to ensure that you’ve got everything you need to succeed in your new role.

Interview Process

We’ll reach out to candidates of interest to schedule an interview. We do our best to communicate outcomes to all applicants by email or phone call.

Accommodation

TD Bank is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, status as a protected veteran or any other characteristic protected under applicable federal, state, or local law.

If you are an applicant with a disability and need accommodations to complete the application process, please email TD Bank US Workplace Accommodations Program at USWAPTDO@td.com . Include your full name, best way to reach you and the accommodation needed to assist you with the applicant process.

Federal law prohibits job discrimination based on race, color, sex, sexual orientation, gender identity, national origin, religion, age, equal pay, disability and genetic information.