Senior Critical Environment Technician

Senior Critical Environment Technician

As a Senior Critical Environment Technician (CET) in Microsoft's Cloud Operations & Innovation (CO+I) team, you will maintain the critical infrastructure that keeps our datacenters up and running. This could be anything from coordinating with supplier / vendors, working closely with management to address operational, risk and safety situations, mentoring other CE Technicians, having a hands-on understanding of how critical environment equipment works, performing various types of maintenance, responding to onsite incidents while coordinating with other critical facilities professionals, and using telemetry and other platforms to monitor equipment performance and operations. Microsoft's Cloud Operations & Innovation (CO+I) is the engine that powers our cloud services. As a CO+I Critical Environment Technician, you will perform a key role in delivering the core infrastructure and foundational technologies for Microsoft's online services including Bing, Office 365, Xbox, OneDrive, and the Microsoft Azure platform.

CO+I is focused on the personal and professional development of all employees and offers training and opportunities including Career Rotation Programs, Diversity & Inclusion training and events, and professional certifications. Our infrastructure is comprised of a large global portfolio of more than 200 datacenters in 32 countries and millions of servers. Our foundation is built upon and managed by a team of subject matter experts working to support services for more than 1 billion customers and 20 million businesses in over 90 countries worldwide. With environmental sustainability and optimization at the forefront of our datacenter design and operations, we continue to grow and evolve as we meet the ever-changing business demands that hold Microsoft as a world-class cloud provider.

Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In this environment, you may be asked to go on business travel to support other metros periodically, 0-25% of the time.

Responsibilities

Equipment and Systems Operations

Works on complex, advanced tasks (e.g., stabilization, resolution, recovery) independently. Serves as a subject matter expert in critical environments-related systems within the data center, advises less experienced colleagues on such topics, and provides oversight and training / mentorship to team members on tasks regarding these subsystems (e.g., electrical, mechanical, controls, generators). Demonstrates an understanding of and operates equipment and systems across all disciplines (e.g., electrical, mechanical, controls) with knowledge of the interactions between them and overall operation of a data center. Operates all systems and equipment in a safe and professional manner.

Serves as an expert in the inspection and supervision of critical environment-related facility equipment (e.g., controls, heating, ventilation, and air conditioning [HVAC], mechanical systems), building, and grounds for unsafe or abnormal conditions. Understands critical system alarms for multiple discipline(s) of equipment, their meanings, and engages with appropriate escalation processes or procedures. Recognizes circumstances where execution would be considered safe to proceed. Performs various inspections and validations of equipment performance. Monitors the performance from central monitoring locations (i.e., Facility Operations Centers) of maintenance and operations of equipment (e.g., electrical, mechanical, fire / life safety) and understands risks or impacts to other subsystems across the data center. Escalates per applicable policies and standards. Utilizes telemetry, control systems, and other platforms to monitor site status, analyze past and current events, as well as other processes, and can identify all alarms. Uses technical expertise, prior experience, and device analytics to recognize trends with equipment behavior and checks potential issues as they arise. Advises less experienced colleagues on issues found while monitoring applicable CE systems. Performs all monitoring equipment repair, replacement, and maintenance work, which meets or exceeds Microsoft Service Level Agreement (SLA) requirements. Uses data trends to develop or produce predictive analyses of equipment performance.

Utilizes internal computerized maintenance management system (CMMS) to track all equipment assets and to complete work order requests for maintenance work. Tracks hours for performed tasks within applicable task management systems. Tracks utilization and time tracking results for team members, within applicable task management systems, as needed. Guides and coaches team in CMMS usage best practices. Adds required data, documents, logs changes, and upkeeps procedures related to building management systems and reports. Properly signals spare equipment and parts utilization within maintenance work orders.

Safety and quickly responds to and leads an onsite incident response team for all abnormal conditions that impact operations, and coordinates with other critical facilities professionals to perform corrective repairs, without supervision. Gathers necessary information and creates incident timelines / data, root-cause analyses, and / or action items following an abnormal condition as required. Identifies and contacts / engages appropriate parties to mitigate incidents as they occur. Develops new or follows preexisting emergency operating procedures (EOPs), methods of procedure (MOPs), standard operating procedures (SOPs), and digital methods of operating procedures (DMOPs) in relation to incidents. Directly provides and / or leads and coordinates emergency monitoring response plans for irregular or malfunctioning conditions. Serves as technical expert in ensuring emergency operating procedures (EOPs) are consistent with proper incident response.

Equipment and Systems Maintenance

Performs various types of maintenance (e.g., planned, predictive, corrective) and repairs for multiple disciplines and multiple equipment types of increasing complexity with no supervision, while serving as a subject matter expert for one discipline - in consideration of Task Hazard Analysis (THA), Method Statement of Work (MSOW), or varying permit requirements. Communicates and / or escalates maintenance activities per established process and procedure. Prioritizes maintenance activities as required and / or appropriate. Documents tasks or issues during maintenance activities within appropriate systems per process and procedure as needed. Provides consultation to colleagues on maintenance and repairs through deep understanding of equipment, systems and their interrelations. Follows recommended maintenance schedules. Oversees everyday, complex, large-scale tasks for a single discipline or equipment across disciplines. Ensures follow up action items are addressed in a timely manner. Masters the maintenance of all systems and equipment in a safe and professional manner and understands levels of risk (LORs) associated with varying types of maintenance across all disciplines. Plans, coordinates, and presents maintenance items for review and approval in their area of responsibility.

Acts as a subject matter expert, performing troubleshooting independently for multiple equipment, systems, subsystems, and component types. Documents issues found in troubleshooting process within appropriate systems per process and procedure as needed. Ensures equipment and system settings are consistent with established parameters and designs. Determines when troubleshooting efforts are deemed adequate and communicates or escalates to suppliers, engineers, or more experienced colleagues as needed. Has a hands-on understanding of how equipment in all disciplines work and how to troubleshoot to subsystem level. Provides consultation to less experienced colleagues with troubleshooting systems and problems. Oversees less experienced colleagues, or directly troubleshooting systems and investigates root causes.

Provides necessary escort to third-party contractors, sub-contractors, vendors, and service providers on site based on all procedure levels of risk (LOR). Takes part in getting third-party work underway (e.g., making sure systems are properly energized / deenergized), ensuring the work is started and completed in a safe manner in accordance with standard practices, procedures, and Authority Having Jurisdiction (AHJ) regulations. Ensures work performed by suppliers / vendors is performed to scope, all documentation is performed correctly, and escalates as appropriate. Recognizes circumstances when to stop supplier / vendor work to address potential and / or identified concerns. Coordinates across all LOR applicable to preventative and / or corrective maintenance. Identifies and recommends procedure corrections if / when errors are detected or when appropriate. Coordinates and schedules supplier / vendor on-site activities. Coordinates with vendor to schedule maintenance and determines availability of equipment / parts, as directed. Resolves or escalates observed vendor quality issues. May review and approve vendor supplier field service reports, invoices, and work orders.

Prepares and submits highly complex reports as assigned following preexisting scripts and templates, or using ad hoc methods required to support trending and analysis (e.g., Root Cause Analysis [RCA] reports) and may review prior reports delivered by less experienced team members. Develops methods of operating procedure (MOPs), standard operating procedures (SOPs), and / or digital methods of operating procedures (DMOPs) for highly complex and / or interdependent equipment and disciplines to ensure safe and reliable execution. Reviews completed work using approved tools and procedural templates from less experienced technicians for accuracy and completeness. Completes and provides coaching to support less experienced technicians for mandatory, technical, and procedural training assignments. Analyzes findings from reports and documents observations.

Processes method statement of work (MSOW) documents. Coordinates activities and associated schedules with contractors. Performs inspections of equipment in a facility. Participates in testing and commissioning activities. Advises engineer partners or project management colleagues on project scope process or execution methodology. Presents for review and approval MSOW in their area of responsibility.

Critical Environment Culture

Understands, follows, and ensures safety and security requirements (e.g