Download as pdf
Download as pdf
You are on page 1of 8
ANSI/BICSI 002-2011 17.1.2 Requirements ‘The number one maintenance requirement that will apply to all the various systems is to always adhere to the ‘manufacturer's maintenance specifications and/or the AHJ over the installation, (e., local code, NEC, OSHA). The ‘AHI typically evaluates an installation in compliance with applicable codes and reguiations (e.g, NFPA 70, OSHA). 17.2 Systems requiring maintenance 17.2.1 Cabling systems 172.1.4 Introduction Cabling systems ones installed, will normally require very litle maintenance, provided the structured cabling system {s designed and installed to comply with appropriate codes and standards ofthe data center location. Properly built cabling systems do not generally break under normal usage without some external force causing breakage. Cable ‘pathways and spaces are designed and built in compliance with applicable standards and follow the recommended cable fill ratios. There should be sufficient space for moves, adds, and changes that will normally occur as changes, ‘and reconfigurations take place in the data center. This is particularly important in a new data seater where growth ic expected, Cable access isthe single most important factor for maintenance of structured cabling systems in the data center, Cabling systems should be inspected periodically for cable degradation, cracks, abrasions, heat, deformation, brittleness, movement, corrosion, or other indications of abuse and/or age. 17.2.1.2 Recommendations Only qualified personnel should be performing moves, adds, and changes. Personnel performing changes should be trained in the data center standards and policies for: tack, cabinet. equipment. cable. atch cable, power strip, and power receptacle labeling: * cable and patch cord color scheme (if used); routing and dressing of cables and patch cords; proper equipment installation (air intakes in the front, exhaust out back, preferably not on ral, labeling, routing of cables); + connecting equipment to the proper power stipe and receptacles to provide the desired redundancy. ‘Annual inspection or during move, adds, and changes performed by cabling technicians: © inspecttepainreplace worn, eut, pinched cabling entering cabinets and at stress points in the cable ‘management systems; ingpect/repair secure mounting ofall cable management systems: inspect/repair cable congestion points with in telecommunications switches and or servers; inspect/repar floor, wall, and ceiling cable penotrations for correct fre stop and or cable damage; inspect/tepair any loose cable that could be snagged, cut or tripped over; remove any/all unusedabandoned cable whenever possible. (especially important at cross connections): censuie any unused terminated optical fiber is capped to prevent dust contamination or seratches on fiber ends; ensure that cabinets, racks, and raceways are properly grounded and that bonding conductors are secure. grounding connections should be inspected regularly (annually at minimum) to ensure that they have not been damaged, corroded, or come loose; ‘© ensure that all cabinets, racks, paten panels, cables, and patch cables are propery labeled 17.2.2 Electrical systems 1722.1 Introduction Many electrical systems are requited to support a working data center. Some of these systems will require more ‘maintenance than others. Generators, batteries and UPS systems will require periodic maintenance at manufacturer- specified or industry standard intervals Safe performance of electrical maintenance and testing should conform to the manufactures’ procedure. Technicians must also follow applicable safety codes and standards such as NFPA 70B, NFPA 70E, NFPA 110, NEDA 111, TREE stationary hatory etandarl, andl applicable local and federal guidelines ‘The most important factor regarding electrical systems maintenance is safety. Consequently, all electrical work shall be performed by fully qualified, licensed/bonded/insured electricians/techniciens who have been trained (and certified when such cetifcation is available) on the specific type of equipment. All electrical work shall be accomplished in accordance with all applicable codes and regulations as mandated by the AHJ. Certain maintenance a2 ANSI/BICSTI 002-2011 functions, suchas replacement of hot swappable elements, shall be permitted to be performed by trained operators when the equipment hasbeen so designed and procedures have been specified NFPA 70B, Section 25:38, recommends routine maintenance on a semiannval basis for UPS systems. It also suggest what should be inspected, measured, and possibly tested, NITA 70D, Sexi 4, ilsuales the inyorlane of EMfetive Kleuival Preventive Malutcuaine (CPM, is economic benefits as well as increased availabilty. 17.222 Recommendations Perform inspections as required by the AHL: + all power connections secur ‘+ TR thermography scanning is recommended once per year to identify loose ar poor connections and unbalanced electrical loads, all characterized by increased resistance or temperature rise; all receptacles and posse strips properly labeled; all safety features in place and operational; doors and cover plates on panelboards and power distribution unis in place and operating properly, UPS and power generation systems periodie maintenance inspections performed in accordance with ‘manufacturer's specifications and ot AL; consider battery monitoring in UPS systems; lighting systems checked and bulbs replaced as required: «emergency lighting operational check as required by AH; BAS and fire alarm systems operational check as required by AHJ; ensure complete compliance with all mandated safety regulations (cg, OSHA, NEC, local code, AHL), Perform inspections as specified by the equipment manufacturer. The following is an example of one manufacturer's specified service intervals for electrical systems and components: + 3.phase UPS—2 preventive maintenances (PMS) per yea YVRLA boiteres associated with 3-phase UPS—4 PMs per year, wet cell batteries associated with S-phase UPS 12 PMs per year: |-phase UPS— PM per year; \VRLA batteries associated with L-phase UPS—1 PM per year; Power distribution units (PDU)—I PM per year Satie transfer switches 2 PMs year; de power plans—2 PMs per year YRLA batteries associated with de power pants—4 PMs per year; ‘Wet cell batteries associated with de power planis—4 PMs per yeer; emote monitoring systems—1 PM per year, ‘TVSS—surge suppression devices—conition item only—no PM; IR thermography seanning—lI per yar. Perform inspections on batteries as recommended by TEE standards — see the following sections 172.2.2.1 VRLA battery recommendations IEEE 1188 provides details for maintenance, (VRLA) bateres, including: + monthly: = Visually inspect for evidence of eorosion, container distortion, and dt = check overall battery float voltages at regular intervals (at least monthly if performed manually; ‘continuous monitoring is recommended). + quanery: ~ measure and record cenit internal ohmic value, temperuture, and voltage: testing. and replacement of stationary valve-regulated lead-acid 333 ANSI/BICSI 002-2011 w2. annually measure and record cell-to-cell and terminal connection resistance and measure ac ripple curent; = compare measurements to base line data, monitor tends, and identify units that fall outside of predicted range (per manufacturer's recommendation; = replace battery units or strings as necessary; — if UPS is designed with continuously monitored modular battery cartridges, replace when notified by alarm, 22 Vented (flooded) lead acid battery recommendations TERE 450 details the recommended maintenance, tating, and replacement practices for vented, stationary, and lead ‘acid batteries: monthly; — visually inspect for evidonce of corrosion, container distortion or damage, and dirt; = check veel! hattery float valtages and charger float current: = inspect electrolyte levels; add water as required; check plot cell voltage and electrolyte temperature; = check for unintentional grounds. quarterly: = measure and record cellunit voltage; '~ measure and record specific gravity and temperature of 10% of cells. annually: — measure and record cell-to-cell and terminal connection resistance; = measure and record specific gravity and temperature of each cell; = inspect structural integrity of battery rack or cabinet; = compare measurements to base line data, monitor trends, and identify units that fall outside of predicted range (per manufacturer's recommendation; — replace battery units or strings as necessary. 17.2.2.2.3 Vented nickel-cadmium (Ni-Cd) battery recommendations IEEE 1106 provides details for maintenance, testing, and replacement of stationary vented Ni-Cd batteries, including: = monthly: visually inspect for evidence of corrosion, container distortion, = check overall battery float voltages at regular intervals; = measure charger output current and voliag ~ visually inspect electrolyte levels; replenish as required; © quarterly: = measure and record pilot-cell electrolyte temperature. © semiannually: = moasnre and raaned unltage ofeach oe © annually: = measure intercell connection torque; = yearly measure and record cell-to-cell and terminal connection resistance; = YEARLY inspect structural intesrity of battery rack or cabinet; check fuel quality for generators annually. Reference IEEE 1184-2006, Annex G, “Maintenance and Testing Intervals” 172.224 Generator testing recommendations Regular testing it required to maintain the generator per manufacturers’ instructions and code requirements. See ‘NFPA 110 regarding recommendations for maintenance. ‘Testing under a load bank will prevent the potential of jeopardizing the critical load. However, local code may require testing under live load, Class Fl and F2 generator systems should have an extra breaker with lugs for connection of portable Load Bank. Class F3 and F4 should have a permanent load bank for regular testing 334 ANSI/BICSI 002-2011 17.2.3 HVAC systems 17.23.1 Introduction HIVAC systems in data centers are a critical component in the operation of the center. All IT and Telecommunications system operating within the data center have temperature and relative humidity operating ‘ranges that must be maintained to prevent overheating and damage to eritcal system components. Numerous commercially available environmental monitoring tools run on LANs and provide computer room environment reporting to the operations center, Operations personnel can then take preventative measures if ‘computer room conditions begin to approzch threshold temperatures Itis very important that HVAC systems operate at optimal performance, Ta da sa these systems must be maintained according to mannfacturer's specifications. Data center HVAC systems should always be maintained by qualified HVAC technicians that are available for service twenty-four hours a day, seven days a week 17.232 Recommendations Recommended preventive maintenance for computer room air conditioning (CRAC) systems: + monthly: = environment: © verify that each module is maintaining temperature and humidity set points: (© record room temperature and humidity near the return vent of each module; © inspect for visible damage to module (dents, scratches); © inspect for environmental damage (dirt, dust, debris, liquid stains) around the module installation 15 inepwet helts (fapplieahle) far wna and tightness; ‘0 record past month's alarm history ~ cause and response. = cleanliness: ‘©. check condition of retur air filters; replace if necessary; (© check condition of drain pan and remove any accumulation of debris, mechanical (© ensure that all components of the blower and its motor are moving freely, with no signs of binding or damage; ‘© inspect the set-screws on fan blades and bushings to make sue that they are tight verity dha eesti sowie, ‘© verify thatthe humidifiation system does not have leaks a the fll and drain valves and that these rode of operation are Functional; ‘© ensure that there are no kinks inthe stam delivery system (here applicable) from the eylinder top tothe steam distributor, ‘© check for build-up in cleanable cylinders (where applicable) and clean as required; © replace disposable humidifier eylindersifnecessary (where applicable); © verify chilled water supply temperature (where applicable) = electrical: ‘2 confirm thatthe incoesing main power is within tolerance listed on the module's nameplate; (© verify that the control voltage is within manufacturer's recommended tolerance. © quarterly = mechanical 16. check water Hines for leaks; (© verify tightness of blower and its motor hardware, = electrical: (© conduct an infrared (IR) scan of electrical panels and connection points. if hot spots are identified, schedule shutdown, deenergize the equipment, and tighten any loose connections; (© record amperages'for critical components (such 2s cooling coil fan motors, reheater, and hbumidifier), 335 ANSI/BICSI 002-2011 © semiannually: = cleanliness: © check cleanliness of chilled water coil = lecteical: (© verify that contactors and relays are operating correctly; (© check the main power wiring for ertial components such as reheat elements, evaporator motors, and humidifiers. = functional tests: (© verify operation ofthe col uid (water regulating) valves and record pressure; ‘©. check the operation ofall system alarms, 17.2.4 IT and telecommunications systems 172.4.1 Introduction IT systems for data centers come in many configurations from small servers that fit in a single rack unit or blade server chassis module to very large multiple processor systems that consume several cabinets and can require @ footprint of 1.7 m* (18 £” or more, The one thing all servers and associated peripherals have in common is that they all will require maintenance at some time. ALT systems manufteturers should provide the necessary maintenance documentation aud or Web-based technical support for their particular systems. Most will offer maintenance programs ranging from defective component mail in replacement to on-site maintensnce technicians. ‘The key to IT systems maintenance is to provide sufficient space for qualified technicians to perform the required ‘maintenance actions ‘Telecommunications systems have advanced as rapidly as today's new generation of servers and are just as sophisticated, Systems can be ordered with redundant “Hot Swappable” components that make it possible to run virtually forever without taking a system offline for hardware maintenance. ‘Maintenance spaces are very important for Telecommunications systems due to cable congestion that often happens ‘with large configurations installed in cabinets ur racks. Like IT systems, Telecommunications system manufacturers should provide the necessary maintenance documentation and or web based technical support for their particular systems. Most will offer maintenance programs ranging from defective component mail in replacement to on-site maintenance technicians. The key to ‘Telecommunications Systems maintenance is to provide sufficient space for qualified technicians to perform the required maintenance actions. Ethemet switches, commonly used to provide network connectivity fo servers with in the data center, range in size from one rack space unit fora small office Ethernet distribution switch with eight, to forty eight connectivity ports (ee Figure 82), 10 large enterprise class distribution switches that will take up nearly half (or more) of a standard 42U eabinet or rack and can contain four hundred or more connectivity ports ‘Maintenance on a small switch usually consists of whole unit removal and replacement when failure is detected. In contrast, a large enterprise class switch will consist of a chassis with multiple “blades” and redundant power ‘supplies. Maintenance on a large switch like this requires removal and replacement of the individual defective “blade” or power supply. Some devices require front access for maintenance and others will require rear access for maintenance. Its wise 10 plan for both front and rear maintenance access. Some specialty peripheral equipment such as robotic tape storage systems can require front, rear and side maintenance access due to the complexity end size of the intemal subsystems and components. [All equipment and systems proposed for installation in the data center will have manufacturer recommended installation specifications that must be reviewed in advance by planners, configuration managers and or facilites, ‘managers to help determine the maintenance space required for each respective system installed inthe data center. Planning for and allocating adequate maintenance space ensures expedient and safe maintenance activities on installed IT and Telecommunicstions systems 17.242 Recommendations ‘Some IT systems must be maintained by factory authorized service technicians because of their proprietary nature ‘andior complexity, and some IT systems can be maintained by competent onsite personnel. Most checks would be performed during periodic maintenance inspections monthly, quarterly or annually. 336 ANSI, BICST 002-2011 Causes are: toner spills; toner used for printers. Consequences are ‘© creates abrasive film on floor surface: © filure to computer related circuit boards; © poor indoor air quality 17.2.5.2.2.10 Subfloor particulate—sand Causes are: ‘brought into area by foot traffic; ‘© [eft from original construction. Consequences: ‘© highly abrasive to high-pressure laminates; ‘© permanent surface damage; ‘© equipment damage; degrades static dissipative properties of surface. 172,52.2.11 Subfloor particulate rust Causes are excessive moisture in area; Aeterioration of pedestals; high uv Teak underfloor; flooding of floor system during cleaning, Consequences: ‘= component damages component failure; ‘© unwanted must flake particulate. 1725.22.12 Subfloor particulate—sheetrock dust Causes are: ‘© subfloor and access floor not properly cleaned after construction or renovation; ‘© original construction debris not cleared under floor, ‘© interim construction (cutting holes in wall). Consequences are: ‘© damage to sensitive equipment; ‘© creation of high flying particulate 172.5.2.2.13 Additional access floor maintenance recommendations

You might also like