Gebruiksaanwijzing /service van het product SFS 7008 van de fabrikant Cisco Systems
Ga naar pagina of 108
Part N u m ber: OL-7725-01 Cisco SFS 7008 InfiniBand Server Switch Hardware Guide ( Topspin 270 Hardware Guide) Release 2.2.0 Update 1 Product ID: 140265.
Copyright © 2 004 - 2005 T opspin Communi cations, Inc. All rights reserved. The T opspin Switched Computing Syst em, T opspin Host Channel Adapter, T opspin Element Manager, and collateral software .
iii Regulatory Notices ........................................ vii FCC Statement .................................................................................................................. ........................ vii Safety Inform ation .....
iv Connect Management Devices ..................................................................................................... ............. 26 Attach a Serial Console Cable to a PC or Terminal ....................................................
v Upgrading a Topspin 270 with Element Manager ........................................................................ 54 Upgrading an Individua l Controller Card .......................................................................................
vi 7: Specifications and Compliance Certifications 103 Chassis and Management Interface ............................................................................................ 10 3 Electrical Spec ifications ......................................
vii Regulatory Notices FCC S t atement This equipment has been tested and found to comply wit h the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. Th ese limits are designed to provide reasonabl e protection against harmful interference when the equi pment is operated in a commerci al environment.
viii CAUTION: Grounding is supplied by the gro und-prong on the 3-prong power cable. Do not attach a separate ground cable. Do not use adapter plugs. Do not remov e the ground prong from the cable. Ensure the ground connection on the power supply is correct and functioning before applying power to the T op spin system.
ix CAUTION: Never place your hand inside an empty card or module bay . Y ou should never have cause to place a hand anywhere inside the T opspin chassis. Unused card and module bays should always have a T opspi n cover over the bay to ensure proper safet y , ventilation, and cooling.
x.
11 1 Features Overview The T op spin 270 Switched Computing System provide s data center managers with a high-performan ce, low-latency interconnect. • “System Architecture” on page 1 1 . • “About the T opspin 270 Chassis” on page 13 . • “Administrative Features” on page 20 .
12 Example The oper code field of the command out put id entifies the controller card as the active card (normal) or the hot standb y card (standby). By d efault, when you power on a T opspin 270, the card in slot 1 1 becomes active and the card in slot 12 becomes the standby .
13 Fabric For redundancy , InfiniBand Host Channel Adapters (HCAs) can be dual-connected to a redund ant pair of T o pspin 270s. In an InfiniBand fabric that includes more th an one T opsp in 270: if the subnet manager on the T opspin 270 that is acting as the master fails, another su bnet man ager will take over within seconds.
14 Figure 1-2: Back Chassis V iew.
15 Chassis Slot Numbering Slot numbers are p rinted on the chassis for easy identificatio n. Figure 1-3: Chassis Slot Numbering in Fr ont (Non-port Side ) Power Supply ID 1 Power Supply ID 2 Fan ID 2 .
16 Figure 1-4: Chassis Slot Numbering in Back (Service Side) Dimensions • Height : 6U unit • Wid t h : 17.04” • Depth : 8” - 23.7” • We i g h t : maximum 106 pounds (full chassis configurat ion with 4x copper Li ne Interface Modules) Connections • 96 ports of 10 Gbps 4X Copper InfiniBand.
17 • The power supplies are 1U, 48V , 1200W • The supplies provide regulated +48V DC to all other modules in the system. • Each power supply has self contained fans for cooli ng. Fan T rays Refer to “Installing a Fan Module” on page 41 for installation instru ctions.
18 Understanding the Core Slot to Mgmt Interface Module Connection Each Core slot in the chassis (refer to “The Core Slot” on page 18 ) is connected to 1 port on the Management Interface mo dule. The controller (fabri c interface module inserted in the core slot) selects the Management Interface module to which it will connect.
19 • At least one Fabric Controller module must be inst alled in the Core slot for the chassis to boot. • When a module is installed in a Co re slot, it acts as either the master or standby controller for the chassis, with all modules in the system being slaves to the master controller .
20 Administrative Features Real-T ime Clock The T opspi n 270 maintains correct time regardless of power conditions or con nectivity . Latency The T opspi n 270 has port to port latency of less than 600ns.
21 2 Inst alling the T op spin 270 System This chapter describes how to install and m anage the T op spin 270 system hardware. • “Prepare the Site” on page 21 • “Configure Basic Connectivity.
22 Mount the T op spin 270 Chassis in a Rack This section describes how to install the T opspin 270 chassis in an equipment rack. The followi ng procedure is the standard installa tion, using your own rack shelf. T op spin also has an optional shelf that is appropriat e for pre-racking and shippi ng a unit in the rack.
23 4. Determine the direction that the sw itch will be inst alled and justified in the rack . The direction that the switch will be justified will determine which set of rack ears that need to be rem oved.
24 7. Use 2 - 3 people to lift the switch into the rack. Figure 2-3: Chassis Set onto Shelf 8. Push the chassis into the rack until the ra ck ear s are flush with rails.
25 9. Use screws that fit your rack to attach both rack ears to the rack rails. Figure 2-5: Use Appropriate Screws to Attach Rack Ears to Rails Inst all Optional HA Component s If you have purchased a High-A vailability (HA) package, install the follo wing components: • Redundant Power Supply .
26 Connect Management Devices T o connect the management ports, use either a serial cable and/or an Ethernet cable. Figure 2-6: Serial and Ether net Management Ports Att ach a Serial Console Cable to a PC or Te r m i n a l 1. Attach the RJ-45 consol e cables from the cable kit that is provided.
27 Connect an Ethernet Cable to the Ethernet Management Port 3. Connect an Ethernet cable to the Ethernet port of the left Management Interface module (slot number 15).
28 5. Inspect the power cord and determin e if i t provides the proper plug and is appropriately certified for use with your electri cal system. Discard the cord if it is in appropriate for your national electrical system and obtain the proper cord, as required by your national electrical codes or ordinances.
29 Assigning an Address S t atically Refer to the static example below: a. When the system has completed booting, press < Enter > several times to display the CLI prompt. b. Enter the user name and password. The default u ser name is super , and t he default password is super .
30 b. Enter the user name and password. The default u ser name is super , and t he default password is super . c. Enter the enable command. d. Enter the configure command. e. Enter the interface mgmt-ethernet command. f. Enter the option dhcp command.
31 Connecting InfiniBand Devices Attaching the IB Cable to the IB Port T o conn ect using InfiniBand to other workstations or switches, standard 4X InfiniBand cabl es are required. InfiniBand cables can be used to connect an y two InfiniBan d devices, whether switch or host.
32 • Chassis Manager (GUI) - A web-based graphic user interface. • Element Manager (GUI) - An optio nally available graphic interface installed on a workstation, and accessible over IP . Refer to the InfiniBand User Guide , the CLI Reference Guide or the Chassis Manager User Guide for more information about managin g the InfiniBand systems.
33 2. T yp e the Management IP address of your Server Switch in the address field of your browser and press Enter . (Y ou configured the IP address in Ste p f. ) Figure 2-10: W eb Browser W indow A log-in window opens. Figure 2-11 displays the log-in window .
34 (Optional) Inst all th e Element Manager GUI For more information regarding th e Element Manager tasks, refer to the InfiniBand User Guide . 1. Check that you have sufficient system resources.
35 3 Managing Individual Component s This chapter describes how to install the Field Re placeable Units (FRUs) in the T opspin 270 system. About the Field Replaceable Unit s The following Field Replac.
36 In most cases, vital information can be recovered fr om the failed module. If you have the appropriate support agreement, you may want to return the unit for diagnosis. Refer to “V ital Product Data Storage” on page 20 . Locating the Power Supply Module Both power supply units are l ocated on the front of th e chassis.
37 7. Pull the power cord from the chassis. Figure 3-1: Diagram of Power Supply to the Associate d Power Cord 8. Use a #1 phillips screwdriver to unscrew the fasteners that hold the power supply module in place.
38 9. Use the handle to pull the power supply mo dule from the bay . Figure 3-3: Pulling the Power Supp ly Module from the Bay 10. Install the blanking panel in pl ace of the power supply module. The device should never be run without either a blanking panel or module in any bay , as overheating may occur .
39 7. Insert the new power supply unit into the open slot until it is fully seated. Y ou may need to push the unit with your thumbs to get it completely into the bay . Figure 3-4: Inserting Power Supply Module 8. Secure the captive screws wi th a #1 phillips screwd river .
40 4. Use a #1 phillips screw driver to unscrew the captive screws. Figure 3-5: Loosening Captive Screws 5. Carefully begin to pull the fan tray 1” out of the bay . Do not pull the fan tray completely from the bay . CAUTION: The fan tray does not hav e guards over the blades.
41 or Install a new fan modul e. Refer to “Installing a Fan Module” on page 41 if you are installing a n ew fan module. Inst alling a Fan Module 1. Remove the new fan module from the package. 2. Ground yourself approp riately . 3. Remove the bezel cover from the front of th e switch, if you have not already done so.
42 9. Check the LEDs on the fan module to verify the status. Refer to “Fan LEDs” on page 69 . Fabric Controllers About the Fabric Controllers Refer to “Fabric Controller Modul es” on page 18 for more specifi c inform ation about t his module.
43 5. Use a #1 phillips screwdriv er to unscrew the captive screws from bo th ends of the Fabric Controller card. Figure 3-9: Loosen Ca ptive Screws Before Removing 6. Pull the levers on both sides of the card toward you. The card will be released. Figure 3-10: Opening Fabric C ard Levers 7.
44 Inst alling a Fabric Controller 1. Remove the new Fabric Controller module from the packag ing. 2. Ground yourself approp riately . 3. Remove the bezel cover , if you have not already done so. 4. Refer to “Removing a Fabric Controller” on page 42 , if a Fabric Controller module is still in stalled.
45 Upgrade the Image with the CLI T o upgrade the image of the Controller card with the Command Line Interface, refer to “Upgrading a Controller Card with the CLI” on page 57 and the following doc.
46 3. Remove the InfiniBand cables from the ports. a. T o remove a cable with a pinch connector , pinc h both sides of the back of the connector and pull the connector aw ay from the port .
47 4. Use a #1 phillips screwdriver to unscrew the captive screws on bot h sides of the LIM card. Figure 3-14: Loose n the Captive Screws 5. Release the LIM module by pulli ng both levers towa rd you, then to ward the outside of the chassi s. Figure 3-15: Relea sing the LIM Module Levers 6.
48 7. Install a blanking panel in pl ace of the LIM module, or refer to “Installing a LIM Module” on page 48 for instruction s on replacing the LIM module. Inst alling a LIM Module 1. Remove the new LIM module from the package. 2. Refer to “Removing a LIM Card” on page 45 , if a LIM module is still in place.
49 9. Connect the InfiniBand cables to the ports. a. T o plug in an InfiniBand cab le, push the connector into th e interface until you hear/feel a click.Check the InfiniBand port LEDs to de termine the status of the port. Refer to “InfiniBand Port LEDs” on page 75 .
50 7. If the Master Management Interface module wa s removed, the standby module becomes active. The “Master” led becomes green. 8. Install a blanking panel in th e empty bay , or refer to “Installing a Management Interface Module” on page 50 to replace the Management Interface module.
51 3. Use a #1 phillips screwdriver to loosen and remov e the screws from the left and right side of the Chassis ID module. Figure 3-20: Loose n the Captive Screws 4. Pull the Chassi s ID mod ule from the bay . Figure 3-21: Remove the Chassis ID Module 5.
52 Inst alling a Replacement Chassis ID Module 1. Remove the new Chassis ID module from the package. 2. Ground yourself approp riately . 3. Remove the old Chassis ID module, if you have not already don e so. Refer to “Removing a Chassis ID Module” on page 50 if a Chassis ID module is still in pl ace.
53 4 Administrative T asks This chapter describes administrative tasks that may be performed on the T opspin 270 system. • “Upgrade all Cards in a Chassis” on page 53 • “Upgrading an Individ.
54 Upgrading a T op spin 270 with Element Manager The following procedure describes the upgrade procedure using the Element Manag er GUI. This procedure also assumes you are upgrading all fabric controllers in the chassis. 1. Launch Element Manager for the server switch.
55 Note : all cards in the chassis must have an oper -status of “ up ” for the upgrade to be ef fective on all components. a. Select Maintenance > File Manageme nt b. Click the new .img file and click the Install butto n. c. Click Ye s when prompted.
56 6. Select Maintenance > Reboot to reboot the controller cards and activate the image. Click Ye s at the prompt. 7. V iew the new image on the cards: a. Select Vi e w > Device Front V iew . b. Right-cl ick one of the cards and select Properties .
57 Upgrading a Controller Card with the CLI For the commands needed to upgrade a single Controller card using the CLI, refer to the CLI Refer ence Guide . 1. Check the version of your Controller card with the show card-inventory command. In the example below , only the Controller card in slot 12 needs to b e upgraded.
58 2. Show the standby Controller card. Example 3. Check to see if you alread y have a .img file that can be installed. (Delete the .img file, if it not the one you need to install. Use the delete [ slot-number : ] imag e: file-name command.) Example 4.
59 5. Activate the image. After download ing the image file to the chassis controller , it must be installed to become active. The install command installs the specified image file into the system. a. In the privileged-execute mode, enter install image: image-file-name .
60 Upgrading a Node Card with Element Manager The following procedure describes the upgrade procedure for indiv idual node cards using the Element Manager GUI. This procedure assumes you are upgra ding only one or more node cards, and not the Controller cards.
61 Note : all node cards in the must have an oper - status of “ up ” for the upgrade to be ef fective. a. Select Maintenance > File Manageme nt b. Click the new .img file and click the Install butto n. c. Click Ye s when prompted. Figure 4-6: W atching the File Copy Progress d.
62 6. Activate the image on the node card(s) by enabli ng and disabling each node car d. Do not reboot the chassis as this will not result in the image being applied to the node card(s). a. Right-click a node card and select Pr operties . b. Click the down radio button and select the Apply but ton.
63 Upgrading Node Card(s) with the Chassis Manager For the procedure needed to upgrade node cards using the Chassis Manager GUI, refer to the Chassis Manager User Guide .
64.
65 5 Monitoring the T op spin 270 System This chapter describes how to install and m anage the T op spin 270 system hardware. • “Interpret ing the Front Panel L EDs” on page 65 • “Interpreti.
66 Figure 5-1: Front Pan el LEDs System-Wide S t atus LED Locating the System-Wide S tatus LED The system-wide status LED is located on the front of the chassis, and is visible whether the bezel cover is on or off. This LED indicates the over all health of all mo dules in the system.
67 Power Supply LEDs Locating the Power Supply LEDs The Power Supply LEDs are located in the outside of each Power Supp ly module, if you are facing the front of the chassis with the bezel cover removed. Figure 5-2: Power Supply LEDs Y ellow blinking System identify .
68 In addition, a Power Sup ply Identify LED is locat ed on the outside of th e chassis, next to the corresponding power supply . This LED allow s the us er to initiate a comman d that causes the Identify LED to blink, which assists in locating a particular Field Repl aceable Unit.
69 Fan LEDs Location The Fan LEDs are located at the top of each Fan tray module. Refer to “Front Pan el LEDs” on page 66 . In addition, replicas of the Fa n T ray LEDs are positio ned on the back of the chassis. Refer to “Management Interface Module LEDs” on page 71 .
70 Fabric Controller LEDs Each Fabric Module has two sets of LED indicators. • The two LEDs (green or yellow) are the module status indicators ( Ta b l e 5 - 5 ). • The single LED (green only) indicates whether of n ot the module is th e active system master ( Ta b l e 5 - 6 ).
71 Interpreting the Back Panel LEDs The back of the T o pspin 270 chassis has the following types of LED indicato rs: • “Management Interface Module LEDs” on page 71 • “Chassis ID LEDs” on.
72 Location The Management Interface modules are located at the top of back the chassis. Refer to Figure 5-5 to view the chassis diagram. Figure 5-6: Managem ent Interface Module LEDs Interpreting the.
73 Fan T ray Mo dule S tatus LEDs Power Supply Module S tatus LEDs Green off No power to the Manageme nt Interface module, LED failure, or yellow LED is ON. Y ellow solid on Failure of the Mana gement Interface module. Operator attention required. The “ ! ” label indicates a failure.
74 Master Management Connection S tatus LED The Master Management Connection Status LED is a single LED that indicates wh ether that particular Management Interface module is connected to the syste m 's active master controller . Refer to Figure 5-5 to view the location of this LED.
75 LIM S t atus LEDs Location The LIM Status LED is located at the far left of each LIM card (if you are facing the back of the chassis). Refer to Figure 5-5 for a complete diagram of th e back panel of the chassis.
76 Location The InfiniBand port LEDs are located to the right of each InfiniBand port (i f you are facing the LIM card) in the back of the chassis. Figure 5-9: InfiniBand Port LEDs Interpreting the In.
77 3. The Device Rear V iew and the Device Front V iew appear . Figure 5-10: Chassis Ma nager 270 Device Rear View.
78 Figure 5-1 1: Chassis Manager 270 Device Front View 4. V iew the information at the top of the window to quickly check the status color and the number of modules installed . • The numbers associated with the Card field indicate the slot numbers where modules are installed.
79 • In the case of the fabric controller cards, th e card that is currently on standby (not the master) will be grey . The master fabric controller will be green. • A red LED indicates that an error has been detected. Monitor the Cards 1. Launch the Chassis Manager by entering the IP address of the InfiniB and switch into your web browser .
80 normal bootFailed tooHot booting checkingBootImage wrongBootImage rebooting standby recoveryImage 9. Click the radio button next to the card that you want to monitor . 10. Click the Properties button to view details about the card, or to reset the card.
81 7. V iew the Admin S tatus and the Oper S tatus of the ports. The Admin Status refers to the state that the admin has chosen the port to be. The Oper S t atus refers to the actua l state of the port.
82 The Power Supplies view appears. Figure 5-15: Chassis Ma nager Power Supplies Window Monitor the Fans 1. Launch the Chassis Manager by entering the IP address of the InfiniB and switch into your web browser . 2. Log into the chassis. 3. The Device Rear V iew and the Device Front V iew appear .
83 Monitor the T emperature 1. Launch the Chassis Manager by entering the IP address of the InfiniB and switch into your web browser . 2. Press the Enter key . 3. The Device Rear V iew and the Device Front V iew appear . 4. Click open the Chassis file in the left-navigation tree.
84 Monitoring the System with Element Manager For information regarding installi ng the optionally licensed Element Manager GUI, refer to the InfiniBand User Guide . 1. Launch the Element Manager . 2. Select Health > St a t u s . The Health S tatus window opens.
85 Interpreting the Power Supplies T ab Use the Health > St a t u s > Power Supplies tab to view the operating st atus of the power supplies. Figure 5-19: Element M anager Power Supplies T ab Interpreting the Fans T ab Use the Health > St a t u s > Fans tab to view the operating status of the fans.
86 Figure 5-21: Element M anager Sensors T ab 6. Note the OperS tatus field. A status of “up” indicates th at t he sensor is functioning prop erly . 7. Note the T emperature field. Each slot has an individua l temperature sensor . The Alarm and Shutdown temperatures vary by slot type.
87 Note the Speed field. The integer in this field represents a percentage. The percentage changes based on the ambient temperature of the unit, and will increase as the temperature rises . Example Monitor the Sensors •s h o w s e n s o r Example Note the T emperature field.
88.
89 6 Hardware Diagnostic T est s This chapter describes how to run diagnostic tests on th e T opspin 270 system hardware. • “About Diagnostic T ests” on page 89 • “Displaying Hardware Errors” on page 99 About Diagnostic T est s Hardware diagnostic tests can be performed through the CLI or the Element Manager GUI.
90 Run Card T est s References to “Cards” refers to fabric controllers , management I/O modules, no de cards and the chassis ID module. Fans and power supplies are not included in the Card test s; they can be tested through the standard chassis test ( page 93 ), or as indiv idual components.
91 Example of comp leted test Topspin-270(config-diag-card-11)# exit Topspin-270(config)# exit Topspin-270# show diagnostic card 11 ================================= ==================================.
92 3. Use the more file-system : file-n ame command to displ ay the log file and view the detailed results of the diag test . Example of l og resu lts 4. Enter reload to reboot the switch after the test is complete. If you do not reboot the switch after running the self-test, the switch will remain in an unknown state.
93 • Standard page 93 • Extended • Extended Memory Run a Chassis S t andard T est The chassis standard diag test runs a diag nostic test on all cards in the chassis. 1. Enter the diag chassis test standard and start commands to initiate the test.
94 3. Enter the show diag post command to show any errors on indivi dual components. Example Run Fan T est s The following tests are available to locate and diagnose fan m odules: •L E D •S e l f - T e s t page 94 Run a Self-T est on a Fan 1. Identify the numb er of the fan you want to diagnose, if you do not already know the nu mber .
95 2. Enter the diag fan < id > command. Example 3. Use the show diag fan command to show the progress of the test. Example Topspin-270# config Topspin-270(config)# diag fan 1 Topspin-270(config.
96 4. Use the show diag fru-error command to display any errors th at appear in the result-string . Example 5. Reboot the chassis when the self-test is complete.
97 Run a Self-T est on a Power Supply 1. Show the ID of the power supply that you wan t to diagnose, if you do not already know the number . a. Enter the show power -supply comma nd. Example 2. Enter the diag power-supply < id > command and specify the type of test (self-test is chosen by default).
98 5. Use the show diag fru-error command to display any errors th at appear in the result-string . Example 6. Reboot the chassis when the self-test is complete.
99 Displaying Hardware Errors T o di splay POST results, non-fatal errors th at can are recovered, inform ational logging (such as firmware updates), and hardware errors: 1.
100 T o view FRU errors on y our T opspin 270, enter the show diagnostic fru-error command. Example Error T ypes The following types o f hardware errors are logged for the T opspin 270 baseboard: The .
101 2 Power Supply Fan Fail Error 3 Power Supply I2C Communication Error T able 6-2: T opspin 270 Power Supply Errors Error Number Description.
102.
103 7 S pecifications and Compliance Certifications This chapter details the T opspin 270 sp ecifications and compliance certifications. Chassis and Management Interface T able 7-1: Chassis and Manage.
104 Electrical S pecifications EMC/Immunity Safety Acoustics Non-Operating V ibration, random 2.09Grms, 3-axis, bottom /top, left/right, front/back Max. Operating Inclination 15 degrees T able 7-2: Electrical S pecific ations Category Specification AC Input Auto-ranging 90-264V AC , 47-63Hz.
105 Product Markings • UL, FCC S tatement, VCCI, CE, ICES.
106.
Index A active controller card 11 admin status 81 C card operational state 79 reset 80 card reset 80 chassis ID about 19 LEDs 74 chassis manager launching 32 LEDs 78 controller card identify active 11.
R rack-locator 89 reload 92 reset card 80 reset controller card 59 S safety information vii setup 32 show card 11 show diag chassis 93 show diag fru-error 96, 98 show diag post 94 show power-supply 97.
Een belangrijk punt na aankoop van elk apparaat Cisco Systems SFS 7008 (of zelfs voordat je het koopt) is om de handleiding te lezen. Dit moeten wij doen vanwege een paar simpele redenen:
Als u nog geen Cisco Systems SFS 7008 heb gekocht dan nu is een goed moment om kennis te maken met de basisgegevens van het product. Eerst kijk dan naar de eerste pagina\'s van de handleiding, die je hierboven vindt. Je moet daar de belangrijkste technische gegevens Cisco Systems SFS 7008 vinden. Op dit manier kan je controleren of het apparaat aan jouw behoeften voldoet. Op de volgende pagina's van de handleiding Cisco Systems SFS 7008 leer je over alle kenmerken van het product en krijg je informatie over de werking. De informatie die je over Cisco Systems SFS 7008 krijgt, zal je zeker helpen om een besluit over de aankoop te nemen.
In een situatie waarin je al een beziter van Cisco Systems SFS 7008 bent, maar toch heb je de instructies niet gelezen, moet je het doen voor de hierboven beschreven redenen. Je zult dan weten of je goed de alle beschikbare functies heb gebruikt, en of je fouten heb gemaakt die het leven van de Cisco Systems SFS 7008 kunnen verkorten.
Maar de belangrijkste taak van de handleiding is om de gebruiker bij het oplossen van problemen te helpen met Cisco Systems SFS 7008 . Bijna altijd, zal je daar het vinden Troubleshooting met de meest voorkomende storingen en defecten #MANUAl# samen met de instructies over hun opplosinge. Zelfs als je zelf niet kan om het probleem op te lossen, zal de instructie je de weg wijzen naar verdere andere procedure, bijv. door contact met de klantenservice of het dichtstbijzijnde servicecentrum.
