Summary of the content on the page No. 1
Cisco SFS 7008P InfiniBand Server Switch
Installation and Configuration Note
Product number: PID=78-17434-01 Rev. A0
This installation and configuration note describes how to install and configure the Cisco SFS 7008P
switch. This publication contains these sections:
• Safety Overview, page 2
• Parts List, page 2
• Required Tools, Equipment, and Personnel, page 2
• Before You Install, page 3
• Installing the Cisco SFS 7008P Switch into a Rack, page 6
• Troubleshooting, page 20
• Translated Safety
Summary of the content on the page No. 2
Safety Overview Safety Overview Safety warnings appear throughout this publication in procedures that may harm you if performed incorrectly. A warning symbol precedes each warning statement. Warning IMPORTANT SAFETY INSTRUCTIONS This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents. Use the statement num
Summary of the content on the page No. 3
Before You Install • Three people to complete the installation (highly recommended). The Cisco SFS 7008P switch chassis weighs up to 106 pounds fully loaded. Before You Install Before you begin the installation, do the following: • Make sure that you have the right cables and sufficient ventilation. • Open the Cisco SFS 7008P package and remove the chassis, rack brackets, parts bag, and documentation from the box. Remove the packaging from around the chassis. After you have removed the straps,
Summary of the content on the page No. 4
Verifying Basic Hardware Figure 1 Back of Unit Chassis ID Power plug 1 Management I.O modules Power plug 2 4x copper line interface modules Main air exhaust Step 2 Verify that you have a Chassis ID module installed. (See Figure 1). Step 3 Verify that you have a Fabric Controller installed in the Core slot (see slot 11 in Figure 2). A second Fabric Controller module (installed in slot 12) is not required for the chassis to function, but is required to have a non-blocking fabric. Cisco SFS 7008P
Summary of the content on the page No. 5
Verifying Basic Hardware Figure 2 Cisco SFS 7008P Switch Front ViewWithout Bezel y Status LED Power Supply identity LED System Power supplies Status LED Fan Fan Node slot 1 Slot 9 Node slot 2 Slot 10 Core slot 1 Slot 11 Core slot 2 Slot 12 Slot 13 Node slot 3 Slot 14 Node slot 4 Fan tray LED Step 4 Verify that you have at least one power supply installed. (See Figure 2.) Step 5 Verify that you have at least one fan module installed. (See Figure 2.) Step 6 Verify that you have at least one fabr
Summary of the content on the page No. 6
Installing the Cisco SFS 7008P Switch into a Rack Figure 3 LIM and Fabric Module Connections LIM card in slot 1 Fabric card in slot 9 LIM card in slot 2 LIM card in slot 3 Fabric card in slot 10 LIM card in slot 4 LIM card in slot 5 Fabric card in slot 13 LIM card in slot 6 LIM card in slot 7 Fabric card in slot 14 LIM card in slot 8 Installing the Cisco SFS 7008P Switch into a Rack This section describes how to install the Cisco SFS 7008P switch in an equipment rack. If you purchased the cust
Summary of the content on the page No. 7
Installing the Cisco SFS 7008P Switch into a Rack Figure 4 Install Appropriate Shelf Step 2 Ground yourself using an approved ground wrist-strap. Step 3 Determine the direction that the switch will be installedand justified in the rack. The direction that the switch will be justified determines which set of mounting brackets need to be removed in the next step. Step 4 Remove one set of mounting brackets, as shown in Figure 5: • If the switch will be justified toward the bezel-side in the rack,
Summary of the content on the page No. 8
Installing the Cisco SFS 7008P Switch into a Rack Figure 5 Unscrew Extra Mounting Brackets from the Chassis Step 5 Separate the mounting brackets from the chassis when all screws have been loosened. Step 6 With 2 or 3 people working together, lift the switch into the rack as shown in Figure 6. Figure 6 Chassis Set onto Shelf Step 7 Push the chassis into the rack until the mounting brackets are flush with the rails. Step 8 Use screws that fit your rack to attach both mounting brackets to the ra
Summary of the content on the page No. 9
Installing the Cisco SFS 7008P Switch into a Rack Installing Optional High-Availability Components If you purchased a High-Availability (HA) package, install the following components: • Redundant Power Supply; see the power supply locations in Figure 7. Install the second power supply according to the directions in the Power Supply Module Installation Guide in the package. Figure 7 Power Supplies and Fans Located in the Front of the Unit with the Bezel Removed Power Supply Status LED Power Sup
Summary of the content on the page No. 10
Installing the Cisco SFS 7008P Switch into a Rack Figure 8 Management I/O Modules Located in the Back of the Unit Chassis ID Power plug 1 Management I.O modules Power plug 2 4x copper line interface modules Main air exhaust Configuring and Connecting Host Channel Expansion Card for IBM BladeCenter This section briefly describes configuring your InfiniBand host. Download the configuration software and an integrated suite of drivers including IPoIB, SRP, SDP, uDAPL and MPI from the Cisco Softwar
Summary of the content on the page No. 11
Installing the Cisco SFS 7008P Switch into a Rack To install the Host Channel Expansion Card for IBM BladeCenter drivers after you have installed the HCA Expansion Card, follow these steps: Step 1 Locate your downloaded software direcory. Step 2 Open a terminal or graphic window and access the top-level directory. Step 3 Execute the command ./tsinstall in a terminal window. # cdmount ./tsinstall This program automatically detects the available kernel and installs the appropriate drivers as RPM
Summary of the content on the page No. 12
Installing the Cisco SFS 7008P Switch into a Rack Installing Non-WHQL Host Channel Expansion Card Drivers on a Windows 2000 Server (BoIB and non-BoIB) The SFS 7008 chassis has Topspin operating system version 2.5.0 preloaded. DRIVERS TOO? OR DOWNLOAD?? IN STEP 4, THE SDK COMES UP - WHERE DID THAT COME FROM? To install Windows drivers after you have installed the HCA Expansion Card, follow these steps: Step 1 Log on to your Windows 2000 host. A Found New Hardware alert appears (see Figure 9). F
Summary of the content on the page No. 13
Installing the Cisco SFS 7008P Switch into a Rack Note This wizard may not appear immediately. When the wizard does appear, click Cancel. Step 4 Run Topspin-ib-W2k-releaseNumber.exe. The InfiniBand SDK Setup window opens (see Figure 11). Figure 11 InfiniBand SDK Setup Window Step 5 Click Next. The End User License Agreement window opens. Step 6 Click the I Agree to the terms listed above radio button, and then click Next. The Product Information window appears. Step 7 Click Next. The Ready to I
Summary of the content on the page No. 14
Installing the Cisco SFS 7008P Switch into a Rack Installing Host Channel Expansion Card Windows 2003 Drivers If you have not already done so, download an integrated suite of HCA drivers including IPoIB, SRP, SDP, uDAPL and MPI from the Cisco Software Center at this URL: http://www.cisco.com/public/sw-center To install the Windows 2003 drivers, follow these steps: Step 1 Log on to your Windows 2003 host. Step 2 HOW DID SW GET ON MY COMPUTER?HOW DO I START THIS????????????. The Product Install
Summary of the content on the page No. 15
Installing the Cisco SFS 7008P Switch into a Rack Figure 13 Installation Status A Windows driver dialog box appears. This dialog box explains that the new drivers do not contain a Windows signature. Although the drivers are not digitally signed, they are tested using the Microsoft HCT suite. WHQL submission materials are available per request (CAB files, etc.). Step 6 Click Continue Anyway (Figure 14) each time the Windows Logo testing dialog box appears. Figure 14 Testing Dialog Box The drive
Summary of the content on the page No. 16
Installing the Cisco SFS 7008P Switch into a Rack Figure 15 Driver Installation Notice Step 8 Important: Ignore the Found New Hardware Wizard (see Figure 16) when it appears because it will continue without user intervention. This window appears three times (twice for the IPoIB and once for SRP). Figure 16 Ignore the Found New Hardware Wizard Windows Step 9 Click Finish. Step 10 Reboot the server. a. In Windows, click Start > Shutdown. You see the screen in Figure 17. b. Select Restart from th
Summary of the content on the page No. 17
Installing the Cisco SFS 7008P Switch into a Rack Figure 17 Restarting Windows Server Installing WHQL Drivers on a Windows 2000 or 2003 Server (BoIB and non-BoIB) WHQL drivers are packaged in a .ZIP file. To install WHQL drivers, see the documentation at http://www.cisco.com. THERE IS NOTHING HERE??!! Launching the SFS Chassis Manager (Optional) SFS Chassis Manager is a web-based GUI that can be used to manage a single InfiniBand chassis from a Web browser. SFS Chassis Manager supports the fol
Summary of the content on the page No. 18
Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log-In Window Step 2 Enter your username and password in the log-in window and click Login . SFS Chassis Manager loads in your browser window as shown in Figures 19 and 20. Figure 19 SFS Chassis Manager Opening (Rear View) Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 18 78-17434-01 Rev. A0
Summary of the content on the page No. 19
Installing the Cisco SFS 7008P Switch into a Rack Figure 20 SFS Chassis Manager Opening (Front View) Installing the SFS Element Manager GUI (Optional) For more information regarding the SFS Element Manager, see the Cisco SFS 7000 Series Product Family Element Manager User Guide. To install Element Manager, follow these steps: Step 1 Ensure that you have sufficient system resources. You need the following: • 32 MB free RAM • 50 MB disk space and 50MB additional temporary space during installati
Summary of the content on the page No. 20
Troubleshooting Step 4 Run the installation wizard: a. On Windows, double-click install.exe. On Solaris and Linux systems, enter sh ./install_yourOS.bin. b. Follow the onscreen instructions. Enter location and preference information as requested by the installation program. Step 5 Start the SFS Element Manager by following these steps: a. On Windows platforms, click Programs -> Cisco SFS Element Manager -> Cisco SFS EM On Linux platforms, change to the installation directory and run SFS Elemen
