Professional Documents
Culture Documents
BCFP Ina Nutshell 4Gb
BCFP Ina Nutshell 4Gb
Welcome to this BCFP in a Nutshell 4 Gbit/sec Edition study aid. Objective: We've put together this guide is to help you prepare for the BCFP certification exam number 143-050. Weve added some additional items to help you even more. Audience: This self-study guide is targeted for those who have attended CFP 264 Brocade 4 Gbit/sec Accelerated BCFP BLS course, and who wish to undertake self-study or review activities before taking the actual BCFP test. It is also for those individuals who do not have the time to attend the formal training, but who still wish to be certified as a BCFP. This guide is aimed at anyone who works with Brocade SilkWorm products and is proficient in their knowledge of the features and functionality as well as the day-to-day operations of. It is not intended as a substitute for classroom training, and hands-on time. We still highly recommend you attend CFP 264 Brocade 4 Gbit/sec Accelerated BCFP BLS. Usage: This guide summarizes the key topics on the BCFP exam for you in an easy to use format. It is organized closely around the exam objectives. Use the Table of Contents, List of Tables and List of Figures to quickly jump to a given area. We also suggest this guide be used in conjunction with our free online knowledge assessment test, CFP 265 BCFP Knowledge Assessment. We hope you find this useful in your journey towards BCFP Certification, and we welcome your feedback.
TABLE OF CONTENTS
List of Tables ................................................................................................................................5 List of Figures ...............................................................................................................................6 1 Fibre Channel Concepts..........................................................................................................7 1.1 1.2 1.3 1.4 1.5 2 2.1 2.2 2.3 2.4 2.5 2.6 2.7 3 4 3.1 4.1 4.2 4.3 4.4 4.5 5 5.1 5.2 5.3 5.4 6 6.1 Decoding 24-bit address components.................................................................................7 Selection of Routes...........................................................................................................8 Fibre Channel Classes of Service .......................................................................................9 Port Initialization Sequences, Topologies and Characteristics ................................................9 Principal Switches ..........................................................................................................11 Output From Key Fabric OS Commands ...........................................................................12 Components and Functions of FRUs..................................................................................12 Zoning Concepts and Implementation ..............................................................................14 Zone Usage Related to Zone Merge Operations and I/O...................................................15 Trunking Concepts .........................................................................................................17 Long Distance Fabric Technologies ..................................................................................18 Licensed Products...........................................................................................................19 Fibre Channel Cables and Transceivers............................................................................20 Switch Installation and Initial Configuration Steps ..............................................................21 Port-specific Configurations .............................................................................................21 Switch Configuration and Capturing a Baseline Configuration ............................................22 Verifying the Switch Configuration...................................................................................23 Validating Device Connectivity ........................................................................................24 Adding an Initiator And Target Pair .................................................................................25 Fabric OS Tools to Monitor a Switch or Fabric ..................................................................26 PID Formats...................................................................................................................28 Maintenance Operation Impacts......................................................................................29 Security Benefits and Implementation Requirements ............................................................30
2006 Brocade Communications Systems, Incorporated. Page 3 of 40
Management Interfaces.........................................................................................................25
Administering Multiple User Accounts...............................................................................31 Security-related Base Fabric OS Features ..........................................................................31 Determining the Operational Status of a SilkWorm Product.................................................33 Troubleshooting Connectivity Issues..................................................................................34 Relevant Tools for Problem Escalation...............................................................................35
Troubleshooting ...................................................................................................................33
LIST OF TABLES
Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table Table 1: Routing Commands ..........................................................................................................8 2: Classes of Service ............................................................................................................9 3: Brocade Switch States ....................................................................................................11 4: Commands to Troubleshoot Fabric Segmentation ...............................................................12 5: Commands to Determine the Switch WWN ......................................................................12 6: SilkWorm Director Blade Support ....................................................................................12 7: FRU Status Commands ....................................................................................................13 8: Zoning Enforcement Type................................................................................................14 9: Zone Member Definitions ................................................................................................14 10: Zoning Transaction Commands......................................................................................15 11: Segmentation Errors .....................................................................................................16 12: RSCN Suppression .......................................................................................................16 13: portcfglondistance Settings ..................................................................................18 14: Distance Limitations by Speed .......................................................................................20 15: Port Management Commands........................................................................................21 16: Switch Configuration Management Commands ...............................................................22 17: System Support Commands ...........................................................................................22 18: Ethernet Port Management Commands ...........................................................................23 19: Switch Configuration Display Commands .......................................................................23 20: Device Connectivity Commands.....................................................................................24 21: Fabric Watch Information .............................................................................................27 22: Fabric Watch Events.....................................................................................................28 23: Extended Edge PID Format ............................................................................................29 24: SSL Certificate Files ......................................................................................................30 25: Commands to Diagnose Physical Switch Connectivity.......................................................33 26: Commands to Diagnose Routing Issues ...........................................................................33 27: FC Router Commands ...................................................................................................34 28: portcmd Command ....................................................................................................34 29: Switch Data Collection Commands.................................................................................35
LIST OF FIGURES
Figure 1: Fibre Channel Network Addressing...................................................................................7 Figure 2: SilkWorm 48000 Port Area Numbers ...............................................................................7 Figure 3: Device Initialization.......................................................................................................10 Figure 4: Principal Switch in a Fabric ............................................................................................11 Figure 5: Zoning Database Sizes..................................................................................................15 Figure 6: Multi-speed Trunk Groups ..............................................................................................17 Figure 7: Types of Connectors ......................................................................................................20 Figure 8: Name Server Model......................................................................................................24 Figure 9: fcping Command Example ..........................................................................................25 Figure 10: Fabric Manager Toolbar ..............................................................................................26 Figure 11: SAN Health................................................................................................................36 Figure 12: Exam Introduction Screen.............................................................................................37 Figure 13: Non-disclosure Agreement ...........................................................................................38 Figure 14: Sample Question ........................................................................................................39 Figure 15: Sample Score Sheet ....................................................................................................40
NOTES ABOUT THE 24-BIT FIBRE CHANNEL ADDRESS FORMAT A 24-bit address has 3 parts, Domain (1-239), Area (0-255) and Node Address (the AL_PA) On a SilkWorm 48000, each slot could have a 16 or 32-port card Port numbering is constant; if a 16-port card is in a slot, only the grey ports below would be used for that slot
In-order Delivery
iodset Frames are delivered in order or dropped. A new route will not be added until the hold down period is met on the old path hold down is equal to the E_D_TOV = 2000ms Wait 650ms to detect then re-run routing protocol (default setting) Displays mode
iodreset iodshow
NOTES ABOUT ROUTING The default routing policy for 4 Gbit/sec Condor-based switches is exchange-based The linkcost command should not be used unless there is some extraordinary circumstance
Class
1 2 3 4 6 F
Description
Dedicated connection transmitter/receiver Connectionless switch to switch communication between ports transfers frames (acknowledgement) Connectionless switch to switch communication between ports transfers frames (no acknowledgement) Dedicated connections transmitter/receiver - virtual circuits Connectionless multicast service Communication between switches only
ACK
X X
Supported by Brocade
Yes Yes
Yes
DEVICE PORT TYPES N_Port Node port, a fabric device directly attached NL_Port Node Loop port, a device attached to a loop
no
y/n
yes
FL_Port
(State 2)
yes
y/n
no
Do you want to talk loop? (Transition 2) Im waiting for someone to talk to me (State 3)
G_Port
F_Port device
(State 5) Switch
Fabric
E_Port
Figure 3: Device Initialization
(State 4)
1.5
PRINCIPAL SWITCHES
Notes
Ensure unique Domain IDs throughout the fabric Time synchronization across the fabric
Subordinate
PRINCIPAL SWITCH NOTES The switch with the lowest WWN will be the principal switch Using the fabricprincipal command will set a priority bit to make that switch the preferred principal next time there is an election Upstream ISLs are principal routes to the principal switch; downstream routes go away from it Using the tsclockserver command will associate a principal switch with an NTP time server; the date command then becomes read-only for the rest of the switches in the fabric
Definition
Displays the contents of the switch error log Displays switch and port status information One use is to list the reason for fabric segmentation
Command
wwn switchshow licenseidshow
Definition
Displays the switchs worldwide name Displays WWN after switchWwn: heading in command output Displays the systems license ID
Supported Blades
CP2 FC-16 FC2-16 FC4-16
Blade ID
5 2 4 17 16 17 14 24
Installation Notes
24K CP; 16-port Port Cards only (2 Gbit/sec) 12K Port Card works with CP2 only 24K Port Card works with CP2 or CP4 48K Port Card works with CP2 or CP4 48K CP; 16 & 32-port Port Cards (4 Gbit/sec) 48K Port Card works with CP4 CP4 only CP4 only using chassisconfig 5
SilkWorm 48000
GETTING A BLADE INVENTORY sw2:admin> slotshow Slot Blade Type ID Status --------------------------------1 SW BLADE 17 ENABLED 2 UNKNOWN VACANT 3 UNKNOWN VACANT 4 UNKNOWN VACANT 5 CP BLADE 16 ENABLED 6 CP BLADE 16 FAULTY 7 UNKNOWN VACANT 8 UNKNOWN VACANT 9 SW BLADE 18 ENABLED 10 AP BLADE 24 ENABLED
Description
Display status of the power supplies Display temperature sensor readings Display fan or blower status Display serial ID SFP information Display sensor readings Display all FRUs in a Director chassis
Enforcement Type
Hardware Session
Method
Frame filter at destination port Trap PLOGI, issues reject to initiator
Zone Members
All <domain, port or area> All WWNs Mixed
Enforcement
Hardware Hardware Session
ZONING NOTES LSAN zones must begin with LSAN_ or lsan_ (case-insensitive) Only Port WWNs may be used in LSAN zone device definitions LSAN zones are created in the edge fabrics when routing between multiple edge fabrics A best practice is single-initiator zones; 1 HBA/zone LSAN zones may also be created in backbone fabrics that run Fabric OS v5.1
Description
Displays the current zoning transaction information Aborts the current zoning transaction (anything since the last save)
Description
Occurs when zoning is enabled in both fabrics and the effective configurations are different Occurs when the name of a zone object in one fabric is also used for a different type of zone object in the other fabric. Fabric A: alias: Mkt_Host 1,16 Fabric B: zone: Mkt_Host 1,16
Content mismatch
Occurs when the name and type of a zone object in one fabric is also used in the other fabric but the content or order is different.. Fabric A: alias: Eng_Stor wwn1; wwn2 Fabric B: alias: Eng_Stor wwn2; wwn1
RSCN NOTES RSCN suppression status may be determined by output from the portcfgshow command Look for RSCN Suppressed under the particular port in portcfgshow output sw2:admin> portcfgshow
Ports 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 -------------------+--+--+--+--+----+--+--+--+----+--+--+--+----+--+--+-Speed 2G 2G AN AN AN AN 4G 4G AN AN AN AN 1G AN 1G AN Trunk Port ON ON ON ON ON ON ON ON ON ON ON ON ON ON ON ON Long Distance L1 L1 .. .. L2 .. .. .. .. .. .. .. .. .. .. .. VC link init .. .. .. .. ON .. .. .. .. .. .. .. .. .. .. .. Locked L_Port .. .. .. .. .. .. .. .. .. .. .. .. ON .. .. .. Locked G_Port .. .. .. .. .. ON .. .. .. .. .. .. .. ON .. .. Disabled E_Port .. .. .. .. .. .. .. .. .. .. .. .. .. .. ON .. RSCN Suppressed .. .. .. .. ON .. .. .. .. .. .. .. .. .. .. .. Persistent Disable .. .. .. ON .. .. .. .. .. .. ON .. .. .. .. .. ISL R_RDY Mode .. .. ON .. .. .. .. .. .. ON .. .. .. .. .. .. where AN:AutoNegotiate, ..:OFF, ??:INVALID
2006 Brocade Communications Systems, Incorporated. Page 16 of 40
One port group can have both 2 Gbit/sec and 4 Gbit/sec trunks simultaneously
SilkWorm4900:admin> switchshow switchName: SilkWorm4900 switchType: 44.0 switchState: Online <output truncated>
Area Port Media Speed State ============================== 0 0 id N2 Online 1 1 id N2 Online 2 2 id N2 Online 3 3 id N2 Online 4 4 id N2 Online (upstream)(Trunk master) 5 5 id N2 Online 6 6 id N4 Online 7 7 id N4 Online (upstream)(Trunk master) E-Port E-Port E-Port E-Port E-Port
A six-ISL 2 Gbit/sec trunk A two-ISL 4 Gbit/sec trunk
(Trunk port, master is Port 4 ) (Trunk port, master is Port 4 ) (Trunk port, master is Port 4 ) (Trunk port, master is Port 4 ) 10:00:00:05:1e:34:01:e6 "toist04b41"
E-Port (Trunk port, master is Port 4 ) E-Port (Trunk port, master is Port 7 ) E-Port 10:00:00:05:1e:34:3b:8b "toist03b41"
<output truncated>
Figure 6: Multi-speed Trunk Groups
To connect two edge fabrics over an FCIP connection, a SilkWorm Multiprotocol Router, SilkWorm 7500 or FR4-18i blade must be used on both sides When seeking an FCIP solution, the circuit should have the lowest possible round-trip time and least percentage of packets lost Extended Fabric enables a single fabric using two switches over a WAN at distance Extended Fabric is an optional license key Both bookend switches must have the same configurations and be the same generation ASIC Can use extenders or repeaters Use the portcfglongdistance command to set the distance level for a port ISL R_RDY may be used to connect two fabrics using gateway devices for ATM or SONET LD is used when the Fabric OS will calculate the distance LS is used when the user specifies the distance Distance @ 1 Gbit/sec
0 - 10 km 0 - 10 km 11 - 25 km 26 - 50 km 51 - 100 km 0 - 500 km 0 - 500 km
Distance @ 2 Gbit/sec
0 - 5 km 0 - 10 km 11 - 25 km 26 - 50 km 51 - 100 km 0 - 250 km 0 - 250 km
Distance @ 4 Gbit/sec
0 - 2 km 0 - 10 km 11 - 25 km 26 - 50 km 51 - 100 km 0 - 100 km 0 - 100 km
License Required
No No Yes Yes Yes Yes if > 10 km Yes if > 10 km
MONITORING SWITCHES Web Tools, Advanced Performance Monitor and Fabric Watch can be used to monitor a switch SNMP may also be configured to set traps with the snmpconfig command
62.5 Cable
300 m 150 m 70 m
9 Cable
10 km 10 km 10 km
MEDIA NOTES Multimode uses SWL SFPs only Single mode uses LWL SFPs up to 10 km; ELWL SFPs > 10 km SFPs should match any port speeds that are hard set via the portcfgspeed command
4 INITIAL CONFIGURATION
4.1 SWITCH INSTALLATION AND INITIAL CONFIGURATION STEPS
INITIAL CONFIGURATION NOTES fabric.ops parameters must be the same on all switches that participate in a fabric PID format is one of the fabric.ops parameters Switch parameters are set with the configure command RS232 ports on a Director are used for serial & modem connections IP addresses should be set with a serial connection before plugging in the Ethernet cable
Command
portcfg
Description
Use this command to configure the address resolution protocol (ARP) entries, IP interfaces on the gigabit Ethernet (GbE) port, static routes on the IP interface, FCIP tunnels, and registered state change notification (RSCN) suppression. Enable or disable a port from becoming an E_Port Enable a port as a G_Port, preventing loop initialization Shows status and speed of ports Configures the port speed at AN, 1, 2 or 4 Gbit/sec
PORT CONFIGURATION NOTES The SFP and hard-coded port speed should match, otherwise a Mod_Inv will display in switchshow output Some devices prefer hard-coded speeds to auto-negotiation
Description
Saves a copy of the switch configuration file Restores the switch configuration file from a backup
Command
syslogdipadd errshow syslogdfacility
Description
Enables you to redirect error log messages to 1-6 external servers Show the contents of the switch error log Use this command to change the syslog facility to LOG_LOCALx, where x is in the range of 1 - 7
SUPPORT NOTES The syslogd daemon enables you to send error messages off of the switch to a central location The errdelimiterset command allows you to set custom delimiters at the start and the end of a standard switch error message Running the supportsave command captures the contents of supportshow, as well as all of the system RASLOG, TRACE, core, FFDC and other files Configuring SNMP with the snmpconfig command will enable the switch to send traps under certain conditions to the SNMP management software SNMPv1 and SNMPv3 are supported
Description
Displays speed of network Displays detailed network configuration Sets network configuration
Command
configshow portcfgshow chassisshow
Description
Displays the switch configuration file Displays port configuration settings Display all FRUs in a Director chassis
PARAMETERS NOT RESET WHEN RESETTING SWITCH CONFIGURATION When a configdefault is issued, none of these are reset to defaults: IP Address MAC Address Subnet mask IP gateway License keys SNMP parameters System Name WWN Zone Configuration
Description
Displays the 24-bit addresses for all devices in the fabric Displays contents of the local Name Server Display contents of the remote Name Servers Validates a device has logged in to the fabric Displays Name Server entries matching a WWN, PID or alias Displays the zoning configuration Displays information about the current zoning transaction Displays all online devices zoned with a given device
5 MANAGEMENT INTERFACES
5.1 ADDING AN INITIATOR AND TARGET PAIR
NOTES Once an initiator and target have been added, connectivity between the two must be verified If zoning is involved, the zoning configuration must be checked using cfgshow A way to test initiator-to-target communication is by using fcping A device contacted by fcping could either ignore the ELS Echo request or issue an ELS ACCEPT By default, fcping sends 5 ELS Echo requests to each port
FABRIC MANAGER NOTES With the Change Management Profile feature, you may monitor changes to: o Firmware o Name server o Zoning o Port state changes (online/offline) o License keys Fabric Manager may be used to download firmware to multiple switches simultaneously, even if they are in different fabrics
FABRIC WATCH NOTES Fabric Watch monitors several different classes, and within those classes exist many more areas
Information
Classes
Description
Environment Fabric Performance Monitor Port E_Port F/FL_Port (Optical) AL_PA Performance Monitor EE Performance Monitor Filter Performance Monitor Resource Security SFP
Default and custom Triggered or continuous SNMP trap Event is logged to switch error log Port log lock RAPITrap Email alert
One Fabric Watch configuration per switch fwalarmsfilterset fwalarmsfiltershow fwmailcfg fwconfigure
Can be the same file for each switch 0 = disable alarms, 1 = enable alarms Display current alarm settings Configure email address to receive notifications Configure Fabric Watch from the command line
Event Type
Above Below Changed In-between
Definition
Counter > Upper boundary Counter < Lower boundary Counter is different than preceding counter Counter < (Upper boundary Buffer) Counter > (Lower boundary + Buffer)
XX1YZZ
XX is a value between 0x1 to 0xef inclusive (Domain ID 1-239 in decimal) The 1 means Native Mode Y is the port number 0x0 to 0xf (0-15 decimal) ZZ is the AL_PA for a loop device or 00 for an F_Port THE FORMAT OF A 24-BIT ADDRESS IN CORE PID MODE
XXYYZZ
XX is a value between 0x1 to 0xef inclusive (Domain ID 1-239 in decimal) YY is the port area ZZ is the AL_PA for a loop device or 00 for an F_Port
XXYYZZ
XX is a value between 0x1 to 0xef inclusive (Domain ID 1-239 in decimal) YY is the port area + 0x10, wrapping at 0x7f ZZ is the AL_PA for a loop device or 00 for an F_Port
PID FORMAT NOTES Switches in a fabric will not merge unless the PID formats are exactly the same
Certificate File
name.crt nameRoot.crt nameCA.crt
Description
The switch certificate The root certificate, which may already be installed in the browser. If not, it must be installed The CA certificate, installed only if you want the CA name displayed in the browser window
SNMP NOTES Fabric OS v5.1.0 supports SNMPv1 and SNMPv3 The SNMP security level is set with the configure command The SNMP agent and traps are configured with the snmpconfigure command
WEB TOOLS Web Tools may be disabled with the configure command Using the configure command, you may also enable the upfront login feature Upfront login requires validation before the GUI will be launched
NOTES ABOUT RADIUS When configured for RADIUS, the switch becomes a RADIUS client With RADIUS enabled, all account passwords are managed through the RADIUS server Authentication may be done from a RADIUS server, and use the local switch database as a backup if RADIUS is unavailable If only RADIUS is used for authentication, and unavailable, no access to the switch is possible through telnet
SAMPLE ERROR MESSAGES REGARDING TRACK CHANGES 2006/06/29-08:43:02, [TRCK-1002], 4,, INFO, switch2, Unsuccessful login by user jcannata. 2006/06/29-08:43:14, [TRCK-1006], 5,, INFO, switch2, Track-changes off.
NOTES ABOUT PASSWORDS AND POLICIES Passwords should be changed on a regular basis Administration of Fabric OS v5.1.0 account passwords consists of these policy features: o Password strength o Password history o Password expiration o Account lockout The strength policy enforces format rules such as case, digits, punctuation and minimum length The history policy prevents users from recycling passwords The expiration policy forces the minimum and maximum time a password may exist The lockout policy allows you to set the number of failed attempts, and the duration of the lockout When an administrator sets a users password, the history policy will be ignored
7 TROUBLESHOOTING
7.1 DETERMINING THE OPERATIONAL STATUS OF A SILKWORM PRODUCT
Command
nsallshow nsshow portlogdump switchshow porterrshow cfgshow portflagsshow fcping
Description
Displays the 24-bit addresses for all devices in the fabric Displays contents of the local Name Server Display the switch port log Validates a device has logged in to the fabric Displays a port error summary Displays the current zoning configuration Shows the port status and initialization Sends a Fibre Channel ELS Echo request to a pair of ports
Command
urouteshow islshow trunkdebug topologyshow aptpolicy
Description
Displays routing information for a port Displays current connections and status of ISLs Debugs failures in trunks Display fabric topology as it appears to the local switch View or set the switch routing policy
NOTES ABOUT FICON FICON is a high-speed mainframe interface Configurable as a single-switch or cascaded fabric Cascaded fabrics require a Secure Fabric OS license and digital certificates from Brocades CA Allows for port swapping o Redirects resources from a failed port to a healthy port without changing the FICON host configuration using the portswap command It uses Insistent Domain IDs (IDID) o Switch insists on a specific Domain ID which guarantees it operates only with its preassigned Domain ID
2006 Brocade Communications Systems, Incorporated. Page 33 of 40
Description
Displays routes through the Router backbone fabric Displays physical devices configured to be exported to another fabric Display Routers that exist in a backbone fabric Display available resources on the Router Display devices presented by Router EX_Ports
Description
-s source_ip Specifies the IP interface issuing the ping -d dest_ip Specifies the IP interface receiving the ping
GUARANTEEING IN-ORDER FRAME DELIVERY Set the routing policy to port-based Turn on in-order delivery Turn off dynamic load sharing
Description
Set/clear a trace trigger on a specific error message Enable an immediate trace dump to be retrieved from the switch to the FTP site; configured in supportftp Set/clear auto-FTP parameters, and/or check connectivity to the FTP server Display available resources on the Router Display devices presented by Router EX_Ports Captures the contents of supportshow, as well as all of the system RASLOG, TRACE, core, FFDC and other files; for Directors run on both CPs
PROBLEM ESCALATION NOTES When escalating a problem to a support provider, include the following: o A very detailed description of the problem citing specific information o Capture the error log, port details, and the switch configuration o Gather the historic record of the current and past state of the switch (trace dump) o Identify vital information important in problem determination Collect this information by running the supportsave command o o o o o o All supportshow groups are included in capture RASLog output includes external and internal messages Most recent trace dump file is included First-Failure-Data-Capture (FFDC) files are captured Out-Of-Memory (OOM) information is also captured When relevant, FR4-18i blade data is included
SAN HEALTH NOTES SAN Health is a free utility that helps you create: o Comprehensive Documentation o Historical Performance Graphs o Detailed Topology Diagrams o Best Practice Recommendations SAN Health may be run against: o Brocade systems running any version of Fabric OS or XPath OS o McDATA systems running EOS 4.x and higher
After the Introduction Screen, once you click on Next, you will see the non-disclosure agreement:
Once you agree to the non-disclosure terms, the timed exam will begin. This is a sample of how the questions will look. In this example, you see a multiple-choice question.
This is a sample of the score sheet you will see at the end of the exam. You also see the breakdown of how many questions there are in each section of the exam. A hard copy of this will be printed at the testing center. It is vital that you obtain and save this hard copy as proof and validation.