Emulex Troubleshooting
Emulex Troubleshooting
Emulex Troubleshooting
Maintenance Manual
for Emulex HBAs
Copyright© 2007 Emulex Corporation. All rights reserved worldwide. No part of this document may be reproduced
by any means nor translated to any electronic medium without the written consent of Emulex Corporation.
Information furnished by Emulex Corporation is believed to be accurate and reliable. However, no responsibility is
assumed by Emulex Corporation for its use; or for any infringements of patents or other rights of third parties which
may result from its use. No license is granted by implication or otherwise under any patent or patent rights of Emulex
Corporation.
Emulex, AutoPilot Installer, BlockGuard, cLAN, FabricStream, FibreSpy, Giganet, HBAnyware, InSpeed, IntraLink,
LightPulse, MultiPulse, SAN Insite, SBOD and Vixel are registered trademarks, and AutoPilot Manager, EZPilot,
SLI and VMPilot are trademarks, of Emulex Corporation. All other brand or product names referenced herein are
trademarks or registered trademarks of their respective companies or organizations.
Emulex provides this manual "as is" without any warranty of any kind, either expressed or implied, including but not
limited to the implied warranties of merchantability or fitness for a particular purpose. Emulex Corporation may
make improvements and changes to the product described in this manual at any time and without any notice. Emulex
Corporation assumes no responsibility for its use, nor for any infringements of patents or other rights of third parties
that may result. Periodic changes are made to information contained herein; although these changes will be
incorporated into new editions of this manual, Emulex Corporation disclaims any undertaking to give notice of such
changes.
Common Problems
Hardware Issues
Any of the following symptoms indicate that you may need to return your HBA to Emulex for repair:
• Host system (server) does not pass power-on self test (POST).
• The server does not boot.
• LEDs on the HBA stop flashing or flash an error code.
• The bus has incorrect power.
• Hardware errors are logged in the event log or message file.
• Onboard parity errors.
• Peripheral Component Interconnect (PCI) parity errors.
• Firmware “traps”.
• A physical Fibre Channel (FC) interface problem looks similar to a bad cable but follows the
HBA.
• A high error count is reported by the HBAnyware utility Statistics tab.
• CRC errors, frames out of order, bad frames (replacing the cable may provide a quick fix
to these types of problems)
• Bad HBA optics
See “Product Repair and Return” on page 9 for information on returning your HBA for repair.
Link Down
Any of these symptoms may indicate the cause of a link down:
• Firmware operation and port activity indicate that the link is down.
LEDs are visible through openings in the HBA’s mounting bracket and indicate the conditions
and results of the POST function. A link-down is indicated when the green LED flashes and the
yellow LED is off (see Table 1 on page 6).
• If the HBA has a power LED, the power LED indicates that power is off.
Some HBA models have a separate green 3.3V power indicator LED (see page 6).
• Topology and link speed are improperly matched for the HBA and the devices connected to it.
Firmware Updates
You can download the latest Emulex firmware from the Emulex Web site. Click the Drivers, Downloads
and Documentation link to navigate to the Support page. On the Support page, click the link for your
HBA model. A page appears with downloads for firmware, boot code and drivers. Download the
firmware, and then use the HBAnyware utility or a driver-specific utility to update the firmware on the
HBA.
LED Reference
Table 1: LED Reference Table
4-Gb HBAs:
1 blink On 1-Gb link rate - normal, link up
2 blinks On 2-Gb link rate - normal, link up
3 blinks On 4-Gb link rate - normal, link up
2-Gb HBAs:
Slow blink On 1-Gb link rate - normal, link up
Fast blink On 2-Gb link rate - normal, link up
Fast blink Slow blink Restricted offline mode (waiting for restart)
Emulex Knowledgebase
The searchable Emulex knowledgebase is an on-going effort to provide you with answers to questions
regarding all facets of Emulex products. Information is provided for older (legacy) products as well as for
current products. Knowledgebase topics are stored by knowledgebase solution ID (solution number). A
link to the Emulex knowledgebase is available from the Support page.
Search for information using the knowledgebase:
• By a word or phrase:
• Conduct a general search by entering one word (such as “Storport”) in the Keywords
field or by entering multiple words and choosing Any as the match method.
• Conduct a specific search by entering multiple words and choosing All as the match
method.
• By the solution ID:
• Enter a 1-5 digit solution ID in the Solution ID field (you must know the solution ID to
conduct this search).
Note: Model and serial numbers are located on bar code labels on the product
itself. Record the information from the bar code label and not the packaging.
The HBAnyware utility contains five basic elements: the menu bar, the toolbar, the discovery-tree, the
property tabs and the status bar (see “HBAnyware Window Element Definitions” on page 12).
The element that you select in the discovery-tree determines whether a menu item or toolbar icon is
active. For example, if you select the local host or other system host, the Reset Adapter item on the
Adapter menu becomes unavailable. The Reset Adapter toolbar button becomes unavailable as well.
The Toolbar
The toolbar contains buttons that enable you to refresh the discovery-tree, reset the selected HBA and
sort the discovery-tree. The toolbar is visible by default. Many of the toolbar functions are also available
from the menu bar.
Use the Toolbar item in the View menu to hide/view the toolbar. If the menu item is checked, the toolbar
is visible.
Help
Discovery-Tree
The discovery-tree (left pane) shows icons that represent discovered network SAN elements (local host
name, system host names and all HBAs active on each host). Targets and LUNs, when present, are also
displayed.
Discovery-Tree Icons
Discovery-tree icons represent the following:
A gray HBA icon with red descriptive text represents an HBA that is offline or otherwise temporarily
inaccessible. Several situations could cause an offline or inaccessible HBA:
• The HBA on a local host is not connected to the network, but is still available for local access.
• The HBA on a local host has malfunctioned and is inaccessible to the local host as well as the
network.
• The HBA on a local host is busy performing a local download and therefore temporarily
inaccessible to the local host as well as the network.
Property Tabs
The property tabs display configuration, statistical and status information for network elements. The set
of available tabs is context-sensitive, depending on the type of network element or HBA currently
selected in the discovery-tree.
Status Bar
As you navigate through the menu bar or the toolbar, help messages appear on the status bar near the
bottom of the HBAnyware window.
The status bar is visible by default. Use the Status Bar item in the View menu to hide the status bar. If
checked, the status bar is visible.
Management Mode
The management mode determines whether you can manage HBAs on the host. If you cannot manage
HBAs from the host, the host has restricted access. See the driver user manual for more information on
setting and changing the management mode.
Note: Before you start the Security Configurator, you must make sure that all of the systems
that are part of, or will be part of, the security configuration are online on the FC network
so that they receive updates or changes made to the security configuration.
Any system already part of the security installation might not run with the proper security
attributes if updates to the security configuration are made while it is offline. Any system
that is part of the security installation and that is offline when the Security Configurator
starts will not be available for security configuration changes even if it is brought online
while the Security Configurator is running.
Firmware Buttons
• Update Firmware - click to open the HBAnyware utility Firmware Download dialog box and
update firmware. Using the HBAnyware Firmware Download dialog box, browse to the file you
wish to download and download the file.
• Enable/Disable - click to enable or disable the boot code.
All functions are supported locally and remotely, except for the dump feature which is only supported
locally.
Running POST
A POST is a firmware test normally performed on an HBA after a reset or restart. A POST does not
require any configuration to run.
To run a POST:
1. Start HBAnyware.
2. From the discovery-tree, select the HBA on which you wish to run a POST.
3. Select the Diagnostics tab and click Power-on Self Test (POST). A warning dialog box appears
(see Figure 11).
4. Click OK. A POST Test window shows POST test information.
Note: The beaconing buttons are disabled if the selected HBA does not support
beaconing.
To enable/disable beaconing:
1. Start HBAnyware.
2. From the discovery-tree, select the HBA whose LEDs you wish to set.
3. Select the Diagnostics tab and click Beacon On or Beacon Off.
Note: The Diagnostic Dump feature is only supported for local HBAs. If a remote
HBA is selected from the tree-view, the Initiate Diagnostic Dump is disabled.
Figure 14: HBAnyware Utility, PCI Registers and Wakeup Parameters Area of the Diagnostics Tab
Note: You cannot run the External Loopback test and ECHO test concurrently. If you select
External Loopback the ECHO test section is disabled and vice versa.
You can specify the number of test cycles by clicking one of the cycle counts values in the Test Cycles
section of the dialog box or enter a custom cycle count if you wish. The Test Status section displays how
many cycles of each test ran. The Error Action section of the dialog box enables you to define what
should be done in the event of a test failure.
Note: You must insert a loopback plug in the selected HBA before running an
External Loopback test.
Figure 17: HBAnyware Utility, Advanced Diagnostic Tests Warning for External Loopback
6. Click OK. The progress bar indicates that the test is running.
Periodic test feedback, consisting of the current loopback test/cycle plus the completion status
of each type of test, is displayed in the Test Log section of the dialog box. Click Clear to erase
the contents of the log display or click Save to File to save the log file.
You cannot run the ECHO test and the External Loopback test concurrently. If you
select the ECHO Test the External Loopback test is disabled.
Driver-specific Tools
In addition to the HBAnyware utility, Emulex provides Windows-specific and UNIX-specific utilities.
Windows-specific Tools
• The lputilnt utility is provided for the SCSIport Miniport and the Storport Miniport drivers. Use
lputilnt to identify problems on the local HBA only. See the driver user manual for more
information on lputilnt.
• The elxcfg utility is provided for the FC Port driver. Use elxcfg to identify problems on the local
HBA only. See the driver user manual for more information on elxcfg.
• Error and event logs (see page 96).
• Registry dump (see the driver user manual for parameter descriptions).
• The FC Information Tool (FCINFO, or FCIT) is available directly from Microsoft and runs only on
x86 platforms. FCINFO is a tool used to discover SAN resources and configuration information
on the FC SAN. To download this tool, access the Microsoft Web site and search for “fcinfo” on
the Downloads page. This tool provides local information such as:
• List of HBA WWNs.
• Versions of installed firmware/driver.
• List of discovered targets.
• Statistics about installed HBAs.
The following Emulex drivers are compatible with FCINFO:
• Storport Miniport driver, version 1.03 (or later)
• SCSIport Miniport driver, version 5.10a10 (or later)
Linux-specific Tools
Use Linux-specific tools to do the following:
• Boot from SAN with Linux and Emulex HBAs.
• Access the No-Reboot Dynamic Target/LUN Discovery Tool.
• Access the System Grab Diagnostic Tool.
• Re-insert an offline device (lun_change_state.sh).
• Adjust time-out for array behavior (set_target_timeout.sh).
See the driver user manual for more information on Linux-specific tools. Also, see the Linux tools, which
are available from the Linux page in the Support section of the Emulex Web site.
.
Prerequisites:
• The Offline Utility on a bootable media with MS-DOS or FreeDOS.
Hardware Compatibility
The Offline Utility supports:
• All current Emulex HBAs
• Up to 12 HBAs on one system
• To start the Offline Utility with a script file name, from the directory where the
DOSLPCFG.exe file resides, type:
doslpcfg @<script file name>
• Example of starting the Offline Utility with script1.txt in the c:\test directory:
doslpcfg @C:\test\script1.txt
Note: To redirect screen output to a file, add >filename at the end of each command.
Example:
DOSLPCFG listboot n=1 >result.out
Note: For more information on script files, See “Creating Script Files” on page 39 and
“Script File Commands” on page 39.
Model: LP250048-900
Serial Number: 0003
Port Number:
Model Description:
EMULEX LIGHTPULSE LP250048-900 2 GIGABIT PCI FC ADAPTER
Program Type:
T2: 0xB2, 0xB8, T3: 0xB1, 0xB2, 0xB3, 0xB5, 0xB6, 0xB7, T6: 0xB2, T7: 0xB2
where the Config IEEE is the original IEEE address from manufacturing, obtained from Configu-
ration Region 16 or 32. The Non-Volatile WWPN and WWNN are the port name and node name
(respectively) you have written using the scriptWWPN and scriptWWNN commands (respec-
tively) or the WWNN command.
Viewing PCI I/O Base Addresses of all HBAs in the System - listIOBase
This command lists the PCI I/O base addresses of all HBAs present. If the system does not have any
Emulex HBAs installed, error code 45 is returned.
• To list PCI I/O base addresses, type:
doslpcfg listIoBase
• Sample response:
adapter 1: 00001800
adapter 2: 00002000
adapter 3: 00001000
adapter 4: 00001400
adapter 5: 00001600
adapter 6: 00001300
The following example downloads the hd100a4.all firmware file to all LP9802 HBAs:
doslpcfg download a=lp9802 i=c:\image\hd100a4.all
• To download a firmware image file to an HBA specified by its number, type:
doslpcfg download n=<adapter number> i=<firmware image filename>
The following example downloads the 1.70a3 BootBIOS file to HBA # 6; in this example, the x86
BootBIOS file is for an LP982 HBA:
doslpcfg download n=6 i=lb170a3.prg
• To set up one or more alternate boot devices, type (all on one line):
doslpcfg setAltBoot n=<adapter number> i=<index> w0=<WWPN word 0>
w1=<WWPN word 1> l=<Decimal ID of LUN>
Note: The command for specifying the LUN is a lower- or upper-case L.
• The following example set the alternate boot device on HBA #1, LUN #3:
doslpcfg setAltBoot n=1 i=1 w0=12345678 w1=a842b6 1=3
Setting the HBA to Use Soft Jumpers or the Hardware Default - jumper
This command allows you to select the default PCI configuration or alternate configurations. Selections
are 0 for none, 1 for hardware default or 2 for soft jumper. Alternate regions are 6 or 7 (used only for
selection 2, soft jumper).
• To set soft jumpers or the hardware default, type (all on one line):
doslpcfg jumper n=<adapter number> s=<selection> r=<alternate
region>
• The following example sets up HBA #5 to use soft jumpers in region 7:
doslpcfg jumper n=5 s=2 r=7
• The following example selects the default PCI configuration for HBA #4:
doslpcfg jumper n=4 s=1
Updating Configuration Regions - config
To update configuration regions, those configuration regions must be initialized prior to running the
config command. Valid region numbers range from 0 to 32.
HBA name is the one that appears in when you run the listHBA command.
• To update a specified configuration region with all HBAs of the same selected name with
contents from a selected configuration file, type (all on one line):
doslpcfg config a=<adapter name> r=<region number> l=<byte length>
c=<configuration filename>
Note: The adapter name is the name that appears when you run the listHBA command. For
more information on the listHBA command, see .“Viewing all HBAs in the System -
listhba” on page 31.
The command for specifying byte length is a lower- or upper-case Byte length is in
decimal format.
The following example updates region 6 of all LP9000 HBAs with ctplus1.cfl.
doslpcfg config a=lp9000 r=6 l=68 c=ctplus1.cfl
The following example updates region 17of all ABC24-FC56 HBAs with d:\dfplus1.cfl.\:
doslpcfg config a=ABC24-FC56 r=17 l=100 c=d:\dfplus1.cfl
• To update a specified configuration region of only one HBA specified by its number with contents
from a selected configuration file, type (all on one line):
doslpcfg config n=<adapter number> r=<region number> l=<byte
length> c=<configuration filename>
The following example updates region 17 of HBA number 4 with heplus1.cf1:
doslpcfg config n=4 r=17 l=100 c=heplus1.cfl
The following example updates region 6 of HBA number 2 with d:\dfplus1.cf1:
doslpcfg config n=2 r=6 l=68 c=d:\dfplus1.cfl
• To repeat the series of commands in the script file, add the following as the last line of the file:
repeat r=<repeat count>
• The following example repeats the series of commands in the script file 10 times.
repeat r=10
Enabling or Disabling Test Messages on the Screen - screendisplay
This command enables or disables test messages from being displayed on the screen. o=1 enables
message to appear on the screen, o=0 prevents messages from appearing on the screen.
• To enable or disable test message displays, type:
doslpcfg screendisplay o=<display option>
To read WWNN words 0 and 1 from the command line, type (all in one line):
scriptWWNN n=<adapter number> w0=<WWNN word 0> w1=<WWNN word 1>
• The following example updates NVPARMS WWNN word 0 and word 1 for HBA #1:
scriptWWNN n=1 w0=40A2D6B8 w1=B620A1B2
Updating NVPARMS - scriptWWPN
This command reads the WWPN words 0 and 1 from the command line to update the NVPARMS. This
command can also be executed from a script file. The new WWPN value will be used when the HBA is
discovered, not the original IEEE address assigned by manufacturing in Configuration Region 16 (or
32)..
Note: Use the scriptWWPN command with caution. Do not use the same WWPN on more
than one HBA in a fabric or unpredictable results may occur.
To read WWPN words 0 and 1 from the command line, type (all in one line):
scriptWWPN n=<adapter number> w0=<WWPN word 0> w1=<WWPN word 1>
• The following example updates NVPARMS WWPN word 0 word 1 for HBA #1:
scriptWWPN n=1 w0=40A2D6B8 w1=C920A1B2
Creating a logfile - logfile
This command is valid only in a script file. This command creates a log file with a specified directory and
file name. The default log file is lpcfglog.txt and is created in the system’s current directory."
• To create a log file use the following command as the first command in your script file, type:
logfile l=<filename>
• The following example creates a file called hplplog.txt in the d:\ directory:
logfile 1=d:\log\hplplog.txt
Note: The command for creating a logfile is a lower- or upper-case L.
Results of all commands are recorded in a log file. Unless otherwise specified by the logfile command,
the default log file is lpcfglog.txt in the current directory.
0 No error
1 Invalid adapter number
2 Mailbox command error
3 No valid boot code found
4 Open file error
5 Invalid configuration region
6 Invalid adapter name
7 Download error
8 Invalid boot code index
9 Link not up for external loopback test
10 Link not up for internal loopback test
11 Invalid jumper selection (in jumper command)
12 Invalid alternate configuration region (in jumper command)
13 PCI loopback test fails
14 Adapter reset error
15 Read configuration region error
16 No VPD information available
17 No command in command line
18 Open log file error
19 Read wakeup parameters error
20 Update wakeup parameters error
21 Incorrect test parameters
22 Stopped by user
23 Internal loopback test fails
24 External loopback test fails
25 Error exists after four retries
26 Invalid command
27 Incorrect syntax
28 Command supported only in script file
29 Read_rev error
30 Dump configuration region error
31 Read file error
32 Short file error
33 Read NVPARMS error
Start lp6dutil
Note: You cannot start lp6dutil at the DOS prompt in Windows.
An Introduction screen is displayed. A menu bar is near the top and the lp> is prompt near the bottom of
the screen.
Navigation Tips
• To move from box to box (area to area) within a screen, tab to move to the right, or hold down
<Shift> and tab to move to the left. If the box title has a highlighted letter, hold down <Alt> and
press the letter to move into the box.
• To move through items within a box or area, press the up and down arrow keys.
• ( ) round brackets next to an item indicate that one choice must be selected. There is
typically a default option selected. Press the up and down arrow keys to move through
choices and select a different choice.
• [ ] square brackets near or next to an item indicate an optional choice. Tab to the item
list. Press the spacebar to select or clear an item. Sometimes optional choices are not
active unless a specific required choice is selected.
• Boxes within various screens may contain a vertical scroll bar on the right side of the box. This
indicates that the box contains additional information that exceeds the display capabilities of the
box. Click on the scroll bar to view additional information or selections.
Note: Press <Enter> after selecting an item in a screen. If you do not press
<Enter>, the selection is not made.
or
• The syntax requires one space between the command name and the first argument, and a
space between additional arguments.
• There is no space before or after the equal sign within an argument.
• To exit lp6dutil, type:
exit
The DOS prompt is displayed.
enableboot enableboot <n=adapter> <i=index> Enables the selected boot code on the HBA
specified by its number.
logfile logfile <l=filename> Creates a log file using the specified file
name.
jumper jumper <n=adapter> Changes the state of the HBA soft jumpers,
<s=selection> <r=region> which can be used in place of the physical
jumpers on the HBA. s=0 for none, 1 for
hardware default, 2 for soft jumper. Alternate
regions, r= 6 or r=7 (used only for selection 2,
soft jumper).
pciloopback pciloopback <n=adapter/all> <r=repeat- Runs the pciloopback test. You can run this
count> <o=option> test on one HBA or on all HBAs in the system.
Options: o=1 for stop, o=2 for repeat, and o=3
for ignore.
disableboot disableboot <n=adapter> Disables the current boot code on the HBA
specified by its number.
extloopback extloopback <n=adapter/all> <r=repeat- Runs the external loopback test. The
count> <o=option> loopback plug must be installed. You can run
this test on one HBA or on all HBAs in the
system. Options: o=1 for stop, o=2 for repeat,
and o=3 for ignore.
listhba listhba Lists the HBAs that are installed in the system
(HBA #, WWN, functional FW, HBA type and
mailbox error (if any).
reset reset <n=adapter/all> <s=custom/ Resets one or all adapters in the system. s=1
standard reset> skips POST during a restart, s=0 performs a
standard reset.
download download <a=adapter name> Downloads the specified firmware image to all
<i=firmware image filename> HBAs of the same name.
download download <n=adapter number> Downloads the specified firmware image file
<i=firmware image filename> to the one HBA, as specified by its number.
help help <command> Lists the syntax for the specified command.
listboot listboot <n=adapter> Lists boot code versions with indexes (base 1)
that are currently loaded in the flash of the
HBA specified by its number.
vpd vpd n=<adapter number> This command displays the VPD contents of
the adapter specified by its number.
View Mailbox
1. Select the Debug menu.
Select an HBA in the Adapters box. Register information is displayed in the Registers box.
• Host attention corresponds to 31 bits that describe information that the HBA provides to the
host. In Figure 54 the HBA informs the host when a current mailbox command is finished.
• Chip attention (also known as port attention) corresponds to how the utility gets the HBA's
attention. For the example, the utility informs the HBA when a pending Mailbox Attention
command has an error.
• Host status corresponds to errors and events.
• Host control corresponds to the driver utility.
3. Select OK to close the screen.
The most recent test results are displayed at the bottom of the screen. Use the up and down
arrows on your keyboard to scroll through the test results.
Configure Tests
Note: Internal loopback and SRAM tests are not supported for the LP1005DC-CM2 HBA.
Start Tests
1. After you have configured the tests, select Start Tests from the Test menu.
Debug Tasks
Dump Memory
1. Select the Debug menu.
Run Program
The Run Program screen allows you to run firmware test programs, if the firmware test images have
been downloaded. The test results are also displayed in this screen.
1. Select the Debug menu.
Run Diagnostics
• Four standard tests can be run using the Test menu (see “Run Diagnostics” on page 72). The
Run Diags screen allows you to run customized tests that must be downloaded to the HBA.
Instructions for creating customized tests are beyond the scope of this manual.
• To download customized tests, use the same procedure for downloading other files and images
(see “Load and Update Firmware, Test and Boot Code Files” on page 60).
The Run Diags screen allows you to run up to five tests at one time.
console-notices 0 Sets the verbose level for log-only (when set to 0, log
driver notices to the messages are logged to the
console. system log file and also printed on
the console.)
console-warnings 0 Sets the verbose level for
driver warnings to the Default = Disabled
console.
log-notices 0xffffffff; Sets the verbose level for log-verbose (when set to non-zero,
driver notices to the system verbose messages are generated.)
log file.
Default = Disabled
log-warnings 0xffffffff; Sets the verbose level for
driver warnings to the
system log file.
PANIC (Severe) Message indicates that the driver has forced a system panic to occur.
Driver Events
SLI Events
Mailbox Events
Node Events
Link Events
ELS Events
IP Traffic Events
IOCTL Events