.\" Man page generated from reStructuredText.

.

.TH INFINIBAND-DIAGS 8 "@BUILD_DATE@" "" "Open IB Diagnostics"

.SH NAME

infiniband-diags \- Diagnostics for InfiniBand Fabrics

.

.nr rst2man-indent-level 0

.

.de1 rstReportMargin

\\$1 \\n[an-margin]

level \\n[rst2man-indent-level]

level margin: \\n[rst2man-indent\\n[rst2man-indent-level]]

-

\\n[rst2man-indent0]

\\n[rst2man-indent1]

\\n[rst2man-indent2]

..

.de1 INDENT

.\" .rstReportMargin pre:

. RS \\$1

. nr rst2man-indent\\n[rst2man-indent-level] \\n[an-margin]

. nr rst2man-indent-level +1

.\" .rstReportMargin post:

..

.de UNINDENT

. RE

.\" indent \\n[an-margin]

.\" old: \\n[rst2man-indent\\n[rst2man-indent-level]]

.nr rst2man-indent-level -1

.\" new: \\n[rst2man-indent\\n[rst2man-indent-level]]

.in \\n[rst2man-indent\\n[rst2man-indent-level]]u

..

.SH DESCRIPTION

.sp

infiniband\-diags is a set of utilities designed to help configure, debug, and

maintain infiniband fabrics.  Many tools and utilities are provided.  Some with

similar functionality.

.sp

The base utilities use directed route MAD\(aqs to perform their operations.  They

may therefore work even in unconfigured subnets.  Other, higher level

utilities, require LID routed MAD\(aqs and to some extent SA/SM access.

.SH THE USE OF SMPS (QP0)

.sp

Many of the tools in this package rely on the use of SMPs via QP0 to acquire

data directly from the SMA.  While this mode of operation is not technically in

compliance with the InfiniBand specification, practical experience has found

that this level of diagnostics is valuable when working with a fabric which is

broken or only partially configured.  For this reason many of these tools may

require the use of an MKey or operation from Virtual Machines may be restricted

for security reasons.

.SH COMMON OPTIONS

.sp

Most OpenIB diagnostics take some of the following common flags. The exact list

of supported flags per utility can be found in the documentation for those

commands.

.SS Addressing Flags

.sp

The \-D and \-G option have two forms:

.\" Define the common option -D for Directed routes

.

.sp

\fB\-D, \-\-Direct\fP     The address specified is a directed route

.INDENT 0.0

.INDENT 3.5

.sp

.nf

.ft C

Examples:

   [options] \-D [options] "0"          # self port

   [options] \-D [options] "0,1,2,1,4"  # out via port 1, then 2, ...

   (Note the second number in the path specified must match the port being

   used.  This can be specified using the port selection flag \(aq\-P\(aq or the

   port found through the automatic selection process.)

.ft P

.fi

.UNINDENT

.UNINDENT

.\" Define the common option -D for Directed routes

.

.sp

\fB\-D, \-\-Direct <dr_path>\fP     The address specified is a directed route

.INDENT 0.0

.INDENT 3.5

.sp

.nf

.ft C

Examples:

   \-D "0"          # self port

   \-D "0,1,2,1,4"  # out via port 1, then 2, ...

   (Note the second number in the path specified must match the port being

   used.  This can be specified using the port selection flag \(aq\-P\(aq or the

   port found through the automatic selection process.)

.ft P

.fi

.UNINDENT

.UNINDENT

.\" Define the common option -G

.

.sp

\fB\-G, \-\-Guid\fP     The address specified is a Port GUID

.\" Define the common option -G

.

.sp

\fB\-\-port\-guid, \-G <port_guid>\fP  Specify a port_guid

.\" Define the common option -L

.

.sp

\fB\-L, \-\-Lid\fP   The address specified is a LID

.\" Define the common option -s

.

.sp

\fB\-s, \-\-sm_port <smlid>\fP     use \(aqsmlid\(aq as the target lid for SA queries.

.SS Port Selection flags

.\" Define the common option -C

.

.sp

\fB\-C, \-\-Ca <ca_name>\fP    use the specified ca_name.

.\" Define the common option -P

.

.sp

\fB\-P, \-\-Port <ca_port>\fP    use the specified ca_port.

.\" Explanation of local port selection

.

.SS Local port Selection

.sp

Multiple port/Multiple CA support: when no IB device or port is specified

(see the "local umad parameters" below), the libibumad library

selects the port to use by the following criteria:

.INDENT 0.0

.INDENT 3.5

.INDENT 0.0

.IP 1. 3

the first port that is ACTIVE.

.IP 2. 3

if not found, the first port that is UP (physical link up).

.UNINDENT

.sp

If a port and/or CA name is specified, the libibumad library attempts

to fulfill the user request, and will fail if it is not possible.

.sp

For example:

.INDENT 0.0

.INDENT 3.5

.sp

.nf

.ft C

ibaddr                 # use the first port (criteria #1 above)

ibaddr \-C mthca1       # pick the best port from "mthca1" only.

ibaddr \-P 2            # use the second (active/up) port from the first available IB device.

ibaddr \-C mthca0 \-P 2  # use the specified port only.

.ft P

.fi

.UNINDENT

.UNINDENT

.UNINDENT

.UNINDENT

.SS Debugging flags

.\" Define the common option -d

.

.INDENT 0.0

.TP

.B \-d

raise the IB debugging level.

May be used several times (\-ddd or \-d \-d \-d).

.UNINDENT

.\" Define the common option -e

.

.INDENT 0.0

.TP

.B \-e

show send and receive errors (timeouts and others)

.UNINDENT

.\" Define the common option -h

.

.sp

\fB\-h, \-\-help\fP      show the usage message

.\" Define the common option -v

.

.INDENT 0.0

.TP

.B \fB\-v, \-\-verbose\fP

increase the application verbosity level.

May be used several times (\-vv or \-v \-v \-v)

.UNINDENT

.\" Define the common option -V

.

.sp

\fB\-V, \-\-version\fP     show the version info.

.SS Configuration flags

.\" Define the common option -t

.

.sp

\fB\-t, \-\-timeout <timeout_ms>\fP override the default timeout for the solicited mads.

.\" Define the common option -z

.

.INDENT 0.0

.TP

.B \fB\-\-outstanding_smps, \-o <val>\fP

Specify the number of outstanding SMP\(aqs which should be issued during the scan

.sp

Default: 2

.UNINDENT

.\" Define the common option --node-name-map

.

.sp

\fB\-\-node\-name\-map <node\-name\-map>\fP Specify a node name map.

.INDENT 0.0

.INDENT 3.5

This file maps GUIDs to more user friendly names.  See FILES section.

.UNINDENT

.UNINDENT

.\" Define the common option -z

.

.sp

\fB\-\-config, \-z  <config_file>\fP Specify alternate config file.

.INDENT 0.0

.INDENT 3.5

Default: @IBDIAG_CONFIG_PATH@/ibdiag.conf

.UNINDENT

.UNINDENT

.SH COMMON FILES

.sp

The following config files are common amongst many of the utilities.

.\" Common text for the config file

.

.SS CONFIG FILE

.sp

@IBDIAG_CONFIG_PATH@/ibdiag.conf

.sp

A global config file is provided to set some of the common options for all

tools.  See supplied config file for details.

.\" Common text to describe the node name map file.

.

.SS NODE NAME MAP FILE FORMAT

.sp

The node name map is used to specify user friendly names for nodes in the

output.  GUIDs are used to perform the lookup.

.sp

This functionality is provided by the opensm\-libs package.  See \fBopensm(8)\fP

for the file location for your installation.

.sp

\fBGenerically:\fP

.INDENT 0.0

.INDENT 3.5

.sp

.nf

.ft C

# comment

<guid> "<name>"

.ft P

.fi

.UNINDENT

.UNINDENT

.sp

\fBExample:\fP

.INDENT 0.0

.INDENT 3.5

.sp

.nf

.ft C

# IB1

# Line cards

0x0008f104003f125c "IB1 (Rack 11 slot 1   ) ISR9288/ISR9096 Voltaire sLB\-24D"

0x0008f104003f125d "IB1 (Rack 11 slot 1   ) ISR9288/ISR9096 Voltaire sLB\-24D"

0x0008f104003f10d2 "IB1 (Rack 11 slot 2   ) ISR9288/ISR9096 Voltaire sLB\-24D"

0x0008f104003f10d3 "IB1 (Rack 11 slot 2   ) ISR9288/ISR9096 Voltaire sLB\-24D"

0x0008f104003f10bf "IB1 (Rack 11 slot 12  ) ISR9288/ISR9096 Voltaire sLB\-24D"

# Spines

0x0008f10400400e2d "IB1 (Rack 11 spine 1   ) ISR9288 Voltaire sFB\-12D"

0x0008f10400400e2e "IB1 (Rack 11 spine 1   ) ISR9288 Voltaire sFB\-12D"

0x0008f10400400e2f "IB1 (Rack 11 spine 1   ) ISR9288 Voltaire sFB\-12D"

0x0008f10400400e31 "IB1 (Rack 11 spine 2   ) ISR9288 Voltaire sFB\-12D"

0x0008f10400400e32 "IB1 (Rack 11 spine 2   ) ISR9288 Voltaire sFB\-12D"

# GUID   Node Name

0x0008f10400411a08 "SW1  (Rack  3) ISR9024 Voltaire 9024D"

0x0008f10400411a28 "SW2  (Rack  3) ISR9024 Voltaire 9024D"

0x0008f10400411a34 "SW3  (Rack  3) ISR9024 Voltaire 9024D"

0x0008f104004119d0 "SW4  (Rack  3) ISR9024 Voltaire 9024D"

.ft P

.fi

.UNINDENT

.UNINDENT

.\" Common text to describe the Topology file.

.

.SS TOPOLOGY FILE FORMAT

.sp

The topology file format is human readable and largely intuitive.

Most identifiers are given textual names like vendor ID (vendid), device ID

(device ID), GUIDs of various types (sysimgguid, caguid, switchguid, etc.).

PortGUIDs are shown in parentheses ().  For switches, this is shown on the

switchguid line.  For CA and router ports, it is shown on the connectivity

lines.  The IB node is identified followed by the number of ports and a quoted

the node GUID.  On the right of this line is a comment (#) followed by the

NodeDescription in quotes.  If the node is a switch, this line also contains

whether switch port 0 is base or enhanced, and the LID and LMC of port 0.

Subsequent lines pertaining to this node show the connectivity.   On the

left is the port number of the current node.  On the right is the peer node

(node at other end of link). It is identified in quotes with nodetype

followed by \- followed by NodeGUID with the port number in square brackets.

Further on the right is a comment (#).  What follows the comment is

dependent on the node type.  If it it a switch node, it is followed by

the NodeDescription in quotes and the LID of the peer node.  If it is a

CA or router node, it is followed by the local LID and LMC and then

followed by the NodeDescription in quotes and the LID of the peer node.

The active link width and speed are then appended to the end of this

output line.

.sp

An example of this is:

.INDENT 0.0

.INDENT 3.5

.sp

.nf

.ft C

#

# Topology file: generated on Tue Jun  5 14:15:10 2007

#

# Max of 3 hops discovered

# Initiated from node 0008f10403960558 port 0008f10403960559

Non\-Chassis Nodes

vendid=0x8f1

devid=0x5a06

sysimgguid=0x5442ba00003000

switchguid=0x5442ba00003080(5442ba00003080)

Switch  24 "S\-005442ba00003080"         # "ISR9024 Voltaire" base port 0 lid 6 lmc 0

[22]    "H\-0008f10403961354"[1](8f10403961355)         # "MT23108 InfiniHost Mellanox Technologies" lid 4 4xSDR

[10]    "S\-0008f10400410015"[1]         # "SW\-6IB4 Voltaire" lid 3 4xSDR

[8]     "H\-0008f10403960558"[2](8f1040396055a)         # "MT23108 InfiniHost Mellanox Technologies" lid 14 4xSDR

[6]     "S\-0008f10400410015"[3]         # "SW\-6IB4 Voltaire" lid 3 4xSDR

[12]    "H\-0008f10403960558"[1](8f10403960559)         # "MT23108 InfiniHost Mellanox Technologies" lid 10 4xSDR

vendid=0x8f1

devid=0x5a05

switchguid=0x8f10400410015(8f10400410015)

Switch  8 "S\-0008f10400410015"          # "SW\-6IB4 Voltaire" base port 0 lid 3 lmc 0

[6]     "H\-0008f10403960984"[1](8f10403960985)         # "MT23108 InfiniHost Mellanox Technologies" lid 16 4xSDR

[4]     "H\-005442b100004900"[1](5442b100004901)        # "MT23108 InfiniHost Mellanox Technologies" lid 12 4xSDR

[1]     "S\-005442ba00003080"[10]                # "ISR9024 Voltaire" lid 6 1xSDR

[3]     "S\-005442ba00003080"[6]         # "ISR9024 Voltaire" lid 6 4xSDR

vendid=0x2c9

devid=0x5a44

caguid=0x8f10403960984

Ca      2 "H\-0008f10403960984"          # "MT23108 InfiniHost Mellanox Technologies"

[1](8f10403960985)     "S\-0008f10400410015"[6]         # lid 16 lmc 1 "SW\-6IB4 Voltaire" lid 3 4xSDR

vendid=0x2c9

devid=0x5a44

caguid=0x5442b100004900

Ca      2 "H\-005442b100004900"          # "MT23108 InfiniHost Mellanox Technologies"

[1](5442b100004901)     "S\-0008f10400410015"[4]         # lid 12 lmc 1 "SW\-6IB4 Voltaire" lid 3 4xSDR

vendid=0x2c9

devid=0x5a44

caguid=0x8f10403961354

Ca      2 "H\-0008f10403961354"          # "MT23108 InfiniHost Mellanox Technologies"

[1](8f10403961355)     "S\-005442ba00003080"[22]                # lid 4 lmc 1 "ISR9024 Voltaire" lid 6 4xSDR

vendid=0x2c9

devid=0x5a44

caguid=0x8f10403960558

Ca      2 "H\-0008f10403960558"          # "MT23108 InfiniHost Mellanox Technologies"

[2](8f1040396055a)     "S\-005442ba00003080"[8]         # lid 14 lmc 1 "ISR9024 Voltaire" lid 6 4xSDR

[1](8f10403960559)     "S\-005442ba00003080"[12]                # lid 10 lmc 1 "ISR9024 Voltaire" lid 6 1xSDR

.ft P

.fi

.UNINDENT

.UNINDENT

.sp

When grouping is used, IB nodes are organized into chassis which are

numbered. Nodes which cannot be determined to be in a chassis are

displayed as "Non\-Chassis Nodes".  External ports are also shown on the

connectivity lines.

.SH UTILITIES LIST

.SS Basic fabric conectivity

.INDENT 0.0

.INDENT 3.5

See: ibnetdiscover, iblinkinfo

.UNINDENT

.UNINDENT

.SS Node information

.INDENT 0.0

.INDENT 3.5

See: ibnodes, ibswitches, ibhosts, ibrouters

.UNINDENT

.UNINDENT

.SS Port information

.INDENT 0.0

.INDENT 3.5

See: ibportstate, ibaddr

.UNINDENT

.UNINDENT

.SS Switch Forwarding Table info

.INDENT 0.0

.INDENT 3.5

See: ibtracert, ibroute, dump_lfts, dump_mfts, check_lft_balance, ibfindnodesusing

.UNINDENT

.UNINDENT

.SS Performance counters

.INDENT 0.0

.INDENT 3.5

See: ibqueryerrors, perfquery

.UNINDENT

.UNINDENT

.SS Local HCA info

.INDENT 0.0

.INDENT 3.5

See: ibstat, ibstatus

.UNINDENT

.UNINDENT

.SS Connectivity check

.INDENT 0.0

.INDENT 3.5

See: ibping, ibsysstat

.UNINDENT

.UNINDENT

.SS Low level query tools

.INDENT 0.0

.INDENT 3.5

See: smpquery, smpdump, saquery, sminfo

.UNINDENT

.UNINDENT

.SS Fabric verification tools

.INDENT 0.0

.INDENT 3.5

See: ibidsverify

.UNINDENT

.UNINDENT

.SH BACKWARDS COMPATIBILITY SCRIPTS

.sp

The following scripts have been identified as redundant and/or lower performing

as compared to the above scripts.  They are provided as legacy scripts when

\-\-enable\-compat\-utils is specified at build time.

.sp

ibcheckerrors, ibclearcounters, ibclearerrors, ibdatacounters

ibchecknet, ibchecknode, ibcheckport, ibcheckportstate,

ibcheckportwidth, ibcheckstate, ibcheckwidth, ibswportwatch,

ibprintca, ibprintrt, ibprintswitch, set_nodedesc.sh

.SH AUTHORS

.INDENT 0.0

.TP

.B Ira Weiny

< \fI\%ira.weiny@intel.com\fP >

.UNINDENT

.\" Generated by docutils manpage writer.

.