This package contains Mpi applications and packages for testing and 
evaluation.



NOTE TO RPM USERS
-------------------------------------------------------------------
If you have installed the opa-fastfabric package through your distro
you likely only have a subset of the applications required for full
testing. Certain run scripts, builds, and functionality will be 
limited. To enable full functionality, the opa-mpi-apps package
must be installed. This package is available from Intel and contained
in Intel Fabric Suite (IFS). 


MPICH_PREFIX ENVIRONMENT VARIABLE:
----------------------------------

By default, Make will build these programs with the MPI installed in
 /usr/mpi/gcc/openmpi* 

You can override this by setting MPICH_PREFIX in your .bashrc file. For
example, the following will use Intel MPI:

export MPICH_PREFIX=/opt/intel/impi_latest/intel64


USING THESE TOOLS WITH MPI-SELECTOR:
------------------------------------

In OFED (and IFS), the normal method of selecting an MPI is to
use the mpi-selector commands (type "man mpi-selector-menu" and "man
mpi-selector" for details on those commmands).

To use mpi-selector with these scripts, add this line to your .bashrc
file:

source /usr/src/opa/mpi_apps/get_selected_mpi.sh



COMPILING THE TEST PROGRAMS:
----------------------------

The top level Makefile will build all the applications and benchmarks,
using the default (described above) or the value of MPICH_PREFIX (also
described above).

Some useful make targets include:

	clean	- remove all binaries. Useful when changing MPIs.
	all 	- will build everything, including NPB.
	quick	- builds only bandwidth, latency, pmb and xhpl.



RUNNING THE TEST PROGRAMS:
--------------------------

A top level "run" script is provided to run all the applications as a
regression test. Other scripts will run individual benchmarks. These
scripts assume the existence of a local "mpi_hosts" file [alternate name can be
exported in MPI_HOSTS if desired] (in mpirun mode)
and that mpd is already running (if you're using mvapich2). For example,
to run the bandwith test, simply type:

# ./run_bw

The scripts log the output of the MPI programs to the 
/usr/src/opa/mpi_apps/logs directory.



TUNING THE TEST PROGRAMS:
-------------------------

MVAPICH, MVAPICH2 and OpenMPI are all extremely tunable, and a complete
discussion of all their settings is far beyond the scope of this document.
However, these scripts to provide examples of tuning the different MPIs
as a way to get started.

When using IFS, you can tune any of the MPIs. See the files
mvapich2.params and openmpi.params for details.
Each file describes the syntax of the parameter file, provides a link to
online documentation on how to tune that MPI and several sample parameters.