BlueGene

From Tau Wiki
Jump to: navigation, search

IBM Blue Gene/(L,P)

A collection of information on how to use TAU with IBM Blue Gene/L systems.

Building PDT

Configure and build PDT:

./configure -XLC
make clean install

Building TAU for the back-end

for IBM BG/P

./configure -arch=bgp -mpi -pdt=<dir> -pdt_c++=xlC
make clean install

for IBM BG/L

./configure -arch=bgl -mpi -pdt=<dir> -pdt_c++=xlC
make clean install

Building front-end tools

The binaries in <taudir>/bgl/bin are not usable on the front-end, to build tools for the front-end, use:

./configure 
make clean install

This will build and install tools (such as Paraprof, pprof) in the <taudir>/ppc64/bin directory.

Fast BGL Timers

BlueGene systems have a special clock cycle counter that can be used for low overhead timings, to use it with TAU configure with

-BGLTIMERS

A Sample Session

Following is a set of commands and their output which should work on most BlueGene systems

# aqcuire sources
wget http://www.cs.uoregon.edu/research/paracomp/proj/pdtoolkit/Download/pdt_latest.tar.gz
wget http://www.cs.uoregon.edu/research/paracomp/tau/tauprofile/dist/tau_latest.tar.gz

# build PDT
tar -xzf pdt_latest.tar.gz
cd pdtoolkit-3.10
./configure
make install
cd ..

# build front-end
tar -xzf tau_latest.tar.gz
cd tau-*
./configure
make clean install

# build back-end
./configure -arch=bgl -mpi -pdt=`pwd`/../pdtoolkit-3.10 -pdt_c++=g++
make clean install

# build and run example auto-instrumented MPI fortran 90 application
cd examples/pdt_mpi/f90
make
cqsub -t5 -n4 ./ring

# after job completes, view simple report
../../../ppc64/bin/pprof

Typescript Output:

% # aqcuire sources
% wget http://www.cs.uoregon.edu/research/paracomp/proj/pdtoolkit/Download/pdt_latest.tar.gz
--23:27:54--  http://www.cs.uoregon.edu/research/paracomp/proj/pdtoolkit/Download/pdt_latest.tar.gz
           => `pdt_latest.tar.gz'
Resolving www.cs.uoregon.edu... 128.223.4.25
Connecting to www.cs.uoregon.edu[128.223.4.25]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 110,312,097 [application/x-tar]

100%[=====================================================================================================>] 110,312,097  400.94K/s    ETA 00:00

23:32:25 (397.35 KB/s) - `pdt_latest.tar.gz' saved [110312097/110312097]

% wget http://www.cs.uoregon.edu/research/paracomp/tau/tauprofile/dist/tau_latest.tar.gz
--23:32:25--  http://www.cs.uoregon.edu/research/paracomp/tau/tauprofile/dist/tau_latest.tar.gz
           => `tau_latest.tar.gz'
Resolving www.cs.uoregon.edu... 128.223.4.25
Connecting to www.cs.uoregon.edu[128.223.4.25]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 15,381,525 [application/x-tar]

100%[=====================================================================================================>] 15,381,525   398.22K/s    ETA 00:00

23:33:03 (395.82 KB/s) - `tau_latest.tar.gz' saved [15381525/15381525]

%
% # build PDT
% tar -xzf pdt_latest.tar.gz
% cd pdtoolkit-3.10
% ./configure
Program Database Toolkit (PDT) Configuration
--------------------------------------------
Looks like a Linux machine ...
Looking for C++ compilers .. done
Unpacking ppc64/bin ...
Unpacking ppc64/bin/gfortran ...
==> ARCH is PPCLINUX
==> PLATFORM is ppc64
==> Using /usr/bin/g++
==> Default compiler options are -O2
==> Makefiles were configured
==> cparse was configured
==> cxxparse was configured
==> f90parse was configured
==> f95parse was configured
==> gfparse was configured

Configuration is complete!

Run "make" and "make install"
Add "/home/amorris/wiki/pdtoolkit-3.10/ppc64//bin" to your path
% make install
(cd ductape; make "MAKE=make" all)
make[1]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
(cd lib; make "MAKE=make" all CXX="g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    " CXXAR="ar  cr " RANLIB="echo Built libpdb.a" PRELINK="echo Building libpdb.a" EXTRAOBJS="")
make[2]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/lib'
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbRead.cc
true pdbRead.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbMisc.cc
true pdbMisc.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbItem.cc
true pdbItem.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbGroup.cc
true pdbGroup.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbClass.cc
true pdbClass.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbModule.cc
true pdbModule.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbRoutine.cc
true pdbRoutine.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbCRoutine.cc
true pdbCRoutine.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbFRoutine.cc
true pdbFRoutine.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbTemplate.cc
true pdbTemplate.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbGroupField.cc
true pdbGroupField.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbWrite.cc
true pdbWrite.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbMacro.cc
true pdbMacro.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbNamespace.cc
true pdbNamespace.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbType.cc
true pdbType.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbFile.cc
true pdbFile.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbSimpleItem.cc
true pdbSimpleItem.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbTemplateItem.cc
true pdbTemplateItem.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbFatItem.cc
true pdbFatItem.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbTemplateArg.cc
true pdbTemplateArg.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbPragma.cc
true pdbPragma.cc
echo Building libpdb.a
Building libpdb.a
ar  cr  libpdb.a pdbRead.o pdbMisc.o pdbItem.o pdbGroup.o pdbClass.o pdbModule.o pdbRoutine.o pdbCRoutine.o pdbFRoutine.o pdbTemplate.o pdbGroupField.o pdbWrite.o pdbMacro.o pdbNamespace.o pdbType.o pdbFile.o pdbSimpleItem.o pdbTemplateItem.o pdbFatItem.o pdbTemplateArg.o pdbPragma.o
echo Built libpdb.a
Built libpdb.a
make[2]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/lib'
(cd src; make "MAKE=make" all CXX="g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE    ")
make[2]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbconv.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbconv.o -o pdbconv ../lib/libpdb.a
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbtree.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbtree.o -o pdbtree ../lib/libpdb.a
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbmerge.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbmerge.o -o pdbmerge ../lib/libpdb.a
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbcomment.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbcomment.o -o pdbcomment ../lib/libpdb.a
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbstmt.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbstmt.o -o pdbstmt ../lib/libpdb.a
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c xmlgen.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc xmlgen.o -o xmlgen ../lib/libpdb.a
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE     -I../inc -c pdbhtml.cc
g++  -O2 -w -Wall -ansi -D_XOPEN_SOURCE      -I../inc pdbhtml.o -o pdbhtml ../lib/libpdb.a
make[2]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
make[1]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
/bin/rm -f /home/amorris/wiki/pdtoolkit-3.10/ppc64//lib/libpdb.a
(cd ductape; make "MAKE=make" install)
make[1]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
(cd src; make "MAKE=make" install)
make[2]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
cp pdbconv pdbtree pdbmerge pdbcomment pdbstmt xmlgen pdbhtml /home/amorris/wiki/pdtoolkit-3.10/ppc64//bin
make[2]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
make[1]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
cp ./ductape/lib/libpdb.a /home/amorris/wiki/pdtoolkit-3.10/ppc64//lib
echo "*****DONE*****"
*****DONE*****
% cd ..
%
% # build front-end
% tar -xzf tau_latest.tar.gz
% cd tau-*
% ./configure
-------------------- TAU configure script ---------------
  The TAU source code has just been configured to use the
  tau root directory /home/amorris/wiki/tau-2.16.1.
  If you move the Tau distribution, you must either
    * set an environment variable TAUROOT containing the new
      location before running any TAU tools
  or
    * run configure again and recompile
-----------------------------------------------------------------
Attempting to auto-configure system, determining architecture...
I think this is a ppc64...
-PROFILE and/or -TRACE should be specified. Choosing -PROFILE as the default
which: no xlf90 in (/home/amorris/tau2/ppc64/bin:/opt/ibmll/LoadL/full/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/bin:/usr/games:/opt/gnome/bin:/opt/kde3/bin:/usr/lib/java/bin)
Default C++ compiler will be  g++ version 3.3.3 (SuSE Linux)
Default C compiler will be  gcc version 3.3.3 (SuSE Linux)
Checking if open takes O_LARGEFILE... yes
C++ compiler supports Std Runtime Type Information (default)
Supporting GNU RTTI options
Testing for Standard C++ Library support for string class
Found support for Standard C++ Library string
NOTE: Compiling Profiling Library and Applications with -DTAU_STDCXXLIB
***********************************************************************
Using GNU lib dir as /usr/lib/gcc-lib/powerpc-suse-linux/3.3.3/
Found an IBM PPC-64 Linux configuration definition
TAU: installing TAU's ParaProf profile browser
jdk version 1.4 or better found
TAU: installed paraprof in /home/amorris/wiki/tau-2.16.1/ppc64/bin
TAU: installed ParaProf, PerfDMF, PerfExplorer and supporting jars in /home/amorris/wiki/tau-2.16.1/ppc64/lib
TAU: installed tau_compiler.sh in /home/amorris/wiki/tau-2.16.1/ppc64/bin
TAU: installed TAU's Java trace writer api tf_writer.jar
TAU: installing TAU's PerfDMF database utilities in /home/amorris/wiki/tau-2.16.1/ppc64/bin
TAU: installed tau_analyze in /home/amorris/wiki/tau-2.16.1/ppc64/bin
TAU: installed Makefile.inc in /home/amorris/wiki/tau-2.16.1/tools/src/TauIL
TAU: installed TauIL and supporting jars in /home/amorris/wiki/tau-2.16.1/ppc64/lib

TAU: installing tools in /home/amorris/wiki/tau-2.16.1/ppc64/bin
NOTE: *** IBM pSeries Linux environment found. ***
NOTE: Enabled Profiling. Compiling with -DPROFILING_ON
NOTE: IBM xlf90 compiler specific options used
NOTE: Using the O_LARGEFILE flag to open
NOTE: Using Standard C++ Library
NOTE: GNU g++ options used
Script to modify Makefiles created.
Applying script to all Makefiles, please wait, this may take a while...
...................................................................................................................

Configuring TAU Build scripts...
Modifying Makefiles in the examples subdirectory...
Platform does not support JOGL, no 3d displays will be available in ParaProf......

Configuration complete!
   Please add  /home/amorris/wiki/tau-2.16.1/ppc64/bin  to your path
   Type "make install" to begin compilation
% make clean install
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
/bin/rm -rf *.o tau_reduce pprof tau_convert tau_merge                *.dep lib*.a *.ii *.ti ti_files cxx_repository ii_files rii_files
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
/bin/rm -rf *.ii *.ti ti_files cxx_repository ii_files rii_files *.a *.o *.so
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
/bin/rm -f simple.o simple
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
/bin/rm -f cubes.o cubes
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
Determining Configuration...
System previously configured as a ppc64
*********** RECURSIVELY MAKING SUBDIRECTORIES ***********
*** COMPILING utils DIRECTORY
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c pprof.cpp
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c function_data.cpp
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c user_event_data.cpp
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   pprof.o user_event_data.o function_data.o -o pprof -lm
Installing pprof in /home/amorris/wiki/tau-2.16.1/ppc64/bin
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
/bin/cp pprof /home/amorris/wiki/tau-2.16.1/ppc64/bin
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c tau_reduce.cpp
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c pprof_elem.cpp
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   tau_reduce.o pprof_elem.o -o tau_reduce -lm
Installing tau_reduce in /home/amorris/wiki/tau-2.16.1/ppc64/bin
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
          else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
/bin/cp tau_reduce /home/amorris/wiki/tau-2.16.1/ppc64/bin
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -c  tau_merge.c
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -c tau_events.cpp
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    tau_merge.o tau_events.o -o tau_merge -lm
Installing tau_merge in /home/amorris/wiki/tau-2.16.1/ppc64/bin
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
/bin/cp tau_merge /home/amorris/wiki/tau-2.16.1/ppc64/bin
g++                   -I../include  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    tau_convert.c -o tau_convert -lm
Installing tau_convert in /home/amorris/wiki/tau-2.16.1/ppc64/bin
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
/bin/cp tau_convert /home/amorris/wiki/tau-2.16.1/ppc64/bin
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
*** COMPILING src/Profile DIRECTORY
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c Profiler.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TulipTimers.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c UserEvent.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c FunctionInfo.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c RtsLayer.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c RtsThread.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauCAPI.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauFAPI.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauMapping.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauHooks.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauHandler.cpp
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauMemory.cpp
ar               rcv  libtau-gnu.a Profiler.o TulipTimers.o UserEvent.o FunctionInfo.o RtsLayer.o RtsThread.o TauCAPI.o TauFAPI.o TauMapping.o TauHooks.o TauHandler.o TauMemory.o
a - Profiler.o
a - TulipTimers.o
a - UserEvent.o
a - FunctionInfo.o
a - RtsLayer.o
a - RtsThread.o
a - TauCAPI.o
a - TauFAPI.o
a - TauMapping.o
a - TauHooks.o
a - TauHandler.o
a - TauMemory.o
echo "Built"  libtau-gnu.a
Built libtau-gnu.a
Installing libtau-gnu.a in /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/cp libtau-gnu.a /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/cp /home/amorris/wiki/tau-2.16.1/include/Makefile /home/amorris/wiki/tau-2.16.1/ppc64/lib/Makefile.tau-gnu
g++                  -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB            -DTAU_GNU  -DTAU_DOT_H_LESS_HEADERS -fPIC                                                   -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include -c TauDisable.cpp
ar               rcv  libTauDisable.a TauDisable.o
a - TauDisable.o
echo "Built"  libTauDisable.a
Built libTauDisable.a
Installing libTauDisable.a in /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/cp libTauDisable.a /home/amorris/wiki/tau-2.16.1/ppc64/lib
g++                  -shared     -o   libTAUsh-gnu.so              Profiler.o TulipTimers.o UserEvent.o FunctionInfo.o RtsLayer.o RtsThread.o TauCAPI.o TauFAPI.o TauMapping.o TauHooks.o TauHandler.o TauMemory.o
Installing libTAUsh-gnu.so in /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/cp libTAUsh-gnu.so /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/rm -rf /home/amorris/wiki/tau-2.16.1/ppc64/lib/libTAU.so
cd /home/amorris/wiki/tau-2.16.1/ppc64/lib && ln -s libTAUsh-gnu.so                libTAU.so
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
***************** DONE ************************
%
% # build back-end
% ./configure -arch=bgl -mpi -pdt=`pwd`/../pdtoolkit-3.10 -pdt_c++=g++
-------------------- TAU configure script ---------------
  The TAU source code has just been configured to use the
  tau root directory /home/amorris/wiki/tau-2.16.1.
  If you move the Tau distribution, you must either
    * set an environment variable TAUROOT containing the new
      location before running any TAU tools
  or
    * run configure again and recompile
-----------------------------------------------------------------
WARNING!! Auto-detect:ppc64 overridden with bgl
-PROFILE and/or -TRACE should be specified. Choosing -PROFILE as the default
Default C++ compiler will be IBMs xlC C++ compiler
which: no xlf90 in (/home/amorris/tau2/ppc64/bin:/opt/ibmll/LoadL/full/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/bin:/usr/games:/opt/gnome/bin:/opt/kde3/bin:/usr/lib/java/bin)
Not using the thread-safe version of the IBM compiler
Thread-safe MPI interface is defined...
MPI-2 Interface is defined...
MPI-2 Grequest Interface is defined...
MPI-2 MPI_Datarep_conversion_function Interface is defined...
MPI-2 Comm_create_errhandler Interface is defined...
MPI-2 MPI*attr_functions are defined...
MPI-2 MPI_Type_dup and MPI_Exscan are defined...
MPI-2 MPI_Add_error* functions are defined...
MPI_Status f2c/c2f found...
NOTE: MPI library does not have a threaded _r suffix
Default C compiler will be blrts_xlc
Checking if open takes O_LARGEFILE... yes
C++ compiler supports Std Runtime Type Information (default)
Testing for Standard C++ Library support for string class
Found support for Standard C++ Library string
NOTE: Compiling Profiling Library and Applications with -DTAU_STDCXXLIB
***********************************************************************
Found an IBM PPC-64 BGL Linux configuration definition
PDT supports Fortran Loop Level information
TAU: installing TAU's ParaProf profile browser
jdk version 1.4 or better found
TAU: installed paraprof in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed ParaProf, PerfDMF, PerfExplorer and supporting jars in /home/amorris/wiki/tau-2.16.1/bgl/lib
TAU: installed tau_compiler.sh in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed tau_load.sh in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed TAU's Java trace writer api tf_writer.jar
TAU: installing TAU's PerfDMF database utilities in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed tau_analyze in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed Makefile.inc in /home/amorris/wiki/tau-2.16.1/tools/src/TauIL
TAU: installed TauIL and supporting jars in /home/amorris/wiki/tau-2.16.1/bgl/lib

TAU: installing tools in /home/amorris/wiki/tau-2.16.1/bgl/bin
NOTE: *** IBM BlueGene/L development environment found. ***
NOTE: Enabled Profiling. Compiling with -DPROFILING_ON
NOTE: Using the IBM xlC C++ compiler
NOTE: IBM xlf90 compiler specific options used
NOTE: Using the TAU MPI Profiling Interface
NOTE: Using the TAU MPI_Init_thread Profiling Interface Wrapper
NOTE: Using TAU's MPI-2 extensions
NOTE: Using TAU's MPI-2 Grequest extensions
NOTE: Using TAU's MPI-2 Datarep_conversion extensions
NOTE: Using TAU's MPI-2 Error handler extensions
NOTE: Using TAU's MPI-2 Attr extensions
NOTE: Using TAU's MPI-2 Type and Exscan extensions
NOTE: Using TAU's MPI-2 Add_error extensions
NOTE: Using default cc compiler.
NOTE: Using the O_LARGEFILE flag to open
NOTE: Using Standard C++ Library
NOTE: Using PDT for TAU Source Code Instrumentation ***
NOTE: Using a different compiler for tau_instrumentor
Script to modify Makefiles created.
Applying script to all Makefiles, please wait, this may take a while...
...................................................................................................................

Configuring TAU Build scripts...
Modifying Makefiles in the examples subdirectory...
Platform does not support JOGL, no 3d displays will be available in ParaProf..................

Configuration complete!
   Please add  /home/amorris/wiki/tau-2.16.1/bgl/bin  to your path
   Type "make install" to begin compilation
% make clean install
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
/bin/rm -rf *.o tau_reduce pprof tau_convert tau_merge      tau_instrumentor           *.dep lib*.a *.ii *.ti ti_files cxx_repository ii_files rii_files
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
/bin/rm -rf *.ii *.ti ti_files cxx_repository ii_files rii_files *.a *.o *.so
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
/bin/rm -f simple.o simple
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
/bin/rm -f cubes.o cubes
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/pi'
/bin/rm -f cpi.o cpi
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/pi'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/NPB2.3'
rm -f core
rm -f *~ */core */*~ */*.o */npbparams.h */*.obj */*.exe
rm -f MPI_dummy/test MPI_dummy/libmpi.a
rm -f sys/setparams sys/makesuite sys/setparams.h
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/NPB2.3'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/autoinstrument'
/bin/rm -f klargest.o klargest.inst.cpp klargest klargest.pdb
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/autoinstrument'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/reduce'
/bin/rm -f klargest.o klargest.inst.cpp klargest klargest.pdb *.refined* profile* pprof.dat
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/reduce'
Determining Configuration...
System previously configured as a bgl
*********** RECURSIVELY MAKING SUBDIRECTORIES ***********
*** COMPILING utils DIRECTORY
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c pprof.cpp
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c function_data.cpp
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c user_event_data.cpp
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   pprof.o user_event_data.o function_data.o -o pprof -lm
Installing pprof in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp pprof /home/amorris/wiki/tau-2.16.1/bgl/bin
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c tau_reduce.cpp
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   -c pprof_elem.cpp
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE   tau_reduce.o pprof_elem.o -o tau_reduce -lm
Installing tau_reduce in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
          else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp tau_reduce /home/amorris/wiki/tau-2.16.1/bgl/bin
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -c  tau_merge.c
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    -c tau_events.cpp
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    tau_merge.o tau_events.o -o tau_merge -lm
Installing tau_merge in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp tau_merge /home/amorris/wiki/tau-2.16.1/bgl/bin
blrts_xlC     -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE    tau_convert.c -o tau_convert -lm
Installing tau_convert in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp tau_convert /home/amorris/wiki/tau-2.16.1/bgl/bin
g++      -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE     -I/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/include -c tau_instrumentor.cpp
g++      -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE     -I/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/include -c tau_instrument.cpp
g++      -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE     -I/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/include -c tau_selective.cpp
g++      -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC  -w     -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE     tau_instrumentor.o tau_instrument.o tau_selective.o -o tau_instrumentor -L/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/bgl/lib -lpdb  -lm
Installing tau_instrumentor in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp tau_instrumentor /home/amorris/wiki/tau-2.16.1/bgl/bin
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
*** COMPILING src/Profile DIRECTORY
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c Profiler.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TulipTimers.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c UserEvent.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c FunctionInfo.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c RtsLayer.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c RtsThread.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauCAPI.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauFAPI.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauMapping.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauHooks.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauHandler.cpp
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauMemory.cpp
ar              rcv  libtau-mpi-pdt.a Profiler.o TulipTimers.o UserEvent.o FunctionInfo.o RtsLayer.o RtsThread.o TauCAPI.o TauFAPI.o TauMapping.o TauHooks.o TauHandler.o TauMemory.o
a - Profiler.o
a - TulipTimers.o
a - UserEvent.o
a - FunctionInfo.o
a - RtsLayer.o
a - RtsThread.o
a - TauCAPI.o
a - TauFAPI.o
a - TauMapping.o
a - TauHooks.o
a - TauHandler.o
a - TauMemory.o
echo "Built"  libtau-mpi-pdt.a
Built libtau-mpi-pdt.a
Installing libtau-mpi-pdt.a in /home/amorris/wiki/tau-2.16.1/bgl/lib
/bin/cp libtau-mpi-pdt.a /home/amorris/wiki/tau-2.16.1/bgl/lib
/bin/cp /home/amorris/wiki/tau-2.16.1/include/Makefile /home/amorris/wiki/tau-2.16.1/bgl/lib/Makefile.tau-mpi-pdt
blrts_xlC    -DTAU_LIBRARY_SOURCE   -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC   -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                -I/home/amorris/wiki/tau-2.16.1/include   -c TauDisable.cpp
ar              rcv  libTauDisable.a TauDisable.o
a - TauDisable.o
echo "Built"  libTauDisable.a
Built libTauDisable.a
Installing libTauDisable.a in /home/amorris/wiki/tau-2.16.1/bgl/lib
/bin/cp libTauDisable.a /home/amorris/wiki/tau-2.16.1/bgl/lib
make -f Makefile.wrapper
make[2]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
blrts_xlc   -I/home/amorris/wiki/tau-2.16.1/include -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC       -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                 -I/bgl/BlueLight/ppcfloor/bglsys/include  -c TauMpi.c
blrts_xlc   -I/home/amorris/wiki/tau-2.16.1/include -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC       -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                 -I/bgl/BlueLight/ppcfloor/bglsys/include  -c TauFMpi.c
"TauFMpi.c", line 4088.54: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
"TauFMpi.c", line 4235.79: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
"TauFMpi.c", line 4906.48: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
"TauFMpi.c", line 5011.79: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
blrts_xlc   -I/home/amorris/wiki/tau-2.16.1/include -DPROFILING_ON                   -DTAU_STDCXXLIB                       -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC       -DTAU_MPI -DTAU_MPI_THREADED                     -DTAU_MPIGREQUEST     -DTAU_MPIDATAREP    -DTAU_MPIERRHANDLER     -DTAU_MPIATTRFUNCTION    -DTAU_MPITYPEEX    -DTAU_MPIADDERROR         -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE                 -I/bgl/BlueLight/ppcfloor/bglsys/include  -c TauMpiExtensions.c
ar              rcv libTauMpi-mpi-pdt.a TauMpi.o TauFMpi.o        TauMpiExtensions.o
a - TauMpi.o
a - TauFMpi.o
a - TauMpiExtensions.o
echo "Built"  libTauMpi-mpi-pdt.a
Built libTauMpi-mpi-pdt.a
make[2]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
make -f Makefile.wrapper install
make[2]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
Installing libTauMpi-mpi-pdt.a in /home/amorris/wiki/tau-2.16.1/bgl/lib
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/lib ] ; then true; \
                   else mkdir /home/amorris/wiki/tau-2.16.1/bgl/lib ;fi
/bin/cp libTauMpi-mpi-pdt.a /home/amorris/wiki/tau-2.16.1/bgl/lib
make[2]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
***************** DONE ************************
% # build and run example auto-instrumented MPI fortran 90 application
% cd examples/pdt_mpi/f90
% make
/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/bgl/bin/f95parse ring.f90 -I/home/amorris/wiki/tau-2.16.1/include -I/bgl/BlueLight/ppcfloor/bglsys/include ; ../../../bgl/bin/tau_instrumentor ring.pdb ring.f90 -o ring.inst.f90 ; blrts_xlf90          -I/home/amorris/wiki/tau-2.16.1/include -I/bgl/BlueLight/ppcfloor/bglsys/include -qsuffix=f=f90   -c ring.inst.f90 -o ring.o ; rm -f ring.pdb ;
** func   === End of Compilation 1 ===
** main   === End of Compilation 2 ===
1501-510  Compilation successful for file ring.inst.f90.
blrts_xlf90              ring.o -o ring -L/home/amorris/wiki/tau-2.16.1/bgl/lib -lTauMpi-mpi-pdt -L/bgl/BlueLight/ppcfloor/bglsys/lib -lmpich.rts -lmsglayer.rts -ldevices.rts -lrts.rts -ldevices.rts -lrt    -L/home/amorris/wiki/tau-2.16.1/bgl/lib -ltau-mpi-pdt               -L/usr/bin/../blrts_dev_lib -L/usr/bin/../blrts_lib -L/opt/ibmcmp/vacpp/bg/8.0/blrts_lib -libmc++ -L/bgl/BlueLight/ppcfloor/blrts-gnu/powerpc-bgl-blrts-gnu/lib-lstdc++
% cqsub -t5 -n4 ./ring
5332
% # after job completes, view simple report
% ../../../ppc64/bin/pprof
Reading Profile files in profile.*

NODE 0;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0        0.088            1           1           5       1420 MAIN
 54.9        0.606         0.78           1           4        780 FUNC
 37.5        0.532        0.532           1           0        532 MPI_Init()
  8.5        0.121        0.121           1           0        121 MPI_Recv()
  1.7        0.024        0.024           1           0         24 MPI_Send()
  1.5        0.021        0.021           1           0         21 MPI_Bcast()
  0.8        0.012        0.012           1           0         12 MPI_Finalize()
  0.6        0.008        0.008           1           0          8 MPI_Barrier()
  0.3        0.004        0.004           1           0          4 MPI_Comm_rank()
  0.3        0.004        0.004           1           0          4 MPI_Comm_size()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 0, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         1         40         40         40          0  Message size for broadcast
         1         40         40         40          0  Message size received from all nodes
         1         40         40         40          0  Message size sent to all nodes
---------------------------------------------------------------------------------------

NODE 1;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0        0.086            1           1           5       1414 MAIN
 52.1         0.55        0.736           1           4        736 FUNC
 37.1        0.525        0.525           1           0        525 MPI_Init()
  7.8         0.11         0.11           1           0        110 MPI_Bcast()
  4.1        0.058        0.058           1           0         58 MPI_Finalize()
  2.8        0.039        0.039           1           0         39 MPI_Recv()
  1.5        0.021        0.021           1           0         21 MPI_Barrier()
  1.1        0.016        0.016           1           0         16 MPI_Send()
  0.4        0.005        0.005           1           0          5 MPI_Comm_size()
  0.3        0.004        0.004           1           0          4 MPI_Comm_rank()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 1, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         1         40         40         40          0  Message size for broadcast
         1         40         40         40          0  Message size received from all nodes
         1         40         40         40          0  Message size sent to all nodes
---------------------------------------------------------------------------------------

NODE 2;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0        0.083            1           1           5       1415 MAIN
 54.2        0.544        0.767           1           4        767 FUNC
 37.3        0.528        0.528           1           0        528 MPI_Init()
  5.7         0.08         0.08           1           0         80 MPI_Recv()
  4.8        0.068        0.068           1           0         68 MPI_Bcast()
  4.1        0.058        0.058           1           0         58 MPI_Barrier()
  2.0        0.028        0.028           1           0         28 MPI_Finalize()
  1.2        0.017        0.017           1           0         17 MPI_Send()
  0.4        0.005        0.005           1           0          5 MPI_Comm_size()
  0.3        0.004        0.004           1           0          4 MPI_Comm_rank()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 2, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         1         40         40         40          0  Message size for broadcast
         1         40         40         40          0  Message size received from all nodes
         1         40         40         40          0  Message size sent to all nodes
---------------------------------------------------------------------------------------

NODE 3;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0        0.086            1           1           5       1411 MAIN
 53.2         0.55        0.751           1           4        751 FUNC
 37.0        0.522        0.522           1           0        522 MPI_Init()
  8.6        0.121        0.121           1           0        121 MPI_Recv()
  3.0        0.043        0.043           1           0         43 MPI_Finalize()
  2.6        0.036        0.036           1           0         36 MPI_Barrier()
  1.9        0.027        0.027           1           0         27 MPI_Bcast()
  1.2        0.017        0.017           1           0         17 MPI_Send()
  0.4        0.005        0.005           1           0          5 MPI_Comm_size()
  0.3        0.004        0.004           1           0          4 MPI_Comm_rank()
---------------------------------------------------------------------------------------

USER EVENTS Profile :NODE 3, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples   MaxValue   MinValue  MeanValue  Std. Dev.  Event Name
---------------------------------------------------------------------------------------
         1         40         40         40          0  Message size for broadcast
         1         40         40         40          0  Message size received from all nodes
         1         40         40         40          0  Message size sent to all nodes
---------------------------------------------------------------------------------------

FUNCTION SUMMARY (total):
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0        0.343            5           4          20       1415 MAIN
 53.6            2            3           4          16        758 FUNC
 37.2            2            2           4           0        527 MPI_Init()
  6.4        0.361        0.361           4           0         90 MPI_Recv()
  4.0        0.226        0.226           4           0         56 MPI_Bcast()
  2.5        0.141        0.141           4           0         35 MPI_Finalize()
  2.2        0.123        0.123           4           0         31 MPI_Barrier()
  1.3        0.074        0.074           4           0         18 MPI_Send()
  0.3        0.019        0.019           4           0          5 MPI_Comm_size()
  0.3        0.016        0.016           4           0          4 MPI_Comm_rank()

FUNCTION SUMMARY (mean):
---------------------------------------------------------------------------------------
%Time    Exclusive    Inclusive       #Call      #Subrs  Inclusive Name
              msec   total msec                          usec/call
---------------------------------------------------------------------------------------
100.0       0.0858            1           1           5       1415 MAIN
 53.6        0.562        0.758           1           4        758 FUNC
 37.2        0.527        0.527           1           0        527 MPI_Init()
  6.4       0.0902       0.0902           1           0         90 MPI_Recv()
  4.0       0.0565       0.0565           1           0         56 MPI_Bcast()
  2.5       0.0352       0.0352           1           0         35 MPI_Finalize()
  2.2       0.0307       0.0307           1           0         31 MPI_Barrier()
  1.3       0.0185       0.0185           1           0         18 MPI_Send()
  0.3      0.00475      0.00475           1           0          5 MPI_Comm_size()
  0.3        0.004        0.004           1           0          4 MPI_Comm_rank()
%