Hp XC System 3.x Software Bedienungsanleitung

HPCPI and Xtools Version 0.6.6 User'sGuideHP Part Number: 5992-4009Published: March 2008Edition: 1

10

• L2I Misses: ICACHE_REFILLS_FROM_LS_FROM.SYSTEM• Misses: ICACHE_MISSES• Icache Fetches: ICACHE_FETCHESBranchDisplays the following branch metrics:• B

Viewing xcxperf (Generic) StatisticsFigure 7-10 shows an xcxperf display. By default, xcxperf displays graphs withprocessor-independent statistics for

DiskDisplays the throughput rates in Mb/s for the following disk activities from /proc/diskstats:• Write• ReadNFSDisplays statistics for the following

ElanDisplays the throughput rates in Mb/s for the following Quadrics QsNetIIinterconnect activitiesfrom Elan memory registers:• Write• ReadMemoryDispl

Displaying Color Legends and Creating Tear-Away LegendsTo display the color legend for a graph, select the menu item with the graph name, such as CPUi

Table 7-3 xperf (Enhanced) Menu Options (continued)DescriptionOptionMenuOpens a dialog box that displays system information, as shown in Figure 7-12(p

Starting an HPCPI Label from xperfYou can start an HPCPI label and collect data for that label from the xperf utility. An HPCPIlabel enables you to an

Recording, Replaying, and Plotting xperf and xcxperf DataYou can save the data from the xperf or xcxperf utility in a file. The utilities update data

Displaying System Information with xperf or xcxperfIf you select Options→System Information from the menu at the top of the display, xperf orxcxperf o

Viewing Generic Data with xclus or xperfBy default, the xclus and xperf utilities display enhanced data. You can force xclus andxperf to display gener

List of Tables1-1 Processors that Support Enhanced Statistics...201-2 Pr

Viewing Enhanced Data with xcxclus or xcxperfBy default, the xcxclus and xcxperf utilities display generic data. You can force xcxclusand xcxperf to d

Xtools DaemonsXtools use the following daemons:• apmond and clusmondThe apmond and clusmond daemons are included with the Xtools software and collecte

112

A Product SpecificationsThis appendix contains product specifications.HPCPI Database Directories and FilesThe database root directory contains the fol

Figure A-1 HPCPI Database$HPCPIDB200802141532node 1node 2node 3200802141712200802141744. . .. . .. . .. . .App12.ebadcb63fb63e830_myLabel_5sum.0479a58

number of samplesrecorded for the event3 14The fully-qualified pathname for the image file.A table withper-instruction statistics.Each line contains e

Multi-Issue ArchitecturesIn multi-issue architectures (those that can execute more than one instruction per cycle), theinterrupt handler associates on

B HPCPI Quick ReferenceThis appendix contains quick reference information for basic HPCPI tasks.Starting HPCPITable B-1 Starting HPCPIReferenceUse thi

Viewing HPCPI DataTable B-3 Viewing HPCPI DataReferenceUse this CommandTo Perform this Task“Viewing Per-Image Data:hpcpiprof” (page 44)hpcpiprofDispla

C Xtools Quick ReferenceThis appendix contains quick reference information for Xtools.xclus and xcxclus TasksThis section contains quick reference inf

12

Table C-2 Modifying xclus or xcxclus Displays (continued)ReferenceUse this ProcedureTo Perform this Task“Showing HyperTransportData Statistics or Data

xperf and xcxperf TasksThis section contains quick reference information for basic xperf and xcxperf tasks.Starting xperf or xcxperfTable C-4 Starting

Additional xperf and xcxperf TasksTable C-6 Additional xperf and xcxperf TasksReferenceUse this ProcedureTo Perform this Task“Starting an HPCPI Label

Glossaryactive fraction The fraction of time an event was active in the PMU.See also duty group.duty groupA group of HPCPI events, used to multiplex t

RPM Red Hat Package Manager.1. A utility that is used for software package management on a Linux operating system, mostnotably to install and remove s

IndexAactive fraction, 114, 116in HPCPI output, 44AMD Opteronbranch statistics displayed by xperf, 100CPU statistics displayed by xperf, 99CPU utiliza

DISPLAY environment variablesetting for Xtools, 78DMA busItanium statistics displayed by xperf, 97-doflushoption for hpcpid, 72DRAMAMD Opteron statist

organizing data with, 56loading the environment, 31, 35log file, 37manpage directory, 35organizing data, 56product limitations, 115sampling characteri

full imaging procedure, 28manual propagation procedure, 28running RPM on clients procedure, 29on standalone systems, 27requirements, 25instructionview

for Xtools, 78mond daemon, 111MPIand HPCPI labels, 73using HPCPI with, 70mpirunand HPCPI labels, 73using HPCPI labels with, 69Nnegating HPCPI label se

About This DocumentThis document describes how to install and use the HPCPI and Xtools performance analysistools on Linux systems running on HP Integr

xcxclus, 78xperf or xcxperf, 94Xtools subsystem, 29statusHPCPI, 41stoppinghpcpid, 41subsume delay parameter for node grouping, 93supermon daemon, 111s

specifying nodes for, 79starting,statistics, 21suspending the display, 86-zoom option, 86xcxperf utilitybandwidth, displaying, 104comparison with xper

Key The name of a keyboard key. Return and Enter both refer to thesame key.Term The defined use of an important word or phrase.User inputCommands and

product changes. To ensure that you receive the updated or new editions, subscribe to theappropriate product support service. See your HP sales repres

16

1 IntroductionThe HP Continuous Profiling Infrastructure (HPCPI) and Xtools are performance analysis toolsfor Linux systems running on HP Integrity Se

hpcpiprofThe hpcpiprof utility displays performance profiles for systems (per image) or images(per procedure). The following excerpt from hpcpiprof ou

greater the number of samples, the closer the statistical correspondence. Therefore, the statisticalevent samples provide a reasonably accurate profil

© Copyright 2008 Hewlett-Packard Development Company, L.P.Confidential computer software. Valid license from HP required for possession, use or copyin

XtoolsThe Xtools utilities are X11 clients with GUIs that enable you to monitor the performance ofmultiple systems and individual systems. The Xtools

Figure 1-1 xclus Display for AMD Opteron SystemsTable 1-3 Statistics for xclus and xcxclusxcxclus Statistics (Generic)xclus Statistics (Enhanced)• Pro

Figure 1-2 xperf Display for an Itanium System22 Introduction

Table 1-4 Statistics for xperf and xcxperfxcxperf Statistics (Generic)xperf Statistics (Enhanced)• CPU utilization (for the user and the system)• Disk

24

2 Installing HPCPI and XtoolsThis chapter describes the installation requirements and procedures for HPCPI and Xtools. Thischapter addresses the follo

• hpcpiThis package contains all the files necessary to use HPCPI.• xtools-commonThis package contains files and utilities that are common to xclus an

HP also recommends that you install the HPCPI or Xtools software when the system is idle tominimize the effects of the installation procedure on other

You can immediately install software on the clients; you do not have to wait until youhave created the golden image on the head node.—— You do not hav

4. Set the shell variable nn to `nodename` to shorten the commands in the remainder of thisprocedure:# nn=`nodename`Where `nodename` resolves to the n

Table of ContentsAbout This Document...13Intended

4. Copy the package files to the shared directory /hptc_cluster as follows:# cp package_file package_file ... /hptc_cluster5. Verify that HPCPI and Xt

3 Getting Started with HPCPIThis chapter shows the commands used in a simple HPCPI user session.NOTE: The program analyzed in this chapter is a simple

You will create the directory in the next step.The following example uses the directory /tmp/hpcpidb:% setenv HPCPIDB /tmp/hpcpidbFor information abou

Step 8: Viewing Per Procedure Statistics for the ApplicationThe following command enables you to view per-procedure statistics for the image myApp:% h

34

4 Using HPCPIThis chapter describes how to perform basic HPCPI tasks, including how to start HPCPI, controlthe HPCPI daemon, and view data using HPCPI

Selecting a Location for the HPCPI Database DirectoryThe HPCPI database directory contains files with performance data. The files are organized insubd

1 groups; user definition: 3 # 4 5 6 7 1 CPU_CYCLES <empty> <empty> <empty>----multiplexing interval =

event_set_nameSpecifies an event set name.valueSpecifies the event interval, which is the number of times an event isrecorded by the PMU before genera

Event Duty QualifierThe -events statement also supports a duty qualifier, which enables you to control how oftenan event is monitored when you are mon

Step 8: Viewing Per Procedure Statistics for the Application...33Step 9: Viewing Per Instr

Running an Application for AnalysisAfter you start the HPCPI daemon, you can run the applications you want to analyze; run theapplications as you norm

Controlling the Daemon with hpcpictlThe hpcpictl utility is a userspace application that controls the operation of the hpcpiddaemon. You can use hpcpi

pretty proper name interval rnd duty active ------ ----------- -------- --- ------ ------ Cycles CPU_CYCLES 60000 no always 1/1 hpcpictl sho

Viewing Data with hpcpiprof, hpcpilist, and hpcpitopcountsHPCPI provides the following utilities to display HPCPI data:• hpcpiprofDisplays performance

Viewing Per-Image Data: hpcpiprofIf you run hpcpiprof without an image name, it displays statistics for the system, partitionedper-image. For example:

%Lists the percentage of event samples for the event type that occurred in theimage.cum%Lists the cumulative percentage of all event samples for this

Viewing Per-Procedure Data: hpcpiprof image_nameIf you run hpcpiprof with an image name, it displays statistics for the image, partitionedper-procedur

Viewing Per-Instruction Data: hpcpilist procedure_nameimage_nameThe hpcpilist utility lists HPCPI performance statistics per line of source and/or ass

Interpreting hpcpilist Event CountsThe value of the instruction pointer recorded is typically several or many instructions after theinstruction that c

Listing the Instructions with the Highest Event Counts: hpcpitopcountsThe hpcpitopcounts utility displays the n instructions with the highest counts f

Displaying Raw Values...53Limiting th

Listing Instructions in an Image: hpcpitopcounts image_nameYou can run hpcpitopcounts with an image name to list the instructions with the highesteven

HPCPI Utility OptionsThis section describes options for the hpcpiprof, hpcpilist, and hpcpitopcounts utilities.Specifying an Alternate DatabaseBy defa

In a cluster environment with a consolidated HPCPI database and synchronized epochs, youmight want to include or exclude the data from specific system

data for myApp with the label myLabel. The following command displays performance data forcode called by myApp from libc-2.3.4.so:% hpcpiprof -label m

85189620000 89.5% 89.5% 28200 main myApp 10002660000 10.5% 100.0% 3000 unknown_rou myApp Limiting the hpcpiprof Out

Tips and Best Practices for Using HPCPIThis section contains tips and best practices for using HPCPI.TipsTo profile an application, you start by monit

Limiting the Event Count Display (hpcpiprof -keep Option)If you have a lot of data, you can use the -keep option with hpcpiprof to limit the number of

Itanium Instruction MetricsOn Itanium processors, the event counter IA64_INST_RETIRED includes retired instructionsand retired no operation instructio

58

5 Using HPCPI LabelsThis chapter describes how to use HPCPI labels. This chapter addresses the following topics:• “Overview” (page 59)• “Simple HPCPI

Using Labels with mpirun and Other Distribution Utilities...69Collecting Data on Multiple Nodes

Simple HPCPI Session Using LabelsIn the following session, the user associates the label myLabel with the performance data for asingle process, myApp.

: :If you run the same hpcpiprof command and specify the label name (hpcpiprof -labelmyLabel), hpcpiprof displays event counts for code execu

Label SelectorsUsing the hpcpictl label command in its simplest form is sufficient if you are executing andmonitoring a single process that is execute

-or-equiv-not OperatorThe unary postfix operator -not negates the specification. The following example uses the -notoperator to select events for nons

Multiple LabelsAn event can be recorded in only one data set, that is, one label. If you have multiple labelsdefined and a process matches the selecto

Label ExamplesThis section contains HPCPI label examples.Existing Processes: -pid pidYou can use the ps utility to determine the PID of an existing pr

Alternatively, you can use the sleep 99999 command and manually terminate the sleepprocess when you are done taking measurements. For example:% hpcpic

Creating Labels in ProgramsYou can use a function such as popen() to invoke the hpcpictl label command within anapplication and assign a label to spec

} else { perror("popen()"); } } }}NotesNote the following items:• The first if block terminates an existing label proc

6 Using HPCPI on an HP XC ClusterThis chapter describes additional procedures for using HPCPI on an HP XC cluster. This chapteraddresses the following

CPU...96Instr

Collecting Data on Multiple NodesThis section describes the tasks you must perform to collect data on multiple nodes, and includesan example using HP-

Submitting the JobUse the HP-LSF bsub command to submit the following job:% bsub -n num_nodes \ mpirun -srun \ --task-prolog=`pwd`/slurm.task-p

the daemon when the specified PID process terminates. In this case, pid is the PID of the initialslurmstepd on node for this task.By default, the -ter

Collecting Data on One NodeTo collect data on one node in a cluster environment, you can use the procedures described inChapter 3 (page 31) and Chapte

74

7 Using XtoolsThis chapter describes how to use xclus, xcxclus, xperf, and xcxperf. This chapter addressesthe following topics:• “Xtools Overview” (pa

Xtools OverviewThe Xtools utilities are X11 clients with GUIs that enable you to monitor the performance ofmultiple systems and individual systems. Th

not require superuser privileges to use the -unrestricted-nodes option and supportsthe -unrestricted-nodes option for all users.• On non-cluster syste

Starting xclus and xcxclusTo start xclus or xcxclus, follow these steps:1. Set up the Xtools environment.2. Set the DISPLAY environment variable.3. St

Specifying Nodes with xcxclusBy default, you do not need to specify the nodes you want to monitor with xcxclus, andxcxclus monitors all the nodes that

HPCPI Product Limitations...115Skid...

Specifying the Cluster File Name with the -cluster OptionIf the cluster file is not named cluster and is not located in the current working directory,

Viewing xclus and xcxclus DisplaysFigure 7-1 shows an xclus display for four Itanium systems. To view an xclus display withAMD Opteron systems, see Fi

Viewing xclus (Enhanced) Itanium IconsBy default, xclus displays enhanced icons for Itanium processors. Figure 7-2 shows an enhancedicon for a node wi

Viewing xclus (Enhanced) Single-Core and Dual-Core AMD Opteron Node IconsBy default, xclus displays enhanced icons for AMD Opteron processors. Figure

Viewing xclus(Enhanced) Native Quad-Core AMD Opteron Node IconsBy default, xclus displays enhanced icons for AMD Opteron processors. Figure 7-4 shows

Viewing xcxclus (Generic) Node IconsBy default, the xcxclus utility displays generic icons for all processor types, and the informationdisplayed is th

Showing Statistic Names and DescriptionsIf you move your mouse over an icon area, xclus or xcxclus opens a window with the nameof the statistic and mo

You can also modify the number of icons that xclus or xcxclus displays per row. By default,the xclus or xcxclus utility attempts to display eight node

Table 7-2 xcxclus Generic) Menu OptionsDescriptionOptionMenuStops the xcxclus utility.Exit..FileOpens a dialog box that enables you to control node gr

Recording, Replaying, and Plotting xclus and xcxclus DataYou can save the data from the xclus or xcxclus utility in a file. The utilities update data

List of Figures1-1 xclus Display for AMD Opteron Systems...211-2 xperf

plot_file_prefix.xclus.gnuplot Script file for gnuplot.You can redisplay the plotted data using the /opt/xtools/gnu/bin/gnuplot commandwith the plot_f

Figure 7-7 Plotted Data from xclusRecording, Replaying, and Plotting xclus and xcxclus Data 91

Starting xperf or xcxperf from xclus or xcxclusTo start xperf from xclus or to start xcxperf from xcxclus, click a node icon.Viewing Grouped NodesIf y

CPU utilizationDRAM utilizationHyperTransport link utilization (processor-to-processor)HyperTransport link utilization (to external devices)If all the

Using xperf and xcxperfThe following sections describe general procedures for using xperf and xcxperf. The xperfand xcxperf utilities are similar, and

Viewing xperf and xcxperf DisplaysBy default, xperf displays graphs for the statistics listed in “Viewing Itanium xperf (Enhanced)Statistics” (page 96

Viewing Itanium xperf (Enhanced) StatisticsFigure 1-2 (page 22) shows an xperf display for an Itanium system. By default, xperf displaysgraphs with pr

• L3cache misses: Level 3 cache misses• TLB misses: Translation Lookaside Buffer missesSysBusDisplays the following system bus utilization rates:• Add

Viewing AMD Opteron xperf (Enhanced) StatisticsFigure 7-9 shows an xperf display for an AMD Opteron system. By default, xperf displaysgraphs with proc

NOTE: AMD does not provide code-usable names for AMD Opteron processor events. Inaddition, the names listed in this section are used for single-core a