Virtual Machine Tool SetVirtual Machine Resource System Monitor |
VMRSM Installation Page.
1.0 Monitor Description
-- Design Theory
-- Real-Time Performance Analysis
-- Disclaimer
2.0 Installation and Operation
-- Invocation EXEC
-- Operational Commands and PF keys
-- Special Facilities.
-- Ascertaining terminal type
3.0 Guide to Display Fields
4.0 Program Product Exceptions
5.0 Error Messages
Monitor Design Theory
The VMRSM program was designed to operate in a CMS environment
as a VM realtime performance monitor. This monitor is for use as
systems programmers analysis and diagnostic tool in determining
current VM system activity and load. It also lends itself as a monitoring
facility to the manager of Information Systems by giving this person
the ability to easily interpret how his/her VM system is performing
with the hardware and peripherals with which it is configured.
The VMRSM monitor is not designed nor recommended to be used
for long-term capacity planning or for charting trends. The monitor
is for very short-term capturing of system performance data and
presenting an accurate picture of such to the monitor user. The
functions of long-trend data accumulation and reduction for capacity
planning purposes is best served by IBM's Virtual Machine Monitor
Analysis Program. VMMAP in CPC's opinion, is currently the best
and most cost-effective product for performing long-term analysis.
VMRSM is however valuable in establishing requirements for
additions to (or removal from) your current hardware and software
configurations.
One of the greatest benefits of the VMRSM performance monitor
having the ability to reliably observe in an interactive environment
the system "spikes" and "valleys" as they occur in the processor
configuration. There is no smoothing of data that may tend to
suppress flagging of problems. Sampling is done with short time
intervals to be able to capture all relevant data pertaining to the
operation of the VM system. Long term monitors tend to lose some
very important performance data because of their infrequent sampling
some problem areas may never be indicated with long term sampling.
VMRSM has been designed and continues to be engineered to place
as little load on the VM system as is statistically feasible during its
monitoring activity. It uses a minimum of resources and therefore
will not bias the system through the act of monitoring. Its overhead
is different for each display facility. The least resource drain is
associated with the VMSYSTEM display; the greatest is the VMUSERs where
the overhead is proportional to the number of logged on users.
The monitor's only resource dependencies are CPU and VM dispatching
time, and possibly paging if the system is short on storage. Other than
these, no other problems in the system should affect the monitor itself.
VMRSM display fieldnames very often are selected directly from the
CP Data Areas and Control Blocks manual for the VM/ESA product.
Realtime Performance Analysis
The performance of a VM system is determined by the operation and the
management of the elements that contribute to the system. Performance
changes result from the alteration of one or more of the contributing
elements or from the lack of or addition of system resources. These
elements are: hardware, software, workload and tuning. Powerful hardware
can be brought to its knees by inefficient software, excessive workload
or a single resource bottleneck. Similarly all the tuning in the world
can not take the place of faster and more efficient hardware after a
certain point. The objective of performance management is to achieve
optimal efficiency with the hardware you have before procuring more
expensive equipment. This VM Monitor is only a tool to help simplify
the process of performance managament by permitting its user to easily
identify factors affecting performance and the demands placed upon a
system by different virtual machines.
Disclaimer
In no event will Licensor or its representatives be liable to the
Licensee or any other party for any loss, including time, money,
good will and consequential damages, which may arise from the use,
operation, modification or interpretation of the Licensed Program by
the Licensee. CTS does not warrant that the functions contained in
the program will meet the customer's requirements or will operate in
combinations which may be selected for user by the customer, or that
the operations of the program will be uninterrupted or error free, or
that all program defects will be corrected.
All information presented by the product is derived directly from
data obtained from the real storage of IBM 370 Architecture computer
equipment upon which the product is executing. The data is mapped
according to guidelines set forth in IBM's VM/ESA Data Areas and Control
Blocks Logic (CP) manual.
Since this program runs asynchronously to the VM/SP Control Program
and there exist no paths of communication, signaling or synchronization
over and above any that exist for a problem-state program running in a
virtual machine with DIAGNOSE(04) privileges, any data fields or set of
data fields, in the process of being sampled and/or interrogated by the
program may be, by the VM CP updated, altered or changed in some way as
to affect the derivation algorithms of the program. Such may present the
user a statistic that is not necessarily a precise indicator of actual
events.
The majority of statistics presented the user is the last posted or
last change of a field in real storage. Some statistics are derived over
the last N intervals (where N is usually less then 10). Others are the
results of an arithmetic operation of sampled statistics to retrieve
their expected complementary statistics.
Invocation Exec
/* Last Update: 09-15-2000 */
TRACE off
parse arg refresh_secs .
if refresh_secs = '' | datatype(refresh_secs,'W') = 0 then
do
refresh_secs = '8'
end
if refresh_secs > 99 then
do
say 'Invalid REFRESHMENT Interval specified (Range: 0 <= seconds <= 99)'
exit 255
end
if refresh_secs < 10 then
do
refresh_secs = overlay(refresh_secs,'0',2,1,0)
end
'EXECIO * CP (STR Q USERID'
parse upper pull . . sysid .
if sysid = '' then sysid = ' '
'CP SET EMSG OFF'
'CP SET MSG OFF'
'CP SET IMSG OFF'
'CP SET MSG IUCV'
'CP SET SMSG IUCV'
'CP SET IMSG IUCV'
'CP SET EMSG IUCV'
'CP SET WNG IUCV'
'CP SET VMCONIO IUCV'
'CP SET CPCONIO IUCV'
n = 0
ADDRESS COMMAND 'EXECIO * CP (STRING Q PF '
do WHILE (QUEUED() > 0)
n = n + 1
parse pull pfk.n a1.n a2.n a3.n a4.n a5.n a6.n a7.n a8.n .
end
'CP TERM BRKKEY PA1'
'DESBUF'
'CP SET RUN OFF'
'vmfclear'
VMRSM refresh_secs sysid
/* 'vmfclear' */
'CP SET RUN ON'
DO i = 1 to n
'EXECIO 0 CP (STRING SET 'pfk.i a1.i a2.i a3.i a4.i a5.i a6.i a7.i a8.i
END
'CP SET CPCONIO OFF'
'CP SET VMCONIO OFF'
'CP SET WNG ON'
'CP SET EMSG ON'
'CP SET IMSG ON'
'CP SET RUN ON'
'CP SET MSG ON'
'CP SET SMSG OFF'
'CP SET MSG ON'
'CP TERM HILIGHT ON'
RETURN 0
Operational Commands and Program Function Key settings
OPERATION: Start: execute VMRSM
:: time in seconds
0 < secs <= 99
Stop: enter HX
Enter CP Panel: enter CP
Screen Capture: enter SOFTCOPY
Help: enter HELP or ?
Command Line: Upper left-hand corner. Depressing the ENTER key will
always cause the cursor to return to this home position.
Function Transition Commands
These commands can be entered from any display and
they will cause a change in display function.
VMSYSTEM or PF7 General VM System diagnostics.
VMUSERS or PF6 Active users and their operating characteristics.
VMDBK or PF4 Display of a particular logged on user. First user
examined will always be the one running the monitor.
To examine any other user, simply enter the name in
the command area and depress the enter key.
VDEV Display of a given virtual device owned by a virtual
machine. ONLY VALID from the VMDBK display command line.
The first VDEVBLOK found for this machine will be the
initial monitored device.
To switch monitoring to other device, just enter the
address of the virtual device in the command area.
PF3 will return you back to the previous VMDBK display.
RDEV or PF5 Display of a given real device. The first GRAF RDEVBLOK
found will be the initial device monitored.
To switch monitoring to other device, just enter the
address of the device in the command area.
VMDEVICE or PF10 Display of all active real peripheral devices.
VMCHANS or PF9 Display of channel path utilization of active paths.
VMSTORAG or PF11 Display of REAL memory utilizations and assignments.
HELP or ? This will display the HELP screen that will outline
the possible major transition commands.
PA1 This will cause a CP READ to occur. Becomes useful
if you wish to execute a CP Command.
Note: Entering the CP Command EXT (for external
interrupt) will terminate the monitor at next cycle.
PF1 Will half the interval time between samplings when
depressed during VMDASD, VMUSERS or VMDEVICE.
PF2 Will double the interval time between samplings for
that display session. Resets upon function change.
Emergency Termination: Hit PA1 to enter a CP READ state, then
Enter CP EXT to generate a virtual
external interrupt. The monitor interrupt
handlers will sense and cause a termination
on the next cycle.
Scope Transition Commands, within Function
These commands can be entered at the ==> of the following
displays and this will cause a change in monitor objective.
Function Scope
-------- ------------------------------------------------------------
VMDBK Display ...Guest | Username...
The VMBDK display will initially select the monitor
user as the object for diagnostic display. To change
objectives simply enter the name of a logged on user
on the command line home position and depress ENTER.
VDEV Display ...CCUU...
The VDEV display will request a virtual device to be
selected as the object for monitoring. To change
objectives simply enter the name of another virtual device
on the command line home position and depress ENTER.
All PFkeys will bring you back to the owning VMDBK display.
RDEV Display ...CCUU...
The RDEV display will request a real device to be
selected as the object for monitoring. To change
objectives simply enter the name of another real device
on the command line home position and depress ENTER.
VMDEVICE Display ...CLASS...
The VMDEVICE logic will initially post statistics for
active DASD as the object for monitoring. To change
objectives simply enter the name of a class of devices.
The device class will appear in the display heading.
The Classes are: TAPE
DASD CKD disk devices
FBA Fixed-Block Architecture devices
UR Unit Record Equipment
TERM Bisync lines
GRAF Graphic and terminals
Special Facilities
CP When the literal "CP" is entered from the command line you will
be switched to a console-like panel that will accomodate accepting,
executing and displaying the results of CP Commands.
This display will be presented in "rolling" console fashion.
You can scroll the contents of this screen forwards and backwards
throught the last 3000 messages.
PF3 or typing ROLLEXIT will return you back to the previous
monitoring display.
PF6 will retrieve up to the last 50 commands.
PF7/PF8 will control scrolling back/forward. Use PF12 to return
the display to NORMAL rolling mode and to display any messages
or reponses pending while in scroll back mode.
All commands must be prefixed with "CP"
Example: CP DISPLAY T0.FF
Note: you must use the latest VMRSM EXEC that includes the
IUCV message capture setting.
SOFTCOPY This will capture the contents of the display to a
CMS file. Further softcopies will append to the file.
The command literal will remain at the command line
until removed or overtyped.
Ascertaining Display Terminal Type
The program uses the CP Diagnose X'8C' in determining the terminal
display surface characteristics. For local attached non-SNA devices
the CP Control Program acquires this from the terminal controller directly.
This CP function returns to the program information including the numbe
of display surface column and row cells. This is used as the basis for
constructing the length of the 3270 IOS datastream, NOT the terminal
that may be physically connected to the controller.
For SNA devices the characteristics are still determined by the
network LOGMODE tables.
Guide to the display Fields of the monitor
General System Diagnostics -- VMSYSTEM
CPU Activity Percent of time that CPU is active in the Supervisor or
or Problem states.
(Emulation.Problem time + User.CP.Service time(ONLY) +
CP.Overhead time) / Interval
CP Supervisor Percent of time that CPU is processing in the Supervisor
state, CP processing for system scheduling, resource all-
ocation, etc, and on behalf of Guests (non-chargeable).
User CP Service Percent of time that CP is performing privileged
processing on Guests' behalf (chargeable).
Emulation State Percent of time that CPU is running guest task work,
instruction sequences that do not require CP interception.
(User CP Service is removed).
System Wait Voluntary System Wait Time. Persent of the total time spent
waiting for I/O or Timer expiration events.
No tasks currently require a CPU.
External Wait Percent of total time that is "unaccounted". Time used by
external sources or VM waiting for external re-dispatch.
For second level VM systems or systems running in an LPAR,
this indicates the percentage of time a processor has work
to do but is unable to run because the hypervisor is not
dispatching this VM system. (LPAR overhead + other LPARs)
100 % Clock Time = Emulation Time + System Wait + User CP Service +
CP Supervisor Time + External Wait
Storage Utilized Percent of page frames used by PROBLEM tasks.
(Sum of the In-Queue Working Sets + CP Nucleus + Free Pages
+ Shared Pages + Locked) / (Number of pages avail at IPL)
Paging Rate/Sec Smoothed paging rate calculated by the Control Program (CP)
Spool Space Satur Percent of SPOOL space currently used. This consists
of an accumulation of reader, punch and printer spool
files, and NSS space.
Page Steals Percent of DPA and XSTORE of reserved and referenced pages
being stolen from in-queue users.
SIEs Intercepted Percent of time that CP intercepts a SIE execution. pages
Users Logd Number of local users using local system.
Dialed Number of users attaching themselves to guest systems
via the DIAL command.
Net Number of users entering local system via SNA VSM.
Outboard VM consoles controlled by VTAM.
Free Storage Extent of FREE STORAGE taken by CP thru stealing
Extended page frames from the Dynamic Paging Area (DPA).
DPA Number of page frames in the DPA.
Avail Number of page frames in the DPA remaining available
Resv Number of page frames in the DPA reserved for users.
Shared Number of page frames in the DPA shared by users.
CorPgs Number of page frames in the VM/ESA.
Interactive Q0 Number of active QUICKDSP users in queue
Q1 Number of active INTERACTIVE users in queue
EQ0 Number of users eligible for QUICKDSP queue
EQ1 Number of users eligible for interactive queue
Computation Q2 Number of active COMPUTE users in queue
Q3 Number of active INTENSIVE users in queue
EQ2 Number of users eligible for COMPUTE queue
EQ3 Number of users eligible for INTENSIVE e queue
Their working-set requirement forces EQ users to wait
until storage is freed when some user is Q-dropped.
PgReads Page frames read into main storage in last interval.
PgWrits Page frames written to aux storage in last interval.
Notice more page reads occur than page writes due to
the fact that if a page in memory has remained
unchanged since pagein then it is not necessary to
refresh the copy on the paging DASD.
SIExecs SIE executions in the last interval. .
SIEcept SIE interceptions by CP in the last interval.
Interval Duration of last sample interval.
Lag Part of last interval that can be attributed to wait
for re-dispatching of monitor due to system load and
data transmission time, and channel/device-ends.
Monitor OVH Measure of CPU seconds consumed by the monitor per cycle
(overhead) (plus the amount of time taken by CP to re-dispatch the
program immediately following its 'sleep' interval, and
minus the time charged by CP to service the virtual machine
interval timer).
XSTORE Number of expanded storage pages available.
Actv CP Number of active CPs running.
WkSet Sum of the working sets of the current in-queue
Sums users for the last sampling interval.
SSCHs Interval count of all real I/O Starts. ve
RSCHs Interval count of all real I/O Resumes. ve
Intrpts Interval count of all real I/O Interrupts. ve
Nuc Number of page frames occupied by the resident
part of the CP Nucleus program.
Core Number of page frames available for VM operations
in this machine.
Elapsed Time Shows the elapsed time in days, hours, minutes and seconds
since Last VM IPL since CP was last initialized.
TOD Clock Current 24-hr Time-of-Day Clock appears on top of display.
Active VM Users Display -- VMUSERS
Resource Service A measure of the ability of the VM system to provide
Level CPU service to the active users on the system. This
is the ratio of the average in-queue users during
the sampled interval to the number of users+System
that used CPU service for that same interval.
.99 is optimal
.01 is poor
User Name of USER logged on to VM/SP.
Run Status Current or last sampled running status posted for
this user by CP.
Dispatch Current or last sampled dispatcher status posted.
RAI Resource Availability Index simulation **testing**
CPU-% Percent of the real CPU resource used by this user
for the last sampling period. (TTIME)
PgSec Paging rate in pages per second for this VM user
for the last sampling period. (READS and WRITES)
XpgSec Rate in pages per second of this VM user's use of
expanded storage for the last sampling period.
Queue Dispatching queue currently assigned to by VM/SP.
INTERACTIVE (Q1) COMPUTE-BOUND (Q2) or INTENSIV (Q3).
WkSet Number of real pages inclusive of locked and reserve
pages currently posted by CP a being resident.
I/O Count Total of SPOOLED and non-SPOOLED I/O s Starts
initiated by this virtual machine since LOGON time.
Guest Virtual Machine Microscope -- VMDBK
Virt Total CPU Percent of real interval time that this guest was
charged as having CPU activity for emulation and
chargeable CP service time (TTIME)
(Not divided by number of active CPUs)
Virtual Percent of real interval time that this guest was
Supervisor charged as being in the virtual Supervisor State,
or had supervisor services performed on its behalf.
Virtual (VMDVTIME) Percent of real interval time that was calculated
Problem as being in the virtual Problem State.
Time Slice Used Field(1) shows the total amount of the CPU time for
all CPs charged to the Guest for the interval.
Field(2) shows the total amount of virtual Emulation
time for all CPs charged to the Guest for the interval.
Note: Supervisor and Problem states are based upon
TIME SLICE USED, which is updated by CP on an
irregular basis, and wall clock time, which is
updated on a regular basis by the hardware.
Total I/O Count Total of spooled and non-spooled I/O STARTs
initiated by this virtual machine since logon.
Virtual Size Size of Guest in megabytes.
Real Pages Number of real pages currently resident in main memory
Resident and assigned to this user.
Projected Size of working set less any reserved pages that CP
Working Set Size projects for this virtual machine. Used by CP for
mgt of real storage and adjust multiprogram levels.
Reserved Number of real pages currently reserved for user.
Locked Number of real pages currently locked for user.
This includes CP command locked and I/O locking.
CPU Share Weight of CPU share assigned by directory entry or
CP command to this virtual machine. Used by CP in
determining relative position in DISPATCH list.
Number of CPUs Number of virtual CPUs defined (Number of VMDBKs)
List Residency Type of scheduler list user is currently occupying.
Interval XSTORE Expanded storage pages accessed during interval.
Interval Paging Number of pages paged-in or paged-out for this user
during the last sampling interval.
Interval Spooling Number of spool pages paged-in or paged-out
for this user during the last sampling interval.
Last Virtual Virtual device that was target of the last START I/O
I/O Device initiated by this virtual machine.
Last CP Command Last CP command issued by this USER.
User PSW Current PROGRAM STATUS WORD set by this virtual
machine. When this user is re-dispatched execution
will begin with the loading of this PSW (with some
alterations) by CP. Base VMDBK.
General Current GENERAL REGISTERS stored for Base VMDBK at
Registers the end of its last time slice.
Control Current CONTROL REGISTERS stored for Base VMDBK at
Registers the end of its last time slice. CR0 and CR1
VMDDLCTL Dispatch List controls status.
VMDDLCTX Dispatch List controls status (extension of VMDDLCTL)
VMDWVDEV Virtual device waiting, if any, for a response from the
I/O Subsystem.
VMDIOACT Number of I/Os outstanding.
VMDVMDWU Number of FREE STORAGE frames attached to guest.
VMDQ1SUM Number of transactions performed in dispatch Q1.
VMDQSUMS Number of transactions performed in other than Q1.
Real Storage Frame Assignments -- VMSTORAG
Non_Pageable Number of page frames locked in real storage by CP,
(ie. locked for I/O processing)
Pages Shared number of page frames in real storage marked
as being used by Discontiguous Shared Segments.
Pages Reserved number of page frames in real storage marked
as being reserved for particular virtual machines.
Nuc Number of page frames in real storage used by the resident
VM Control Program nucleus.
Storage Utiliz Percent of page frames used by PROBLEM tasks.
(Sum of the In-Queue Working Sets + Reserved Frames
+ Shared Pages)/(Number of real page frames)
Free Storage Current number of FREE STORAGE pages extended into
Extended the Dynamic Paging Area.
Page Reads Page frames read into main storage in last interval.
Page Writes Page frames written to aux storage in last interval.
Notice more page reads occur than page writes due to
the fact that if a page in memory has remained
unchanged since pagein then it is not necessary to
refresh the copy on the paging DASD.
Dynamic Paging Number of available page frames in the DPA.
Memory Size Real memory size.
Interval Duration of last sample interval.
Working Set Sum of the working sets of the current in-queue
Sums users for the last sampling interval.
Device Activity -- VMDEVICE
VOLSER -- Volume serial if device is a DASD.
Subchan Addr -- Subchannel designation assigned by CP
CCUU-Address -- Logical channel.channel.unit.unit address of primary
I/O path assigned by CP
Device -- Type of peripheral device.
I/O Count -- Number of I/O Starts to this device since ONLINE.
CylAddr -- Current cylinder address of DASD as posted by VM at
last sampling interval.
IntervalI/O -- Number of I/O to this device last interval.
%Devio -- Ratio of I/Os to this device versus total I/O to all
devices in the last sampling interval expressed as a
percent.
Real Device Block Microscope -- RDEV
Device -- SCP device address selected for monitoring.
Utilization -- Percent of time device selected is busy with work.
K * (Connect + Disconnect) / Interval
Connect -- Percent of time device selected is connected to the
channel.
K * Connect / Interval
Path Interface-- I/O Subsystem CHPID assignment.
'O' indicates path is ONLINE.
I/O -- Interval and Cummulative counts for start subchannel,
solicited, unsolicited and missing interrupts.
and number of I/Os queued.
I/O Rate -- Current sampled rate of I/Os being performed per sec.
Service Time -- Calculation of the time required to perform a single
I/O. T = difference(Connect+Disconnect)/Interval
DEVICE FLAG -- Current disposition of device.
Device Type -- IBM device designation
CYL Address -- If DASD, the current cylinder address at last SEEK.
VOLSER -- If DASD, the volume serial.
RDEVAFLG -- *
RDEVDFLG -- *
RDEVRFLG -- *
Virtual Device Block Microscope -- VDEV
Device -- Virtual Users device address selected for monitoring.
I/O -- Interval and Cummulative counts for Actual I/Os
performed by CP, I/O initiated by the Guest and
I/Os that were unneeded due to residency in the
minidisk caching system, and I/Os that were split
into multiple I/Os by CP.
I/O Rate -- Current sampled rate of I/Os being performed per sec.
Device Type -- IBM device designation
CYL Address -- If DASD, the virtual cylinder address at last SEEK.
Head Address -- If DASD, the virtual head address at last SEEK.
Program Product Limitations and Exceptions
* * * VMRSM Known Problem Areas and Constraints * * *
The CPU Activity calculation for the system is not always in agreement
with the result of the CP INDICATE command, however as of this writing
it is in synchronization with the IBM product VM RTM/SF. This is most
apparent when running VM under Logical Partition (LPAR).
Calculation of time displacements are done by the monitor on a strictly
cyclic basis using timer information presented by CP. However, CP
does not necessarily update the virtual timers on a strict cyclic
basis that is synchronized with the monitor task's sampling.
Certain interrupts and PRIV OPS force virtual timer updating when
the machine is redispatched. Therefore, virtual states in excess of
100 percent may occur due to the timers being refreshed with a
displacement that exceeds the sampling interval displacement.
This problem will appear in the VMUSERS display where the total CPU
Usage for all the machines MAY EXCEED 100 Percent, and in the VMDBK
display where virtual problem state exceeds virtual CPU active state.
This product's ability to show performance data accurately when VM is
running under LPAR is limited as it would be under second level VM.
Monitor OVH field on VMSYSTEM display not valid when repeatedly hitting
the ENTER key. The ENTER interrupt disturbs the sleep interval value.
FBA DASD devices in the VMDEVICE display show Cylinder Location instead
Block Location of the R/W Head. This is what appears in the Real Device
Block information.
Channel utilization is assumed to be balanced over all online channel
paths marked available by the Real Device Logical Path Mask.
The VMUSERS display is dependent on VM's designation of some user as
the OPERATOR. If no OPERATOR is present this routine may enter a
CPU loop.
Performance Monitor Error Messages
RSMDIA001 INVALID VM PRIVILEGE CLASS, REQUIRE E OR C
Program Check Interruption occurred during execution
Monitor requires ability to execute VM Diagnose Code
X'04' to examine real storage.
RSMDIA002 PRODUCT EXPIRATION OCCURRED, CONTACT CTS
The expiration date for this version or for the
licensing period has been reached. Contact CTS for
another licensed tape copy of the product.
Screen Writer Error Messages
RSMSCRFFF UNSPECIFIED ERROR, CALL TECH SUPPORT
RSMSCR007 SCREEN CHARACTERISTICS UNDETERMINED
Write to display logic was unable to determine the
characteristics of this particular terminal type or
the Write Structured Field Query Reply returned
erroneous data.
RSMSCR00A SCREEN NOT OPERATIONAL
Terminal screen is not functioning or un-supported.
RSMSCR00B FATAL CHANNEL PROBLEM
Problems with path thru channel as posted by CSW.
RSMSCR00D UNIT CHECK DURING SCREEN WRITE
Diagnose write to screen failed and unit check was
posted in the Channel Status Word.
RSMSCR00E PROGRAM TEST ERROR
Force error by test code.
RSMSCR00F PROGRAMMING ERROR IN RC HANDLING
Program code either does not have a routine to handle
the event of this return code being posted.
==> Command Line
V M / R S M Channel Path Utilization Diagnostics Interval = 19.270 Sec
CHPID <50----+---40----+---30----+---20----+---10----+----0 Percent
1F <<<<<<<<<<<<<<<<<<<<<<<<< 25.78
2F <<<<<<<<<<<<<<<<<<<<<<<<< 25.78
38 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 40.22
48 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 40.22
54 << 2.04
74 << 2.04
62 <<<<< 6.31
6C <<<<< 6.31
A4 <<<<<<<<<<<<<< 14.97
C4 <<<<<<<<<<<<<< 14.97
B2 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 36.95
E2 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 36.95