CICS Debugging Basics

Download as pdf or txt
Download as pdf or txt
You are on page 1of 51
At a glance
Powered by AI
The key takeaways from the document are that it discusses IPCS basics for debugging CICS including needed components, common commands, different types of dumps, and CICS verbexits.

The different types of dumps discussed are SLIP dumps, console dumps, and CICS dumps.

Some common IPCS commands mentioned are CBFormat, DESCRIBE, FIND, FORMAT, and LIST.

IBM Software Group

CICS Debugging Basics

Sarah Bertram and Charlie Wiese CICS Level 2 Support

WebSphere Support Technical Exchange

IBM Software Group

Agenda
IPCS Basics Whats needed Commands CICS verbexit Types of Dumps SLIP dumps Console dumps CICS dumps CICS verbexit samples CICS References

WebSphere Support Technical Exchange

IBM Software Group

IPCS Basics

WebSphere Support Technical Exchange

IBM Software Group

Basics: Whats Needed


TSO ID
Logon Size parameter should be 16MB or larger

Define and Initialize IPCS Dump directory


Create a VSAM dataset for directory Allocate as FILE(IPCSDDIR) Refer to z/OS IPCS Users Guide

CICS verbexit: DFHPDxxx


Must reside in a dataset which has been added to the LINKLST or an IPCS STEPLIB or TASKLIB CICS-specific IPCS configuration description can be found in the CICS Operations and Utilities Guide

Version CICS/TS 2.2 CICS/TS 2.3 CICS/TS 3.1 CICS/TS 3.2

Verbexit DFHPD620 DFHPD630 DFHPD640 DFHPD650

WebSphere Support Technical Exchange

IBM Software Group

Basics: IPCS Primary Menu


------------------- IPCS PRIMARY OPTION MENU OPTION ===> 0 1 2 3 4 5 6 T X DEFAULTS BROWSE ANALYSIS UTILITY INVENTORY SUBMIT COMMAND TUTORIAL EXIT --------------------------------******************** * USERID - JOEUSER * DATE - 07/09/06 * JULIAN - 07.249 * TIME - 16:20 * PREFIX - JOEUSER * TERMINAL- 3278 * PF KEYS - 24 ******************** Specify default dump and options Browse dump data set Analyze dump contents Perform utility functions Inventory of problem data Submit problem analysis job to batch Enter subcommand, CLIST or REXX exec Learn how to use the IPCS dialog Terminate using log and list defaults

Enter END command to terminate IPCS dialog

F1=HELP F8=DOWN

F2=SPLIT F9=SWAP

F3=END F10=LEFT

F4=RETURN F5=RFIND F11=RIGHT F12=CURSOR

F6=MORE

F7=UP

WebSphere Support Technical Exchange

IBM Software Group

Basics: Dump Selection


On the IPCS Primary Options menu
Select option 0 Enter dump dataset name (format shown below) ------------------------- IPCS Default Values --------------------------------Command ===> You may change any of the defaults listed below. The defaults shown before any changes are LOCAL. Change scope to GLOBAL to display global defaults. Scope ==> BOTH (LOCAL, GLOBAL, or BOTH)

If you change the Source default, IPCS will display the current default Address Space for the new source and will ignore any data entered in the Address Space field. Source ==> DSNAME(YOUR.DUMP.DATASET.NAME) Enter your dump dataset name Address Space ==> Message Routing ==> PRINT TERMINAL Message Control ==> CONFIRM VERIFY FLAG(WARNING) Display Content ==> NOMACHINE REMARK REQUEST NOSTORAGE SYMBOL Press ENTER to update defaults. Use the END command to exit without an update.

WebSphere Support Technical Exchange

IBM Software Group

Basics: MACHINE vs. NOMACHINE


Specifying display content of MACHINE Displays the ASID, virtual address and storage key Here is an example:
command ===> ip l 7000 length(20) LIST 7000. ASID(X'0396') LENGTH(X'14') AREA ASID(X'0396') ADDRESS(7000.) KEY(88) 00007000. 02386EC4 C6C8D2C5 D2C3C240 40404040

Note key of 88
A5900400

Specifying display content of NOMACHINE Displays just the storage area Here is an example:
command ===> ip l 7000 length(20) LIST 7000. ASID(X'0396') LENGTH(X'14') AREA 00007000. 02386EC4 C6C8D2C5 D2C3C240 40404040

A5900400

WebSphere Support Technical Exchange

IBM Software Group

Basics: Common IPCS commands


CBFormat format a control block RTCT STR(TODCLOCK) EQuate - create user-defined symbol Find - search for a value List Sliptrap storage address Title RETP - retrieve previous commands SELECT display ASID information All Current ASID STATUS REGS SYS VERBX Verbexit DFHPDxxx (where xxx is the CICS release) MTRACE

WebSphere Support Technical Exchange

IBM Software Group

Basics: ST (System Status) command


===>ST SYS provides information about the Time of dump, and the Dump Requester In a SLIP dump
SYSTEM STATUS: Nucleus member name: IEANUC01 I/O configuration data: IODF data set name: IODFST.IODF26 IODF configuration ID: B710 EDT ID: A1 Sysplex name: UTCPLEXA TIME OF DAY CLOCK: C015FFD5 DE97C417 TIME OF DAY CLOCK: C01642E4 01D7C417 Program Producing Dump: SLIPDUMP Program Requesting Dump: IEAVTSDT

01/31/2007 05:51:44.839036 local 01/31/2007 10:51:44.839036 GMT

In a Console dump
SYSTEM STATUS: Nucleus member name: IEANUC01 I/O configuration data: IODF data set name: SYS1.IODF03 IODF configuration ID: PLX1 EDT ID: P1 Sysplex name: SYSPLEX1 TIME OF DAY CLOCK: C1289889 1C88A7F9 09/06/2007 15:33:51.602826 local TIME OF DAY CLOCK: C1288B1F E248A7F9 09/06/2007 14:33:51.602826 GMT Program Producing Dump: SVCDUMP Program Requesting Dump: IEAVTSDT Incident token: SYSPLEX1 MV23 09/06/2007 14:34:10.614280 GMT

The MVS image issuing the dump request is MV23, a member of sysplex SYSPLEX1

WebSphere Support Technical Exchange

IBM Software Group

Basics: ST (System Status) continued


===>ST SYS In a CICS Initiated SDUMP
SYSTEM STATUS: Nucleus member name: IEANUC01 I/O configuration data: IODF data set name: SYS1.IODF03 IODF configuration ID: PLX1 EDT ID: P1 Sysplex name: SYSPLEX1 TIME OF DAY CLOCK: C1288161 516B0239 09/06/2007 13:50:15.860912 local TIME OF DAY CLOCK: C12873F8 172B0239 09/06/2007 12:50:15.860912 GMT Program Producing Dump: SVCDUMP Program Requesting Dump: DFHKETCB Incident token: SYSPLEX1 MV23 09/06/2007 12:50:34.446615 GMT

WebSphere Support Technical Exchange

10

IBM Software Group

Basics: Which ASIDs were dumped?


To identify which address spaces are contained in the dump you need to format the Recovery Termination Control Table (RTCT), as in the following example: ===> CBF RTCT
RTCT: 00F51DB0 +0000 NAME..... +0018 FASB..... +002C DSV...... +0044 ADG4..... +005C DIND..... +0074 RPAR..... +00A8 MSRB..... +00C4 +00E2 ECPU..... +00F8 SDO...... +010A ZZZ3..... SDAS ---0396 000F 0000 0000 RTCT 00000000 00C43D98 00E035A0 026C0360 01761FD8 00F64460 00000000 0000 5FA20000 4000 SDF4 ---A0 80 00 00 SAP...... NAS...... SSTK..... ADG5..... DIRS..... BPXP..... TEST..... 00000000 EASD..... SDNA..... 2FD0BE00 00000002 00000000 80E038AC 026C0730 00000000 00000000 00000000 0000 02 SUP...... EEDA..... ADGL..... TABG..... SDAT..... TABO..... SEQ#..... 00000000 ETIM..... INDX..... 00100000 02875AA8 00E03470 80D80100 026B3D80 00CF2008 1346 00000000 00000000 01 SYD...... SDDS..... ADG1..... TABQ..... SMOD..... SDPL..... SDSW..... 00000000 SAO...... SDPR..... FF800000 00000000 00E03510 80D8011E 026C01C0 026B3CC8 0268F000 2FD0BE00 00 SDLA..... SDDC..... ADG2..... TABR..... SCON..... FMT...... TDCB..... SDWK..... SUO...... BUFV..... 0000 0000 00E03520 80D80160 029B3028 00000000 00000000 00C43E68 00100000 00000000

001 002 003 004

SDF5 ---00 00 00 00

The address spaces contained in this dump are: 0396 and 000F

WebSphere Support Technical Exchange

11

IBM Software Group

Basics:

What Jobname corresponds to those ASIDs?

The SELECT ALL command lists, in address space order, all jobs in the system at the time the dump was taken. It is important to note the dump does not contain all jobs listed. Using the IPCS SELECT command SELECT ALL - ASID to Jobname Cross Reference
ASID ---0001 0002 0003 0004 0005 000F 0395 0396 0398 JOBNAME -------*MASTER* PCAUTH RASP TRACE DUMPSRV OMVS ASCBADDR -------00FD4600 00F4E080 00FB0980 00FB0800 00FB0680 00FB0B80 SELECTION CRITERIA -----------------ALL ALL ALL ALL ALL ALL ALL ALL ALL

BPXAS 00F0D900 CICSCWAA 00FBBF80 U0230254 00F77280

WebSphere Support Technical Exchange

12

IBM Software Group

Basics: SELECT continued


The SELECT CURRENT command lists the job which was executing at the point in time the dump was initiated. If the dump was issued via console dump command, the SELECT CURRENT command will display the Master scheduler address space.
SELECT CURRENT
ASID JOBNAME ASCBADDR SELECTION CRITERIA ---- -------- -------- -----------------0396 CICSCWAA 00FBBF80 CURRENT

The SELECT ASID() command lists the specific ASIDs requested


SELECT ASID(x000f,x0396)
ASID JOBNAME ASCBADDR SELECTION CRITERIA -----------------ASID ASID ---- -------- -------000F OMVS 00FB0B80 0396 CICSCWAA 00FBBF80

WebSphere Support Technical Exchange

13

IBM Software Group

Basics: Format Store Clock fields


IPCS CBF address STR(TODCLOCK)
DFHL2BLOCK contains a timestamp at offset x'24' 0000 6EC4C6C8 * >DFH* 0004 D3F2C2D3 D6C3D240 00000000 00000120 *L2BLOCK ........* 0014 00000000 00307CE8 80800000 00000002 *......@Y........* 0024 C1287308 54098CB9 131C0A00 0000FA00 *A...............* 0034 131C0A9D C4C6C8D3 D6C74040 01010000 *....DFHLOG ....* 12FBD10C 12FBD110 12FBD120 12FBD130 12FBD140

IPCS CBF 12fbd130 STR(TODCLOCK) produces


TODCLOCK: 00000000 09/06/2007 12:46:04.451992

Another option is to equate the address of the blocktime to a symbol; first list the address (in browse mode, command => L 12fbd130)
ASID(X'0040') ADDRESS(12FBD130.) STORAGE ---------------------------------Command ===> 12FBD130 12FBD140 12FBD150

eq blocktime
54098CB9 C4C6C8D3 00000000 131C0A00 D6C74040 00000000 0000FA00 01010000 00000000 | A............... | | ....DFHLOG .... | | ..9............. |

C1287308 131C0A9D 0000F9CC

cbf blocktime str(todclock) then produces the same results


TODCLOCK: 00000000 09/06/2007 12:46:04.451992

WebSphere Support Technical Exchange

14

IBM Software Group

Basics: RETP command


RETP command
ISPF command which displays the last 25 commands entered (both IPCS and ISPF) may be entered from either the IPCS or ISPF command line
------------------------ IPCS PRIMARY OPTION MENU ---------------------------Retrieve Options Help ******************** dump and options * USERID - JOEUSER ISPF Retrieve Panel set * DATE - 07/09/06 tents * JULIAN - 07.249 Select the command nalysis job to batch * TIME - 15:02 to be retrieved , CLIST or REXX exec * PREFIX - JOEUSER More: + functions * TERMINAL- 3278 1. cbf blocktime str(t> ntory * PF KEYS - 24 2. eq blocktime is ******************** 3. =1 the IPCS dialog 4. ip l 12fbd130 log and list defaults 5. IPCS CBF 12fbd130 S> 6. ipcs cbf 12fbd134 s> dialog 7. ipcs cbf 12fbd124 s> 8. f dfhl2block 9. f dfhl2 10. verbx dfhpd640 'lg=> 11. ip select asid(x'40> 12. cbf rtct 13. st sys

WebSphere Support Technical Exchange

15

IBM Software Group

Basics: Verbexit options


Keyword Functional area Keyword Functional area AI = 0|2 Autoinstall Model Manager AP = 0|1|2|3 Application Domain APS= <TASKID=nnnnn> AU = 0|2 CICS affinities utility BA = 0|1|2|3 Business application manager BR = 0|1|2|3 3270 bridge CC = 0|2 CICS catalog domain CP = 0|2 Common Programming Interface CQ = 0|1|2 Auto install model manager CSA= 0|2 CICS Common System Area DB2= 0|1|2|3The CICS DB2 interface DD = 0|1|2|3 Directory Domain DH = 0|1|2|3 Document handling domain DLI = 0|2 CICS DL/I Interface DM = 0|1|2|3 Domain Manager DP = 0|1|2|3 Debug Profiles manager DS = 0|1|2|3 Dispatcher Domain DU = 0|2 Dump Domain EJ = 0|1 Enterprise JAVA EM = 0|1|2|3 Event manager domain for BTS FCP= 0|2 File Control Program FT = 0|1|2|3 CICS WEB Interface ICP = 0|2 Interval Control Program IE = 0|1|2|3 IP ECI Domain II = 0|1|2|3 IIOP IND= 0|1|2|3 Page number indexes for output JCP= 0|2 Journal Control Program KE = 0|1|2|3 CICS Kernel LD = 0|1|2|3 Loader Domain LG = 0|1|2|3 Logger Domain LM = 0|1|2|3 Lock Manager domain ME = 0|2 Message domain MN = 0|1|2|3 Monitoring domain MRO= 0|2 CICS Multi-Region Operation NQ = 0|2 Enqueue Manager OT = 0|1|2|3 Object Transaction Domain (610) PA = 0|2 Parameter manager domain PCP= 0|2 Program Control Program PCT= 0|2 Program Control Table PG = 0|1|2|3 Program Manager Domain PI = 0|1|?? Pipeline Domain (640) PR = 0|2 Partner Resource management PT = 0|1|2|3 Partner Domain (620) RD = 0|2 Resource definition manager RM = 0|2 Recovery Management RX = 0|1|2|3 Recoverable EXCI domain RZ = 0|1|2|3 Request Streams (610) SH = 0|1 Scheduler services domain for BTS SJ = 0|1|2|3 JVM Domain (610) SM = 0|1|2|3 Storage Manager domain SO = 0|1|2|3 Sockets domain SSA= 0|2 Static Storage Areas ST = 0|1|2|3 Statistics domain SZ = 0|1 Front End Programming Interface TCP= 0|1|2|3Terminal Control Program TDP= 0|1|2|3Transient Data Program TI = 0|1|2|3 Timer domain TMP= 0|2 Table Manager Program TR = 0|1|2|3 Trace domain TRS= <trace selection parameters> TS = 0|1|2|3 Temporary Storage Program UEH= 0|2 User Exit Handler US = 0|1|2|3 User Domain WB = 0|1|2 The web interface XM = 0|1|2|3 The transaction manager XRF= 0|2 The extended recovery facility XS = 0|1 Security Domain

(630) (610)

(620)

WebSphere Support Technical Exchange

16

IBM Software Group

Basics: Verbexit options notes


CICS Transaction Server is based on domain architecture. Each domain encapsulates the code and control blocks for a given function. Access to the data belonging to a given domain is via the domain interface. Each domain, with the exception of the application domain (AP), is responsible for a given CICS function. All domains are contained in each CICS address space. For example, the Catalog domain (CC) is responsible for the data content and access to the CICS local and global catalogs. When other domains require access to information managed by the catalog domain, it is obtained using a catalog domain call. The exception to the rule is the Application domain which defines the environment for application execution. The Application domain includes file control (FCP), terminal control (TCP), and Multi-region operation (MRO) which are not yet full domains, but have separate formatting routines. To format the control blocks and data, there are normally three levels of detail available as noted in the chart on the prior page: 1. Summary only 2. Full Control Block formatting 3. Both 1 and 2 Note: If you omit the level number, it defaults to level 3 for those components that have a summary, and level 2 for those that do not. Specifying Level=0 suppresses the listing for that component. Also note, as new function is introduced, or significantly changed, the release is identified in the chart. For example the Pipeline (PI) domain was introduced in R640 (CICS/TS R3.1). The CICS Problem Determination Guide (Appendix A) contains two cross reference listings providing the control blocks formatted by IPCS keyword and the IPCS keyword used to format a given control block.

WebSphere Support Technical Exchange

17

IBM Software Group

Types of Dumps

WebSphere Support Technical Exchange

18

IBM Software Group

Types of Dumps: SLIP


To list the name of the dump, issue the LIST command,
LIST TITLE SLIP DUMP ID=xxxx

To see the slip command that corresponds to the dump, issue:


LIST SLIPTRAP SLIP SET,MSGID=DFHEJ0102,JOBNAME=CICSTST1,ACTION=SVCD,ID=3001, JOBLIST=(OMVS,CICSTST1),DSPNAME=('OMVS'.*,'CICSTST1'.*),M L=1

In this example, the slip triggered on CICS console message DFHEJ0102 and dumped the CICSTST1 and OMVS address spaces and data spaces.

WebSphere Support Technical Exchange

19

IBM Software Group

Types of Dumps: SLIP (registers)


Registers at the time the SLIP triggered
ST REGS
CPU STATUS: PSW=470C2000 8185FB36 (Running in PRIMARY, key 0, AMODE 31, DAT ON) ENABLED FOR PER I/O EXT MCH ASID(X'0396') 0185FB36. IEANUC01.IEAVTSMG+0476 IN READ ONLY NUCLEUS ASCB918 at FBBF80, JOB(CICSTST1), for the home ASID ASXB918 at 8FDD00 for the home ASID. No block is dispatched HOME ASID: 0396 PRIMARY ASID: 0396 SECONDARY ASID: 0396 General 0-1 2-3 4-5 6-7 8-9 10-11 12-13 14-15 purpose register values 00000001_0185FFC0 00000000_0406F000 00000000_7F4EAF64 00000000_7F4EAF6C 00000000_00000000 00000000_00000000 00000000_7F4EB334 00000000_7F4EAF04 00000000_00000000 00000000_00000001 00000000_7F4EAF08 00000000_00000000 00000000_0185FFC0 00000000_7F4EB290 00000000_8185FAF8 00000003_00000008

WebSphere Support Technical Exchange

20

IBM Software Group

Types of Dumps: Console dump


Title supplied by the operator in the dump command
DUMP COMM=('DUMP OF HUNG CICS REGION') *02 IEE094D SPECIFY OPERAND(S) FOR DUMP COMMAND R 02,JOBNAME=CICSTST1,END IEE600I REPLY TO 02 IS;JOBNAME=CICSTST1,END

The first time you look at the dump, you will see the following:
TIME-03:36:15 PM. CPU-00:00:02 SERVICE-81484 SESSION-02:50:26 SEPTEMBER 6,2007 Initialization in progress for DSNAME('DUMP.MV01.#MASTER#.D070906.T153350.S00289') TITLE='DUMP OF HUNG CICS REGION'

The title can be viewed using the LIST TITLE command

ST REGS produces registers for ASID 1 (*Master*)


These are not meaningful registers for a console dump.

WebSphere Support Technical Exchange

21

IBM Software Group

Types of Dumps: MVS dump options


SDATA
If you request a CICS dump using CEMT PERFORM SNAP You will not have to set any specific SDATA dump parameters because the dump would be taken by CICS, which will supply its own parms. If you request a Console dump you should insure the following SDATA parameters are supplied: ALLPSA, SQA, SUMDUMP, NUC, RGN, LPA, TRT, CSA, GRSQ These can be specified using the SDATA parameter in the dump request, as in the following example: DUMP COMM=(dump title goes here) R nn,JOBNAME=(region-name), SDATA=(PSA,SQA,SUM,NUC,RGN,LPA,TRT,CSA,GRSQ),end

WebSphere Support Technical Exchange

22

IBM Software Group

Types of Dumps: CICS Dump


The Title of a CICS Dump identifies the type of dump:
L TITLE TITLE=CICS DUMP: SYSTEM=IYNX30 CODE=SR0001 ID=1/0004

Dump Summary
Produced from each of the CICS Verbexit commands Provides high-level diagnostic information

VERBX DFHPD640 KE=3 === DUMP SUMMARY DUMPID: 1/0004 DUMPCODE: SR0001 DATE/TIME: 6/09/07 13:50:14 (LOCAL) MESSAGE: DFHSR0001 IYNX30 An abend (code 0C7/AKEA) has occurred at offset X'00000434' in program SECNDPGM. SYMPTOMS: PIDS/5655M1500 LVLS/640 MS/DFHSR0001 RIDS/DFHSRP PTFS/UK05645 AB/S00C7 AB/UAKEA RIDS/SECNDPGM ADRS/00000434 TITLE: (None) CALLER: (None) ASID: X'0040'

WebSphere Support Technical Exchange

23

IBM Software Group

CICS Verbexit samples

WebSphere Support Technical Exchange

24

IBM Software Group

CICS Verbexit - Introduction


This section will illustrate a variety of common CICS Verbexit commands, using a CICS System Dump produced from the following error message:
DFHSR0001 IYNX30 An abend (code 0C7/AKEA) has occurred at offset X'00000434' in program SECNDPGM.

WebSphere Support Technical Exchange

25

IBM Software Group

Verbx DFHPD640 KE=3


Kernel Domain
Issue: F *Running To locate the task in error look for a *YES* in the ERROR column
===KE: Kernel Domain KE_TASK Summary KE_NUM KE_TASK 0001 0002 0003 0004 0005 0006 0007 0008 0009 000A 0044 0045 0046 0048 11F6FC00 11F6F800 11F6F400 11F6F000 11F8CC00 11F8C800 11F8C400 11F8C000 11FA9C00 11FA9800 STATUS KTCB Step KTCB QR KTCB RO KTCB FO Not Running KTCB L8001 KTCB SL Not Running ***Running** Not Running TCA_ADDR TRAN_# TRANSID DS_TASK 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 122AA680 00003 00000000 12203030 12203148 12203260 121B2080 122038F0 12203490 121B2500 121B2680 121D7500 KE_KTCB 11FB2000 11FB5000 11FB4000 11FB3000 11FB4000 121C2000 121E7000 11FB5000 121BC000 121E7000 ERROR

CSOL OOPS

12ECC880 ***Running** 122AD680 00064 12EE2080 Unused 12EE2480 Unused 12F6A480 Not Running

3164E080 11FB5000 *YES*

122AB680 00019

CFQS

121B2380 11FB5000

Take note of the KE_NUM, TRAN #, and TRANSID

WebSphere Support Technical Exchange

26

IBM Software Group

Verbx DFHPD640 KE=3


Stack entries for KE_NUM 0044
Issue: F 0044
KE_NUM 0044 0044 0044 0044 0044 0044 0044 0044 0044 0044 @STACK 12EDB020 12EDB150 12EDB480 12EDB9B0 LEN 0130 0330 0530 0600 TYPE Bot Dom Dom Dom Int Dom Int Lifo Dom Int Dom Int Int Sub Dom Int Int Int Dom Int Int ADDRESS 91E01A00 91E19DC0 91E3F698 9249BCB0 +02D4 9264E270 +24DC 12669B10 92490360 +04F4 9264E270 +3132 +2F0A 9228FEB0 91E84748 +3526 +165A +3F62 91F1B060 +0B16 +1924 LINK REG 91E01DAC 91E19FC8 91E40690 9249CC60 9249BE38 92669D56 9264EDF6 9266AF0E 924916E8 92490516 9229281E 9264EDEE 926526F6 92290F6A 91E88782 91E849C8 91E87D5C 91E85EBC 91F1BCD4 91F1B250 91F1BFA4 OFFS ERROR NAME 03AC DFHKETA 0208 DFHDSKE 0FF8 DFHXMTA 0FB0 DFHPGPG 0188 INITIAL_LINK 0000 DFHAPLI1 0B86 CICS_INTERFACE 13FE DFHEPC 1388 DFHPGLE 01B6 LINK_EXEC 0000 *YES* DFHAPLI1 0B7E LE370_INTERFACE 4486 INVOKE_FOR_RECURSION 10BA DFHSRP 403A DFHMEME 0280 SEND 3614 CONTINUE_SEND 1774 TAKE_A_DUMP_FOR_CALLER 0C74 DFHDUDU 01F0 SYSTEM_DUMP 0F44 TAKE_SYSTEM_DUMP

12EDBFB0 0CD0 12EDCC80 0D60 12EDD9E0 0770 12EDE150 0CD0 12EDEE20 04C0 12EDF2E0 0E90

0044

12EE0170 0630

WebSphere Support Technical Exchange

27

IBM Software Group

Verbx DFHPD640 KE=3 notes


Task 64 has abended 0C7. There are a number of domains which have knowledge of task 64, but the kernel is always a good place to begin. The summary information indicates task 64 was running at the time of the abend. It's associated with kernel ke_num 0044 and the transaction ID is OOPS. Issuing a find for '0044 ' positions the cursor at the same line, issue a repeat find to locate the kernel stack entries for ke_num 0044 (note there may be additional hits before the stack entries are reached). Kernel stack entries are used for internal CICS modules, they're a combination register save area and working storage for the module. When control passes to another CICS module, a new stack entry is built and registers 14 through 12 are saved starting at offset x'C' into the stack of the module making the call. In the case of ke_num 0044, the stack labeled in error is for module DFHAPLI1. DFHAPLI1 is the module which causes the user application to be given control, it indicates control has been given to the user application program.
KE_NUM @STACK 0044 LEN TYPE ADDRESS 9264E270 +3132 +2F0A 9228FEB0 91E84748 LINK REG OFFS ERROR NAME 9229281E 9264EDEE 926526F6 92290F6A 91E88782 0000 *YES* DFHAPLI1 0B7E LE370_INTERFACE 4486 INVOKE_FOR_RECURSION 10BA DFHSRP 403A DFHMEME 12EDE150 0CD0 Dom Int Int 12EDEE20 04C0 Sub 12EDF2E0 0E90 Dom

0044 0044

WebSphere Support Technical Exchange

28

IBM Software Group

Verbx DFHPD640 KE=3


Kernel Error Table
Issue: F 'Error Table
==KE: KE Domain Error Table Summary ERR_NUM ======= 00000001 00000002 00000003 00000004 00000005 00000006 00000007 00000008 ERR_TIME ======== 13:47:37 13:47:37 13:47:37 13:47:37 13:47:37 13:48:08 13:48:08 13:50:12 KE_NUM ====== 0044 0044 0044 0044 0044 0044 0044 0044 ERROR TYPE ========== TRAN_ABEND_PERCOLATE TRAN_ABEND_PERCOLATE TRAN_ABEND_PERCOLATE TRAN_ABEND_PERCOLATE TRAN_ABEND_PERCOLATE TRAN_ABEND_PERCOLATE TRAN_ABEND_PERCOLATE PROGRAM_CHECK ERR_CODE ======== ---/ATCH ---/ATCH ---/ATCH ---/ATCH ---/ATCH ---/AEIP ---/AEIP 0C7/AKEA MODULE ====== DFHPCP DFHZARQ DFHETC DFHCSAOF DFHEPC DFHPCP DFHEIP DFHYI640 OFFSET ====== 000005E0 00002650 00000EA0 00000048 00000246 000005E0 00002498 00000434

WebSphere Support Technical Exchange

29

IBM Software Group

Kernel Error Table notes


The Kernel error table is a wrap-around table that holds the most recent errors (up to 50 entries). Error numbers are assigned consecutively (in hex) by the kernel, starting from 00000001. The error number tells you the number of program checks and system abends that have occurred for this run of CICS. Not all of them have necessarily resulted in a system dump. You usually will want to focus on the most recent program check, in this example we will focus on error number 00000008. Examine the kernel error data -- there are a number of methods which can be used to locate the kernel error entries. I like to issue the command F number: 00000008

WebSphere Support Technical Exchange

30

IBM Software Group

Verbx DFHPD640 KE=3


Kernel Error data
Issue: F 'NUMBER:
=KE: Error Number:

00000008'

note there are 2 spaces between ':' and '0'

00000008

KERRD 11F69348 KERNEL ERROR DATA


0000 0020 0040 F0C3F761 C1D2C5C1 018400C7 0000FFFF 122AD680 12ECC880 00000008 00000000 00060007 00000000 93E00704 90000838 C4C6C8C1 D7D3C9F1 1264E270 3164E080 FF950007 00000000 079D1000 93E00704 1300B208 13009F98 1300B270 13E006B4 *0C7/AKEA.d.G....DFHAPLI1..S...\.* *..O...H..........n..........l\..* *........l\.............q.....\..*

Error Code: Date (GMT) : Date (LOCAL) : KE_NUM: 0044 0C7/AKEA 06/09/07 06/09/07 KE_TASK: Error Type: PROGRAM_CHECK Timestamp: C12874082F64C2FB

Time (GMT) : Time (LOCAL) : 12ECC880

12:50:32.737356 13:50:12.737340 122AD680 DS_TASK: 3164E080

TCA_ADDR:

Error happened in program DFHYI640 at offset 00000434 Error happened under the CICS RB.

WebSphere Support Technical Exchange

31

IBM Software Group

Verbx DFHPD640 KE=3


PSW and registers
CICS Registers and PSW. PSW: 079D1000 93E00704 Instruction Length: 6 Interrupt Code: 07 Exception Address: 00000000 Execution key at Program Check/Abend: 9 Space at Program Check/Abend: Basespace REGISTERS 0-15 REGS 11F69398 0000 0020 1300B208 13009F98 1300B270 13E006B4 1300B2C0 1300B0D0 13E00400 13E00504 Module: DFHYI640 13E00330 12EDE91C 00000000 130000D0 13E003F4 13009EF8 93E006E2 00000000 Offset: 00000434 *.......q.....\...\....Z........}* *...{...}.\...\...\.4...8l\.S....*

Storage Protection is ACTIVE

Data at PSW: 93E00704 PSWDATA 13E002D0 0000 0020 0040 0060 0080 03E0 0400 0420 C4C6C8E8 C9D3D3C9 13E003AE 13E002F8 00104001

C9F6F4F0 D55C0000 00000000 00000000 00000008

58F0021C 47F0F028 00000000 13E007A0 E2C5C3D5

58F0F0D0 00C3C5C5 00000000 13E003A6 C4D7C7D4

58F0F014 000000C8 90ECD00C 13E002F8 F2F0F0F7

58F0F00C 00000014 4110F038 13E005EC F0F9F0F6

58FF000C 47F0F001 98EFF04C 13E00A90 F1F3F4F2

07FF5CC6 98CEAC00 07FF0000 13E003C2 F3F6F0F2

*DFHYI640.0...00}.00..00.......*F* *ILLIN*...00..CEE...H.....00.q...* *.\................}...0.q.0<....* *.\.8.....\...\.w.\.8.\...\...\.B* *.. .....SECNDPGM2007090613423602* *.0..K.}.}qo j K.}y....}y&.}.o.}.* *..}..0....j..{.....{.Y..j. 0..K.* *...aK.}...o.}...}..cK...}.o...K.*

47F0B000 D203D08C D0989640 9140D21D 4110D0A0 58F0A000 41009138 58C09080 8038A081 D201D0A0 8038960F D0A1FA10

D0A8A01C 4120D0A8 5020D0A0 9680D0A0 05EF58C0 90E85820 912440F0 2000D201 D0A0A083 D2018038 D0A0960F 8039D210

Here is the failing instruction

PSW points here

WebSphere Support Technical Exchange

32

IBM Software Group

PSW and Registers notes


PSW: 079D1000 93E00704 Instruction Length: 6 Interrupt Code: Execution key at Program Check/Abend: 9 Space at Program Check/Abend: Basespace 07 To locate the failing instruction, subtract the instruction length from the PSW. In this case 13E00704 - 6 = 13E006FE. The failing instruction at location 13E006FE is: FA10 D0A0A083 This is an Add Decimal instruction. The interrupt code is a Data Exception due to operand 2 not being in packed format. For more information on Program interrupts and instructions, refer to z/Architecture Principles of Operation CICS will also provide important information about the environment taken from the SDWA. In this case the program was executing in key 9. When STGPROT=YES is specified in the SIT and the program is defined with EXECKey(USER) the program is given control in key 9. Storage around the PSW and each register is formatted. However, it must be remembered this is the storage at the time the dump was taken. Therefore, although the PSW and Registers shown for prior errors are correct, the DATA formatted for these errors has most likely changed, since it reflects storage from the current failure.

WebSphere Support Technical Exchange

33

IBM Software Group

Verbx DFHPD640 LD=3


Loader Domain
==LD: PROGRAM REPERTOIRE
PGM NAME USE CNT. IGZINSH IIBMMSGT IIGZMSGT SECNDPGM 0 0 0 1 0 0 0 1 USERS 0 0 0 1 LOADS 0 0 0 1 COPIES LENGTH USE TYP ATTRIBUTE EXEC DEFINITION DATE/TIME KEY 00000000 APP RPL REUSABLE USER 6/09/07 12:46:01 00000000 APP RPL REUSABLE USER 6/09/07 12:46:01 00000000 APP RPL REUSABLE USER 6/09/07 12:46:01 00001320 APP RPL REUSABLE USER 6/09/07 12:47:24 CPE ADDR STATUS 131A5258 131A5310 131A53C8 131A8538 UNUSED UNUSED UNUSED LOADED

==LD: PROGRAM STORAGE MAP


PGM NAME ENTRY PT DFHCCNV CSECT LOAD PT. REL. PTF LVL. LAST COMPILED 13C00000 13C001A8 13E00000 13E002D0 640 0640 UK09263 620 640 I 18/11 13.35 1 1 1 1 ESDSA RPL REUSABLE ESDSA RPL REUSABLE 12F3D8B0 12F3DC68 COPY NO. USERS 1 0 LOCN TYP ATTRIBUTE APE ADDR 131F12D8 93C00028 DFHYA640 DFHCCNV FIRSTPGM 93E00000 DFHYA620 SECNDPGM 93E002F8 DFHYI640 ERDSA RPL RESIDENT

WebSphere Support Technical Exchange

34

IBM Software Group

Loader Domain notes


The Loader domain is responsible for loading and tracking all program usage, including exit modules. The Program repertoire is a listing of all programs known to the loader at the point the dump was taken. It contains information showing the count, number of users, number of times the program has been loaded, when it was defined to CICS and the program attributes. The program storage map is a sequential (by storage address) listing of all programs managed by the loader domain in the CICS address space. Information in the kernel error data gives the failing PSW address as 93E00704. Also notice the Dump Summary message DFHSR0001 IYNX30 An abend (code 0C7/AKEA) has occurred at offset X'00000434' in program SECNDPGM. Subtracting x434 from the PSW address of 13E00704 provides the address of the Load Point of the failing program, 13E002D0. In the loader domain program storage map, the SECNDPGM Entry Point is at 13E002F8, which is at x28 from the Load Point. It resides in the ESDSA, there is one copy of the module which currently has a use count of 1. In this example, the Dump Summary informed us of the abending program. However, this technique can also be used to locate the abending program, when CICS cannot determine the actual program, by using the PSW and finding the program that encompasses that storage.

WebSphere Support Technical Exchange

35

IBM Software Group

Verbx DFHPD640 PG=3


Program Manager Domain
==PG: PPTE SUMMARY
PPTE ADDRESS MOD LANG CEDF DATA DPL LOAD USE TYPE DED STAT LOC SUBS STAT COUNT PROGRAM LANG INST AVAL EXEC RE HOLD NAME DEF TYPE STAT KEY LOAD STAT _______________________________________________________________ 131A2DF0 IGZCPCC PG ASS NDD G CED E B U F N L C 1 131A2E48 IGZINSH PG ASS NDD G CED E B U F N ND T 131A2EA0 IIBMMSGT PG ASS NDD G CED E B U F N ND T 131A2EF8 IIGZMSGT PG ASS NDD G CED E B U F N ND T 131A6768 SECNDPGM PG COB CO2 R CED E A U F N L T 1

To find the task we are interested in, issue a find for the task number: F 00064
==PG: PTA SUMMARY FOR TRAN NUM : 00064, PTA ADDRESS : 122FC300
LOG-LVL : 2 SYS-LVL : 0 TASK-LLE : 00000000 PLCB : 12EDDCA0 =PG: TASK PLCB SUMMARY PROG SECNDPGM LVL 2 LD 13E002D0 ENT 93E002F8 LEN 001320 ENV EXEC INV FIRSTPGM PROG FIRSTPGM LVL 1 LD 13E00000 ENT 93E00000 LEN 0002D0 ENV EXEC INV CICS

WebSphere Support Technical Exchange

36

IBM Software Group

Program Manager Domain notes


It controls functions involving programs, such as EXEC CICS Link and Load commands, and autoinstalling programs. It contains information about the following CICS control blocks Load List elements - LLE's Program Processing Table Entry - PPTe's Program Level Control Blocks - PLCB's Handle Table Blocks - HTB's It is useful to find out the following information: If Program Autoinstall is being used Program attributes, such as Execution Key, Data Location, Language, Concurrency, and CEDF Status

WebSphere Support Technical Exchange

37

IBM Software Group

Verbx DFHPD640 AP=3


Application Domain
===AP: AP DOMAIN TRANSACTION SUMMARY
Tran No 00021 00024 00029 00064 Tran Id CSNC CSHQ CSNE OOPS Orig Tran CSNC CSHQ CSNE OOPS TCA Addr 0005E080 122AC680 122AD080 122AD680 TWA Addr 007B6000 007B6000 007B6000 007B6000 EIB Addr 000640D0 12F390D0 12F3A0D0 130000D0 SEIB Addr 0005E494 122ACA94 122AD494 122ADA94 EIS Addr 0005E388 122AC988 122AD388 122AD988 EIUS Addr 00064008 12F39008 12F3A008 13000008 Facility Type Facility Id

TC

TC21

===AP: AP DOMAIN TRANSACTION CONTROL BLOCKS


TCA.00064 122AD680 Task Control Area (User Area) 0000 0020 0040 122AD780 00000001 12F2D720 000502A0 0000064C 00000000 00000000 92669D56 93E00064 000867E4 12EDC878 93E00028 12EDEE20 00000000 00000000 00000008 131F9000 00000000 007B8000 1300005C 12EDBFB0 1264F26F 00000014 00004000 *..P......2P.....................* *...<........k............#.....** *l\.....U..H.l\........2?...... .*

SYS_TCA.00064 122AD780 Task Control Area (System Area) 0000 0020 0040 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 13009EF8 00000000 00000000 00000000 0000064C 121F27DC 0000007A 00000000 00000000 00000000 12EDDD00 00000000 00000000 00000000 00000000 00000000 *...................<.......:....* *................................* *...8............................*

SYSEIB.00064 122ADA94 System EXEC Interface Block -0008 0000 0135012F 0107249F D6D6D7E2 0000064C 5CE2E8E2 C5C9C240 E3C3F2F1 00000004 00007D02 0A000000 * *SYSEIB * *........OOPS...<TC21......'.....*

USER31.00064 130015C0 USER storage above 16MB 0000 0020 E4F0F0F0 F0F0F6F4 4C4CD9E4 E6D76E6E 00000000 130015F0 00010000 12EDEE20 00000000 00000000 00008460 00008460 12655497 12656496 E4F0F0F0 F0F0F6F4 *U0000064<<RUWP>>..........d-..d-* *.......0...........p...oU0000064*

WebSphere Support Technical Exchange

38

IBM Software Group

Application Domain notes


AP=3 Formats storage pertaining to each active transaction starting with the lowest task number. Storage includes: Task control area or TCA EXEC Interface blocks, including EIS, EIB and EIUS User task storage SYS EIB + x'1B' contains the current EIB function code; these can be found summarized in the appendix of the Application Programming Reference. In this example the SYSEIB function code was: 020A --- EXEC CICS IGNORE CONDITION EIB + x'1B', if different from the SYS EIBFN, contains the last completed function code. In this example EIB function code identical to the SYSEIB. The EIUS + x'50' contains the address of the application register save area. Registers from the last EXEC CICS command are stored here (registers 14 through 12). The users task storage is displayed, and if a storage check zone is corrupt (storage violation) it will be flagged with one of the following messages:
** DFHPD0124 ** DFHPD0125 Storage violation detected at xxxxxxxx. Leading SAA is invalid. Storage violation detected at xxxxxxxx. Trailing SAA is invalid.

where xxxxxxxx is the starting address of the allocated storage. WebSphere Support Technical Exchange 39

IBM Software Group

Verbx DFHPD640 XM=3


Transaction Manager domain
==XM: GLOBAL STATE SUMMARY
XM domain status: Maximum user tasks (MXT): System currently at MXT: XXMATT user exit currently: XM state lock currently held: XM trandef state lock currently held: System attaches delayed for SOS: Force-purge has been issued: Kill has been issued: Initialised 32 No Inactive No No No Yes No

==XM: TRANSACTION SUMMARY


Tran Tran TxnAddr Start Sys Status DS Facility Facility AP id num TxdAddr code Tran token type token token -------------------------------------------------------------------------CSOL 00003 122091B8 C Yes ACT 00860003 None 122AA680 122CF780 00000000 CSSY 00005 122094C8 C Yes ACT 01900003 None 0005C080 122CF030 01050000 CSSY 00006 12209650 C Yes ACT 01100003 None 0005C680 122CF030 01050000 OOPS 00064 12209340 T No ACT 04000029 Terminal 12F2D720 122AD680 12FDA6B0 00000000

WebSphere Support Technical Exchange

40

IBM Software Group

Transaction Manager Domain notes


The Transaction Manager domain lists all transactions (user and system) that currently exist. Useful information found in the XM domain: Maximum User Task setting (MXT from SIT) Current number of active and queued tasks Transaction ID and transaction number for each active task Type of transaction - System vs. Non-system Start code associated wit the task Transaction Class or TCLASS information Address of the transaction control block - TXN What time was the task attached by transaction manager? The TXN+50 contains a store clock value of the time the task was attached In our case the TXN address for task 00064 is 12209340 On the command line issue: IP CBF 12209340+50 STR(TODCLOCK) Results: TODCLOCK: 00000000 09/06/2007 12:50:32.730252 So task 00064 was attached at 12:50:32 (GMT) on September 6, 2007 WebSphere Support Technical Exchange 41

IBM Software Group

Verbx DFHPD640 TR=1


Trace Domain
===TR: TRACE DOMAIN ABBREVIATED TRACE
Internal trace is STARTED : Table size is 4096K Auxiliary trace is STOPPED : Current extent is DFHAUXT : Autoswitch status is OFF GTF Task 00064 00064 00064 00064 00064 00064 00064 00064 00064 00064 00064 00064 00064 00064 00064 00064 00064 00064 00064 00064 00064 00064 TCB QR QR QR QR QR QR QR QR QR QR QR QR QR QR QR QR QR QR QR QR QR QR trace is STOPPED Trace Point AP AP SM SM AP AP SM SM SM SM AP AP SM SM AP AP AP PG PG AP AP AP 1948 1949 0301 0302 1941 1940 0301 0302 0301 0302 1948 1949 0301 0302 1948 00E1 E160 0700 0701 E161 00E1 1942 Mod APLI APLI SMGF SMGF APLI APLI SMGF SMGF SMGF SMGF APLI APLI SMGF SMGF APLI EIP EXEC PGHM PGHM EXEC EIP APLI Function EVENT EVENT ENTRY EXIT EXIT ENTRY ENTRY EXIT ENTRY EXIT EVENT EVENT ENTRY EXIT EVENT ENTRY ENTRY ENTRY EXIT EXIT EXIT *EXC* CALL-TO-LE/370 RETURN-FROM-LE/370 FREEMAIN FREEMAIN/OK ESTABLISH_LANGUAGE/OK START_PROGRAM GETMAIN GETMAIN/OK GETMAIN GETMAIN/OK CALL-TO-LE/370 RETURN-FROM-LE/370 GETMAIN GETMAIN/OK CALL-TO-LE/370 IGNORE-CONDITION IGNORE IGNORE_CONDITIONS IGNORE_CONDITIONS/OK IGNORE IGNORE-CONDITION Program-Check Establish_Ownership_Type SECNDPGM Establish_Ownership_Type OK SECNDPGM 130015C8,TASK COBOL2,1322F360,,NOT_DEFINED,LE370_RUNTIME SECNDPGM,CEDF,FULLAPI,EXEC,NO,1322F360,00000000 28,YES,RUWAPOOL,TASK31 130015C8 37D0,YES,00,LE_TWA,TASK31 13001608 Thread_Initialization SECNDPGM Thread_Initialization OK SECNDPGM 8458,YES,LE_RUWA,TASK31 13004DE8 Rununit_Init_&_Begin_Invo SECNDPGM 0004,13009EF8 CONDITION LENGERR COBOLII 00028 13009FA5 0 CONDITION LENGERR 0,0,COBOLII,00028 OK 00F4,00000000 START_PROGRAM,SECNDPGM,CEDF,FULLAPI,EXEC,NO,1322F360

WebSphere Support Technical Exchange

42

IBM Software Group

Verbx DFHPD640 TR=2


Trace Domain
AP 00E1 EIP EXIT IGNORE-CONDITION OK TASK-00064 KE_NUM-0044 TCB-QR AP 1942 APLI REQ(00F4) FIELD-A(00000000 ....) FIELD-B(0000020A ....) /007DA510 RET-93E006E2 TIME-13:50:12.7360027800 INTERVAL-00.0000005000 =018368= *EXC* - Program-Check FUNCTION(START_PROGRAM) PROGRAM(SECNDPGM) CEDF_STATUS(CEDF) EXECUTION_SET(FULLAPI) ENVIRONMENT_TYPE(EXEC) SYNCONRETURN(NO) LANGUAGE_BLOCK(1322F360) COMMAREA(00000000 , 00000000) LINK_LEVEL(2) SYSEIB_REQUEST(NO)

TASK-00064 KE_NUM-0044 TCB-QR /007DA510 RET-924916E8 TIME-13:50:12.7375516394 INTERVAL-00.0015488593 =018369= 1-0000 01A00000 000000DA 00000000 00000000 B81B4EA0 00000000 02000100 E2C5C3D5 *..................+.........SECN* 0020 C4D7C7D4 13E002D0 93E002F8 00001320 07010101 01030202 1322F360 1322F360 *DPGM.\.}l\.8..............3-..3-* 0040 00001320 91E21102 00000000 00000000 00000000 00020102 91020201 02404040 *....jS..................j.... * 0060 40404040 0000002D 1202E0E0 131F04D0 01FB53C8 12109AF8 00000001 00007000 * ......\\...}...H...8........* 0080 12EDDFE0 00280000 12ECC880 00007000 00007758 80000000 12EDE300 91E1F450 *...\......H...............T.j.4&* 00A0 12EDD9E0 91E83360 D88C0000 0030D5C0 041201D8 22020000 12EDD678 00008030 *..R\jY.-Q.....N{...Q......O.....* 00C0 01000000 00000000 00000000 91E1F5DE 91E1F77A 91E48D80 11E4C31E 00008958 *............j.5.j.7:jU...UC...i.* 00E0 12212000 12EDDE38 91E3647A 12EDE208 F3F9F1F3 91E07AC2 00000000 80000001 *........jT.:..S.3913j\:B........* 0100 12EDE118 00000007 120F4030 00000001 12EDDE38 00000008 12EDE178 12FB53C8 *.......... ....................H* 0120 1210F378 00000001 0005B680 0002020B 12285000 12240684 00000000 00000000 *..3...............&....d........* 0140 00000000 00000000 00000000 00000000 02A50000 00000270 F10002A0 12EDDD60 *.................v......1......-* 0160 00000000 12FB5420 00E00400 000006D1 00680000 00000028 00000000 00000000 *.........\.....J................* 0180 B5000000 00000000 01EDE1E8 00000001 00000040 0002DFEC 12EDDE38 00000090 *...........Y....... ............* 2-0000 F0C3F761 C1D2C5C1 018400C7 0000FFFF C4C6C8C1 D7D3C9F1 1264E270 3164E080 *0C7/AKEA.d.G....DFHAPLI1..S...\.* 0020 122AD680 12ECC880 00000008 00000000 FF950007 00000000 079D1000 93E00704 *..O...H..........n..........l\..* 0040 00060007 00000000 93E00704 90000838 1300B208 13009F98 1300B270 13E006B4 *........l\.............q.....\..* 0060 13E00330 12EDE91C 00000000 130000D0 1300B2C0 1300B0D0 13E00400 13E00504 *.\....Z........}...{...}.\...\..* 0080 13E003F4 13009EF8 93E006E2 00000000 00000000 00000000 00000000 00000000 *.\.4...8l\.S....................* 00A0 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 *................................* 00C0 00000000 00000000 00000000 00000003 00000000 00000000 00000000 00000000 *................................* 00E0 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 *................................* 0100 00000000 00000000 00000000 00000000 FF950007 00000000 079D1000 93E00704 *.................n..........l\..* 0120 00060007 00000000 93E00704 90000000 1300B208 13009F98 1300B270 13E006B4 *........l\.............q.....\..* 0140 13E00330 12EDE91C 00000000 130000D0 1300B2C0 1300B0D0 13E00400 13E00504 *.\....Z........}...{...}.\...\..* 0160 13E003F4 13009EF8 93E006E2 00000000 00000000 00000000 00000000 00000000 *.\.4...8l\.S....................*

WebSphere Support Technical Exchange

43

IBM Software Group

Trace Domain notes


The prior pages show examples of formatting the CICS trace: first with TR=1, which displays the Abbreviated trace table Next with TR=2, which produces the Full trace. Optionally (but not shown here), you can specify TR=3 to display first the Abbreviated, followed by the Full trace. Exception (*EXC*) trace entries cannot be suppressed TR=2 times are LOCAL (compared to DS times, which are GLOBAL) Dynamic changes to Trace settings can be made using the CETR transaction; those same changes can be made static through various System Initialization Table (SIT) parameters or overrides For further information about CETR settings and usage, refer to CICSSupplied Transactions For further information about SIT settings, refer to the CICS System Definition Guide

WebSphere Support Technical Exchange

44

IBM Software Group

Verbx DFHPD640 DS=1


Dispatcher Domain
KEY FOR SUMMARY T = S = F = P = TT = W = DTA= AD = M = TYPE OF TASK STATE OF TASK PURGEABILITY FLAG PURGE STATUS TIMEOUT TYPE WAIT/SUSPEND TYPE DISPATCHER TASK AREA ATTACHING DOMAIN TASK MODE S=SYSTEM N=NON-SYSTEM D=DISPATCHABLE S=SUSPENDED R=RUNNING A=RUNNING ABTERM YES P=PURGEABLE N=NOT PURGEABLE N=NO PURGE X=PURGED P=PURGE PENDING A=ABTERM PENDING IN=INTERVAL DD=DEADLOCK DELAYED DI=DEADLOCK IMMEDIATE M=WAIT_MVS S=SUSPEND C=WAIT_OLDC W=WAIT_OLDW J=RUNNING IN JVM E=RESUMED EARLY

DS_TOKEN KE_TASK 00000001 00040003 00060003 00080003 00100003 00900003 00040001 00060001 00080001 00000029 00800003 11F8CC00 12F6A480 11F8C000 11FA9C00 12F1C080 121FBC00 1222A080 1222A480 12F1C880 12ECC880 12F38880

T S F P TT RESOURCE RESOURCE_NAME TYPE S S S S S S S S S N S S S S R S S S S S R S N N - ENF NOTIFY N N IN FCCFQS N N - TIEXPIRY DS_NUDGE N N N N N N N N N N IN ICEXPIRY ICMIDNTE SMSYSTEM smsyre TCP_NORM CSNC DFHAPTIX DFHAPTIM smva_ecb DFHZDSP MROQUEUE

W TIME OF SUSPEND

TIMEOUT DUE

DTA (DSTSK)

AD M SUSPAREA XM_TXN_TOKEN DM XM TI AP XM XM SM SM XM XM XM RO QR QR CQ QR QR QR QR QR QR QR 12217998 12F624C0 12209C700000019C 121B3860 121B3BF0 122096500000006C 31669C80 122094C80000005C 121B3920 11FF4594 00058100 122099600000008C 122093400000064C 131B603C 12209DF80000021C

N N -

M 12:45:58.610 121B2080 M 12:46:00.425 12:51:00.425 121B2380 S 12:46:03.584 121B2500 121B2680 S 12:46:03.584 121FCC80 S 12:46:00.312 31669C80 S 12:45:58.614 12:50:58.614 316B2380 M 12:45:59.462 316B2500 W 12:50:32.730 316B2680 3164E080 M 12:46:01.968 31640080

Note: DS Times are GMT!

Task Numbers

WebSphere Support Technical Exchange

45

IBM Software Group

Dispatcher Domain notes


The Dispatcher domain is most useful for examining task hang conditions. For these types of problems, you should examine the type of resource(s) the tasks are waiting for. The except below is a DS=1 sample output from a dump taken when transactions were backing up. This dump was taken at 22:09:05 GMT RESOURCE RESOURCE_NAME TYPE TCP_NORM DFHZDSP LMQUEUE LMQUEUE LMQUEUE LMQUEUE LMQUEUE LMQUEUE LMQUEUE LMQUEUE W TIME OF SUSPEND W 22:09:05.075 S 20:33:20.283 S 20:33:05.398 S 20:33:30.540 S 20:33:26.600 S 20:33:25.978 S 20:33:18.029 S 20:33:24.446 S 20:33:10.234

TCP task matches the time of the dump

these tasks were waiting 1 1/2 hours for a lock

WebSphere Support Technical Exchange

46

IBM Software Group

Verbx MTRACE
Console Message display
*** MASTER TRACE TABLE *** TAG | 0001 0001 0001 0001 IMM DATA 0000025D 0000004B 00000040 00000040 |-------------------------------------------------- MESSAGE DATA ------------------------------------------------N 8000000 MV23 07249 N 4000000 MV23 07249 M C020000 MV23 07249 D has been D debugging E N C020000 MV23 07249 at offset X'00000434' in M C020000 MV23 07249 D DFHSR0001 is D PTFS/UK05645 E N FFFF000 MV23 07249 , DUMPID: 1/0004 13:50:01.16 STC16806 00000281 *DFS3384I DATA SHARING STOPPED IM9C 13:50:09.58 JOB00027 00000080 +06/09/07 13:50:10 13:50:12.73 JOB17692 00000090 +DFHDP0100 IYNX30 067 067 00000090 An unexpected exception response with reason code X'22' 067 00000090 067 13:50:12.73 JOB17692 program SECNDPGM. 13:50:12.73 JOB17692 069 00000090 00000090 00000090 00000090 returned by CICS file control to module DFHDPFM. The profiles file, DFHDPFMP, is not usable. +DFHSR0001 IYNX30 An abend (code 0C7/AKEA) has occurred +DFHME0116 IYNX30 069 (Module:DFHMEME) CICS symptom string for message PIDS/5655M1500 LVLS/640 MS/DFHSR0001 RIDS/DFHSRP AB/S00C7 AB/UAKEA RIDS/SECNDPGM ADRS/00000434 +DFHDU0201 IYNX30 ABOUT TO TAKE SDUMP. DUMPCODE: SR0001

0001 00000040 0001 00000040 0001 00000040 0001 00000040 0001 00000040 0001 00000040 0001 00000040 0001 00000040

069 00000090 069 00000090 13:50:12.73 JOB17692 00000090

WebSphere Support Technical Exchange

47

IBM Software Group

References
CICS Support Web Page http://www.ibm.com/software/htp/cics/tserver/support/ Helpful references and links to CICS Info Center, Technotes, Flashes, Must Gather documents for defect support, SupportPacs, Redbooks, and more! Useful Manuals CICS Operations and Utilities Guide Details and instructions for configuring IPCS for CICS CICS Problem Determination Guide Assistance for investigating dumps and abends CICS Trace Entries CICS Data Areas and Supplementary Data Areas CICS Supplied Transactions z/OS Interactive Problem Control System User's Guide z/OS Interactive Problem Control System Customization z/OS Interactive Problem Control System Commands z/OS Principles of Operation Information on program interrupts and instructions

WebSphere Support Technical Exchange

48

IBM Software Group

Summary
IPCS Basics What's needed Commands CICS verbexit Type of dumps: SLIP Dumps Console Dumps CICS Dumps CICS verbexit samples CICS References

WebSphere Support Technical Exchange

49

IBM Software Group

Additional WebSphere Product Resources


Discover the latest trends in WebSphere Technology and implementation, participate in technically-focused briefings, webcasts and podcasts at: www.ibm.com/developerworks/websphere/community/ Learn about other upcoming webcasts, conferences and events: www.ibm.com/software/websphere/events_1.html Join the Global WebSphere User Group Community: www.websphere.org Access key product show-me demos and tutorials by visiting IBM Education Assistant: ibm.com/software/info/education/assistant Learn about the Electronic Service Request (ESR) tool for submitting problems electronically: www.ibm.com/software/support/viewlet/probsub/ESR_Overview_viewlet_sw f.html Sign up to receive weekly technical My support emails: www.ibm.com/software/support/einfo.html

WebSphere Support Technical Exchange

50

IBM Software Group

Questions and Answers

WebSphere Support Technical Exchange

51

You might also like