NGTRiiAGE-partner(eng) REV: 27.0.

19 BUILD DATE: 081618

*******************************************************************************

This TRiiAGE Analysis Report [as reported by both SPs] is being generated
based on a full analysis of the SP logs.

For a full description of TRiiAGE, refer to the TRiiAGE User Guide.

It contains a detailed explanation of each section.

***********************************************************************************
***********
ARRAY CONFIGURATION INFORMATION
[ArrayInfo Script]
***********************************************************************************
***********
Array Name: FCNNX111700031
Array Serial Number: FCNNX111700031
Array Model: AX4-5F8 ( FILE )

SPA------------ SPB------------
Array Software Revision: 2.23.50.5.711 2.23.50.5.711
SP Serial Number: FCNSC140900196 FCNSC143800225
IP Address: 128.221.252.200 128.221.253.201
PROM Revision: 5.40.00 5.40.00
SP Signature: 38fb71 3a47f7
Agent Revision: 6.23.8 (1.2) 6.23.8 (1.2)
SP Memory: 1023 1023
SP Time: 02/27/2019 17:17:50 02/27/2019 17:03:58
SP Uptime: 01:43:08 01:29:19
Read Cache State: ENABLED ENABLED
Write Cache State: DISABLED DISABLED
Read Cache Size: 75 75
Write Cache Size: 356 356
Cache Page Size: 16 16
Greater WC Availability: N/A N/A
System Fault LED: ON ON
System Disk Free Space: 4.64 GB (76% free) 4.50 GB (74% free)
Enclosures: 4 4
Disks: 35 35

Fault summary:
FRU SPA SPB
-------------------- ------------------------- -------------------------
Bus0 Enc0 Dsk9 Removed Removed
Bus0 Enc1 Dsk1 Removed Removed
Enc0 Degraded - Enclosure reporting multiple fan faults or ambient
over temperature fault, Faulted, Resume fault
Degraded - Enclosure reporting
multiple fan faults or ambient over temperature fault, Faulted, Resume fault
Enc0 Fan A Faulted
Enc0 Fan B Faulted
Enc0 LccA Faulted
Enc0 LccB Faulted
Enc0 SPSB Faulted Faulted
Enc1 Faulted Faulted
Enc3 Faulted Faulted
PowSupply 2 Faulted - Resume Faulted, Faulted
Faulted - Resume Faulted, Faulted
SPA Faulted
SPB Faulted

Enclosure SPA Type Vers F SPB Type Vers F Notes

Bus 0 Enclosure 0 DPE4AX * DPE4AX * SATA/SAS 3G
DPE
Bus 0 Enclosure 1 DAE4AX * DAE4AX * SATA/SAS 3G
DAE
Bus 0 Enclosure 2 DAE4AX DAE4AX SATA/SAS 3G
DAE
Bus 0 Enclosure 3 DAE4AX * DAE4AX * SATA/SAS 3G
DAE

A-side LCC ------------------ B-side LCC

------------------
Enclosure Type Serial Assy Revision Serial
Assy Revision
Bus 0 Enclosure 0 DPE4AX N/A N/A

Bus 0 Enclosure 1 DAE4AX SL7L1110900181 A10 3.0 SL7L1110900179

A10 3.0
Bus 0 Enclosure 2 DAE4AX SL7L1110900165 A10 3.0 SL7L1110900174
A10 3.0
Bus 0 Enclosure 3 DAE4AX SL7L1110900178 A10 3.0 SL7L1110900148
A10 3.0

A-side Power ---------------- B-side Power

----------------
Enclosure Serial Assy Revision Serial Assy
Revision
Bus 0 Enclosure 0 FHTA5110700133 A01 N/A

Bus 0 Enclosure 1 FHTA5110700244 A01 N/A FHTA5110700243 A01 N/A

Bus 0 Enclosure 2 FHTA5110700195 A01 N/A FHTA5110700193 A01 N/A

Bus 0 Enclosure 3 FHTA5110700134 A01 N/A DTEA4110200744 A12 N/A

SPA SPB Interface Bytes/

Rotat
Count Count Type Speed Sect Vendor Drive Type Product ID
Part No TLA Part No Capacity Speed Firmware
1 1 SAS 6Gb 512 SEAGATE EagleRP ST360000 CLAR600
DG118032658 005048960 0 10K RS05
29 29 SAS 6Gb 512 SEAGATE EagleRP ST360000 CLAR600
DG118032658 005048960 549691 10K RS05
5 5 SAS 6Gb 512 SEAGATE Firefly ST914680 CLAR146
DG118032649 005049083 136888 10K FF03

NOTE: DETAILED DISK INFORMATION is provided near the end of this file.

Cannot open file 'C:\Program Files (x86)\EMC\NGTRiiAGE/smbstatus.dat', skipping...

***********************************************************************************
***********
Backend Bus Speed INFORMATION
[Backend Script]
***********************************************************************************
***********
Backend Bus command not supported on this array.

***********************************************************************************
***********
ARRAY ISSUES SUMMARY INFORMATION
[TriageIssues Script]
***********************************************************************************
***********

Test Result Sev Action

=============================== ======= === ================================
AT Relocation Check PASSED
AppSync check PASSED
BackGround Verify Performance PASSED
Backend Bus Speed INFO 3 Backend Bus command not supported on
this array.
CIMOM Bad Request PASSED
CIMOM Memory Leak Issue PASSED
CLONE DRIVER STUCK CHECK PASSED
CRU Signature Status (SPA) PASSED
CRU Signature Status (SPB) PASSED
Cache Persistence Status check PASSED
Checkpoint Status (SPA) PASSED
Checkpoint Status (SPB) PASSED
Cimom Check PASSED
DLU Holding IO Check INFO 3 DLU Holding IO Flag issue is not
applicable on this version.
DRAMCache CorruptCrc check PASSED
DU/DL check WARNING 3 Refer to KB 330422 for Hardware
Replacement errors(event code 803).
Refer to: FLARECENTRIC LOG ERROR REPORTING INFORMATION
DU/DL check PASSED
Drive Capacity Consistency PASSED
Drive Inventory Consistency PASSED
Drive Serial Number Consistency PASSED
Drive Type (SATA/SATAII) check INFO 3 This check is not applicable on this
version.
Enclosure Bus Check PASSED
HLU Conflicts PASSED
Hotspare Stuck Remap PASSED
Invalid Checkpoint PASSED
LCC/BCC Status PASSED
LUN Status Check PASSED
MLU DU/DL check PASSED
MLU Recovery Time Estimates PASSED
MLU Reservation Count Check PASSED
MR trespass storm check INFO 3 MR trespass storm issue is not
applicable on this version.
Media-caused Uncorrectables PASSED
PACO Resiliency check (SPA) INFO 3 Not applicable to this revision.
PACO Resiliency check (SPB) INFO 3 Not applicable to this revision.
Partition Needs Rebuild Status PASSED
R33 Dedup Luns Check PASSED
Raidgroup Attributes (SPA) PASSED
Raidgroup Attributes (SPB) PASSED
Raidgroup Status (SPA) WARNING 2 2 raidgroups have bad disks
Refer to: RAIDGROUP ISSUE INFORMATION
Raidgroup Status (SPB) WARNING 2 2 raidgroups have bad disks
 Refer to: RAIDGROUP ISSUE INFORMATION
Reboot Duration PASSED
Reconstruct Check WARNING 3 Review 684/9 reconstruct message
extended status for details.
SAS Address Check (SPA) PASSED
SAS Address Check (SPB) PASSED
SGInfo Check PASSED
SMBus Status Check INFO 3 SMbus information is not available.
Refer to: ARRAY CONFIGURATION INFORMATION
SP Log Availability PASSED
Scan for Array FCO issues PASSED
Thin LUN Migration Check PASSED
Unbind Stuck Remap PASSED
VNX MLU AR Slice Check PASSED
VP Enabler Check PASSED
VPLEX connectivity check (SPA) PASSED
VPLEX connectivity check (SPB) PASSED
Write Cache FE Port Disabling PASSED

***********************************************************************************
***********
Incident Directory: C:/Users/nileshnirale/Downloads/orgi delhi
TRiiAGE Command Line: triage -f -c
User: nileshnirale
Event log entry count for SPA: 51201
Event log entry count for SPB: 51201
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%%%%%%%%%%%

***********************************************************************************
***********
POTENTIAL DU or DL ENTRY COUNT INFORMATION
[Stats Script]
***********************************************************************************
***********

+--------------------------------------------------------------------
+-------------------------------------------------------------+
| (71 / F1) SCSI Sense Deferred Error : 0 | (a4d) Parity
Checksum Error : 0 |
| (684) Parity Reconstructs : 1 | (a4c) Data
Checksum Error : 0 |
| (689) Sector Reconstructs : 0 | (a4b)
Coherency Error : 0 |
| (COH) Extended Status Coherency Errors : 0 | (a08)
Database Sync Error : 0 |
| (a31)ENC not capable of changing speed to match loop speed : 0 | (878) LCC
reported a General Fault : 0 |
| (957) Uncorrectable Sector : 0 | (953)
Uncorrectable Parity Sector : 0 |
| (951) CRU Signature Error total/unowned luns/broken luns : 0/0/0 | (90a) Can't
Assign - Cache Dirty : 0 |
| (792) Cleared - Cache Dirty : 0 | (840) Data
Sector Invalidated : 0 |
| (904/988/88d) Enc Over temperature : 0 | (71248003)
NTmirror UCRC : 0 |
| (a18/a24) Drive removed by BE fault recovery : 0/0 | Pool and/or
lun requires recovery and/or offline events : 0 |
| DRAMCache CorruptCrc Error : 0 |
|
+--------------------------------------------------------------------
+-------------------------------------------------------------+

***********************************************************************************
***********
FRONTEND PORT DISABLING INFORMATION
[CachePortCheck Script]
***********************************************************************************
***********

***********************************************************************************
***********
DISK[S] REPORTED ERROR INFORMATION
[DiskInfo Script]
***********************************************************************************
***********
There are 9 disks that have reported log error entries.

0.0.0 SEAGATE 10000 SAS 146GB DG118032649 6SD2RWVH R5

0.0.1 SEAGATE 10000 SAS 146GB DG118032649 6SD2RZ2D R5
0.0.2 SEAGATE 10000 SAS 146GB DG118032649 6SD2R7QR R5
0.0.5 SEAGATE 10000 SAS 600GB DG118032658 HOT_SPARE
0.0.9 0
0.1.0 SEAGATE 10000 SAS 600GB DG118032658 3SS03K4D R5
0.1.1 0
0.2.5 SEAGATE 10000 SAS 600GB DG118032658 3SS05ED2 R5
0.2.11 SEAGATE 10000 SAS 600GB DG118032658 HOT_SPARE

***********************************************************************************
***********
DISK MEDIA ERROR CHECK INFORMATION
[LogFilterCSV Script]
***********************************************************************************
***********

No Hitachi Viper-C (600 GB) drives found.

***********************************************************************************
***********
CRU REPLACEMENT INFORMATION
[CRU_replacement Script]
***********************************************************************************
***********

01/18/19 19:26:55 Log starts for SPA.

01/24/19 16:59:49 Log starts for SPB.
02/27/19 17:05:07 Log ends for SPB.
02/27/19 17:18:59 Log ends for SPA.

***********************************************************************************
***********
LCC FIRMWARE UPDATE INFORMATION
[LccFirmware Script]
***********************************************************************************
***********

***********************************************************************************
***********
ENCLOSURE INVENTORY ISSUES INFORMATION
[Diskrepency Script]
***********************************************************************************
***********

Disk Property A-side Value B-side Value

***********************************************************************************
***********
ENCLOSURE BUS CHECK INFORMATION
[EncCheck Script]
***********************************************************************************
***********

***********************************************************************************
***********
PANICS, DUMPS, Restarts and Flare not rescheduling INFORMATION
[Dump_analyzer Script]
***********************************************************************************
***********

SPA has encountered Bugcheck code E131801A on 06/07/2017 09:25:41.

Please escalate to Engineering

SPA has encountered Bugcheck code E131801A on 06/07/2017 17:43:01.

Please escalate to Engineering

SPA has encountered Bugcheck code E131801A on 06/08/2017 22:19:34.

Please escalate to Engineering

SPA has encountered Bugcheck code E131801A on 06/09/2017 12:10:26.

Please escalate to Engineering

SPA has encountered Bugcheck code E131801A on 06/09/2017 20:40:37.

Please escalate to Engineering

SPB has encountered Bugcheck code 00800148 on 01/24/2019 16:21:06.

Please escalate to Engineering

SPB has encountered Bugcheck code 01904fff on 05/26/2015 20:00:00.

Please escalate to Engineering

SPB has encountered Bugcheck code 01934fff on 06/01/2015 09:15:27.

Please escalate to Engineering

B 01/29/19 14:17:02 DGSSP 76008106 The Storage Processor rebooted

unexpectedly @ 16:10:28 on 01/24/2019: BugCheck 0, {0, 800148, 190, 8342dda8},
Failing Instruction: 0xA20FF54D in flaredrv.sys loaded @ 0xA1E05000 [CM_PANIC_BASE
<Flare>]
[ BugcheckCode: 800148 Definition not found, Bugcheck in: CM_PANIC_BASE ]

B 01/29/19 14:17:02 DGSSP 76008106 The Storage Processor rebooted

unexpectedly @ 16:14:29 on 01/24/2019: BugCheck 0, {0, 800148, 190, 831f28b8},
Failing Instruction: 0xA215654D in flaredrv.sys loaded @ 0xA1E5C000 [CM_PANIC_BASE
<Flare>]
[ BugcheckCode: 800148 Definition not found, Bugcheck in: CM_PANIC_BASE ]

B 01/29/19 14:17:02 DGSSP 76008106 The Storage Processor rebooted

unexpectedly @ 15:55:23 on 01/24/2019: BugCheck 0, {0, 800148, 190, 831432c8},
Failing Instruction: 0xA17F254D in flaredrv.sys loaded @ 0xA14F8000 [CM_PANIC_BASE
<Flare>]
[ BugcheckCode: 800148 Definition not found, Bugcheck in: CM_PANIC_BASE ]

B 01/29/19 14:17:02 DGSSP 76008106 The Storage Processor rebooted

unexpectedly @ 16:02:56 on 01/24/2019: BugCheck 0, {0, 800148, 190, 8319e368},
Failing Instruction: 0xA1FA054D in flaredrv.sys loaded @ 0xA1CA6000 [CM_PANIC_BASE
<Flare>]
[ BugcheckCode: 800148 Definition not found, Bugcheck in: CM_PANIC_BASE ]

B 01/29/19 14:16:19 SP B 907 Microcode Panic [CM_PANIC_BASE

<Flare>] 0 800148 190

***********************************************************************************
***********
CIMOM BUG INFORMATION
[CimomBug Script]
***********************************************************************************
***********

Navisphere CIMOM issue not detected.

***********************************************************************************
***********
DUMPS Submitted
***********************************************************************************
***********

No dumps found.

***********************************************************************************
***********
SP BOOT HISTORY INFORMATION
[Reboot script]
***********************************************************************************
***********

Total Reboots: 125

Reboots from Bugcheck: 1
Reboots from Power Outage: 0
Software-Initiated or User-Initiated Reboots or Shutdowns: 0
Unexplained Reboots: 124

Reboot Time SP Cause Event Time FE Up Downtime

Boottime Bugcheck Code
----------------- --- ----------------- ------------------ ----- --------
-------- -------------------
01/19/19 02:36:27 SPA Unexplained 01/19/19 02:36:27* YES 00:00:47
00:00:47
01/19/19 15:26:46 SPA Unexplained 01/19/19 15:26:46* YES 00:00:49
00:00:49
01/19/19 15:35:01 SPA Unexplained 01/19/19 15:35:01* YES 00:00:46
00:00:46
01/19/19 16:12:44 SPA Unexplained 01/19/19 16:12:44* YES 00:00:46
00:00:46
01/20/19 03:59:00 SPA Unexplained 01/20/19 03:59:00* YES 00:00:48
00:00:48
01/20/19 04:03:49 SPA Unexplained 01/20/19 04:03:49* YES 00:00:48
00:00:48
01/20/19 13:36:18 SPA Unexplained 01/20/19 13:36:18* YES 00:00:47
00:00:47
01/20/19 13:44:07 SPA Unexplained 01/20/19 13:44:07* YES 00:00:46
00:00:46
01/20/19 14:20:20 SPA Unexplained 01/20/19 14:20:20* YES 00:00:47
00:00:47
01/20/19 14:28:54 SPA Unexplained 01/20/19 14:28:54* YES 00:00:46
00:00:46
01/20/19 14:33:31 SPA Unexplained 01/20/19 14:33:31* YES 00:00:46
00:00:46
01/20/19 14:36:04 SPA Unexplained 01/20/19 14:36:04* YES 00:00:46
00:00:46
01/20/19 15:19:54 SPA Unexplained 01/20/19 15:19:54* YES 00:00:46
00:00:46
01/20/19 15:28:11 SPA Unexplained 01/20/19 15:28:11* YES 00:00:47
00:00:47
01/21/19 16:40:19 SPA Unexplained 01/21/19 16:40:19* YES 00:00:46
00:00:46
01/21/19 17:57:17 SPA Unexplained 01/21/19 17:57:17* YES 00:00:48
00:00:48
01/21/19 18:09:38 SPA Unexplained 01/21/19 18:09:38* YES 00:00:46
00:00:46
01/21/19 18:25:08 SPA Unexplained 01/21/19 18:25:08* YES 00:00:48
00:00:48
01/21/19 21:13:28 SPA Unexplained 01/21/19 21:13:28* YES 00:00:50
00:00:50
01/21/19 21:20:38 SPA Unexplained 01/21/19 21:20:38* YES 00:00:50
00:00:50
01/21/19 21:32:50 SPA Unexplained 01/21/19 21:32:50* YES 00:00:52
00:00:52
01/21/19 21:38:47 SPA Unexplained 01/21/19 21:38:47* YES 00:00:50
00:00:50
01/21/19 21:47:31 SPA Unexplained 01/21/19 21:47:31* YES 00:00:52
00:00:52
01/21/19 21:57:21 SPA Unexplained 01/21/19 21:57:21* YES 00:00:50
00:00:50
01/21/19 22:48:25 SPA Unexplained 01/21/19 22:48:25* YES 00:00:50
00:00:50
01/21/19 23:03:57 SPA Unexplained 01/21/19 23:03:57* YES 00:00:47
00:00:47
01/22/19 17:25:52 SPA Unexplained 01/22/19 17:25:52* YES 00:00:47
00:00:47
01/22/19 22:48:02 SPA Unexplained 01/22/19 22:48:02* YES 00:00:48
00:00:48
01/23/19 04:24:33 SPA Unexplained 01/23/19 04:24:33* NO

01/23/19 04:29:47 SPA Unexplained 01/23/19 04:29:47* YES 00:00:46

00:00:46
01/23/19 04:44:17 SPA Unexplained 01/23/19 04:44:17* YES 00:00:46
00:00:46
01/23/19 05:13:00 SPA Unexplained 01/23/19 05:13:00* YES 00:00:47
00:00:47
01/23/19 13:38:11 SPA Unexplained 01/23/19 13:38:11* YES 00:00:48
00:00:48
01/23/19 15:09:02 SPA Unexplained 01/23/19 15:09:02* YES 00:00:48
00:00:48
01/23/19 18:08:25 SPA Unexplained 01/23/19 18:08:25* YES 00:00:48
00:00:48
01/23/19 19:28:46 SPA Unexplained 01/23/19 19:28:46* YES 00:00:48
00:00:48
01/24/19 15:04:34 SPA Unexplained 01/24/19 15:04:34* YES 00:00:47
00:00:47
01/29/19 14:15:30 SPB Bugcheck 01/29/19 14:15:30* YES 00:01:23
00:01:23 00800148 CM_PANIC_BASE
02/04/19 03:55:22 SPB Unexplained 02/04/19 03:55:22* YES 00:04:02
00:04:02
02/04/19 03:55:35 SPA Unexplained 02/04/19 03:55:35* YES 00:07:28
00:07:28
02/04/19 10:56:37 SPA Unexplained 02/04/19 10:50:00 YES 00:10:01
00:03:24
02/04/19 11:02:33 SPA Unexplained 02/04/19 11:00:55 YES 00:05:38
00:04:00
02/04/19 11:36:59 SPA Unexplained 02/04/19 11:35:32 YES 00:05:11
00:03:44
02/04/19 12:24:27 SPA Unexplained 02/04/19 12:24:27* NO

02/04/19 12:29:24 SPA Unexplained 02/04/19 12:25:58 YES 00:07:12

00:03:46
02/04/19 12:58:26 SPA Unexplained 02/04/19 12:58:26* YES 00:03:35
00:03:35
02/04/19 14:48:32 SPA Unexplained 02/04/19 14:48:32* YES 00:04:01
00:04:01
02/04/19 17:01:56 SPA Unexplained 02/04/19 17:01:56* YES 00:03:03
00:03:03
02/04/19 20:47:27 SPA Unexplained 02/04/19 20:47:27* YES 00:03:52
00:03:52
02/04/19 22:59:46 SPA Unexplained 02/04/19 22:59:46* YES 00:03:20
00:03:20
02/05/19 00:32:25 SPA Unexplained 02/05/19 00:30:03 YES 00:06:22
00:04:00
02/05/19 09:23:52 SPA Unexplained 02/05/19 09:23:52* YES 00:04:33
00:04:33
02/06/19 08:50:22 SPA Unexplained 02/06/19 08:50:22* YES 00:03:34
00:03:34
02/06/19 17:38:47 SPA Unexplained 02/06/19 17:38:47* YES 00:04:07
00:04:07
02/06/19 18:04:26 SPA Unexplained 02/06/19 18:02:57 YES 00:05:13
00:03:44
02/06/19 18:15:55 SPA Unexplained 02/06/19 18:14:04 YES 00:05:38
00:03:47
02/06/19 18:24:25 SPA Unexplained 02/06/19 18:20:05 YES 00:08:33
00:04:13
02/06/19 20:09:15 SPA Unexplained 02/06/19 20:07:34 YES 00:05:14
00:03:33
02/06/19 23:58:53 SPA Unexplained 02/06/19 23:58:53* NO

02/07/19 00:03:28 SPA Unexplained 02/06/19 23:59:57 NO

02/07/19 00:43:51 SPA Unexplained 02/07/19 00:43:51* YES 00:03:59

00:03:59
02/07/19 00:56:31 SPA Unexplained 02/07/19 00:50:19 NO

02/07/19 01:03:13 SPA Unexplained 02/07/19 00:57:22 NO

02/07/19 05:35:22 SPA Unexplained 02/07/19 05:35:22* NO

02/07/19 05:45:57 SPA Unexplained 02/07/19 05:37:26 YES 00:12:16

00:03:45
02/07/19 08:19:50 SPA Unexplained 02/07/19 08:19:50* YES 00:03:27
00:03:27
02/07/19 10:17:34 SPA Unexplained 02/07/19 10:17:34* NO

02/07/19 11:04:52 SPA Unexplained 02/07/19 11:04:52* NO

02/07/19 12:12:05 SPA Unexplained 02/07/19 12:12:05* YES 00:04:18

00:04:18
02/07/19 12:26:03 SPA Unexplained 02/07/19 12:23:04 YES 00:07:06
00:04:07
02/07/19 15:01:36 SPA Unexplained 02/07/19 14:57:19 YES 00:08:04
00:03:47
02/07/19 18:14:39 SPA Unexplained 02/07/19 18:14:39* YES 00:03:58
00:03:58
02/07/19 18:52:22 SPA Unexplained 02/07/19 18:52:22* YES 00:03:45
00:03:45
02/07/19 20:13:35 SPA Unexplained 02/07/19 20:13:35* YES 00:03:25
00:03:25
02/07/19 21:20:40 SPA Unexplained 02/07/19 21:12:44 YES 00:13:22
00:05:26
02/08/19 00:00:36 SPA Unexplained 02/07/19 23:54:20 NO

02/08/19 00:03:53 SPA Unexplained 02/08/19 00:02:01 YES 00:05:59

00:04:07
02/08/19 04:36:49 SPA Unexplained 02/08/19 04:36:49* NO

02/08/19 07:25:54 SPA Unexplained 02/08/19 07:25:54* NO

02/08/19 07:31:08 SPA Unexplained 02/08/19 07:28:33 NO

02/08/19 07:36:02 SPA Unexplained 02/08/19 07:33:14 NO

02/08/19 07:40:59 SPA Unexplained 02/08/19 07:38:59 YES 00:05:32

00:03:32
02/08/19 08:05:49 SPA Unexplained 02/08/19 07:55:50 YES 00:14:13
00:04:14
02/08/19 15:33:40 SPA Unexplained 02/08/19 15:33:40* YES 00:03:47
00:03:47
02/09/19 08:07:10 SPA Unexplained 02/09/19 08:07:10* YES 00:04:00
00:04:00
02/09/19 09:07:57 SPA Unexplained 02/09/19 09:03:56 YES 00:07:57
00:03:56
02/09/19 09:45:38 SPA Unexplained 02/09/19 09:41:15 YES 00:07:41
00:03:18
02/09/19 09:59:05 SPA Unexplained 02/09/19 09:52:04 YES 00:10:24
00:03:23
02/09/19 10:52:31 SPA Unexplained 02/09/19 10:52:31* YES 00:03:39
00:03:39
02/09/19 16:00:24 SPA Unexplained 02/09/19 16:00:24* YES 00:03:24
00:03:24
02/10/19 04:56:05 SPA Unexplained 02/10/19 04:56:05* NO

02/10/19 09:14:13 SPA Unexplained 02/10/19 09:14:13* YES 00:03:32

00:03:32
02/10/19 18:54:32 SPA Unexplained 02/10/19 18:54:32* NO

02/10/19 18:58:50 SPA Unexplained 02/10/19 18:57:10 YES 00:05:45

00:04:05
02/10/19 19:10:10 SPA Unexplained 02/10/19 19:06:10 YES 00:08:09
00:04:09
02/10/19 19:56:01 SPA Unexplained 02/10/19 19:56:01* YES 00:03:25
00:03:25
02/10/19 23:52:08 SPA Unexplained 02/10/19 23:52:08* YES 00:03:46
00:03:46
02/11/19 01:30:07 SPA Unexplained 02/11/19 01:24:06 YES 00:10:54
00:04:53
02/11/19 02:54:20 SPA Unexplained 02/11/19 02:54:20* YES 00:03:33
00:03:33
02/11/19 16:03:46 SPA Unexplained 02/11/19 16:03:46* NO

02/11/19 16:06:30 SPA Unexplained 02/11/19 16:04:57 NO

02/11/19 16:13:56 SPA Unexplained 02/11/19 16:07:26 NO

02/11/19 16:24:47 SPA Unexplained 02/11/19 16:17:16 NO

02/11/19 17:30:31 SPA Unexplained 02/11/19 17:30:31* YES 00:04:51

00:04:51
02/11/19 17:42:53 SPA Unexplained 02/11/19 17:35:40 YES 00:11:20
00:04:07
02/11/19 19:11:57 SPA Unexplained 02/11/19 19:11:57* YES 00:03:26
00:03:26
02/11/19 20:45:45 SPA Unexplained 02/11/19 20:45:45* NO

02/11/19 21:34:31 SPA Unexplained 02/11/19 21:34:31* NO

02/11/19 22:42:00 SPA Unexplained 02/11/19 22:42:00* YES 00:03:55

00:03:55
02/12/19 01:37:44 SPA Unexplained 02/12/19 01:37:44* YES 00:03:22
00:03:22
02/12/19 02:10:35 SPA Unexplained 02/12/19 02:08:31 YES 00:05:22
00:03:18
02/12/19 03:34:51 SPA Unexplained 02/12/19 03:34:51* YES 00:03:59
00:03:59
02/12/19 03:54:11 SPA Unexplained 02/12/19 03:52:39 YES 00:05:34
00:04:02
02/12/19 06:41:11 SPA Unexplained 02/12/19 06:41:11* YES 00:03:40
00:03:40
02/12/19 09:26:25 SPA Unexplained 02/12/19 09:26:25* YES 00:02:30
00:02:30
02/12/19 09:55:08 SPA Unexplained 02/12/19 09:55:08* YES 00:00:50
00:00:50
02/12/19 10:59:43 SPA Unexplained 02/12/19 10:57:25 YES 00:03:10
00:00:52
02/12/19 11:10:05 SPA Unexplained 02/12/19 11:08:00 YES 00:02:55
00:00:50
02/12/19 11:15:04 SPA Unexplained 02/12/19 11:12:31 YES 00:03:23
00:00:50
02/12/19 14:25:11 SPA Unexplained 02/12/19 14:25:11* YES 00:00:50
00:00:50
02/12/19 18:24:16 SPA Unexplained 02/12/19 18:24:16* YES 00:00:48
00:00:48
02/12/19 18:51:49 SPA Unexplained 02/12/19 18:48:50 YES 00:03:48
00:00:49
02/14/19 18:41:40 SPA Unexplained 02/14/19 18:41:40* YES 00:00:49
00:00:49
02/27/19 15:34:42 SPB Unexplained 02/27/19 15:34:42* YES 00:01:34
00:01:34
02/27/19 15:34:45 SPA Unexplained 02/27/19 15:34:45* YES 00:01:35
00:01:35

* = Event Time is the timestamp of the last log entry prior to reboot.

B 02/04/19 10:56:43 cmid 71310008 CMID Transport Device 0: Gate 0

connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/04/19 11:02:39 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/04/19 11:30:02 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/04/19 11:35:13 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/04/19 11:37:05 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/04/19 12:07:36 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/04/19 12:24:34 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/04/19 12:29:30 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/04/19 12:58:32 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/04/19 14:48:38 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
[ 59 lines deleted ]
B 02/11/19 17:30:38 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/11/19 17:43:02 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/11/19 19:12:04 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/11/19 20:45:53 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/11/19 21:34:38 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/11/19 22:42:07 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/12/19 01:37:51 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/12/19 02:10:42 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/12/19 03:34:58 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/12/19 03:54:18 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/12/19 06:41:18 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/12/19 09:26:32 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/12/19 09:55:15 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/12/19 10:59:51 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/12/19 11:10:12 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/12/19 11:15:11 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/12/19 14:25:18 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/12/19 18:24:23 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/12/19 18:51:56 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)
B 02/14/19 18:41:48 cmid 71310008 CMID Transport Device 0: Gate 0
connects to SP ID 0x5d50a0bb60010650:0 (Signature 0x38fb71)

***********************************************************************************
***********
SP Skipping Unquiesce, SP in HFOFF mode, SP reboots unsuccessfully (Degraded)
INFORMATION
***********************************************************************************
***********
DGSSP 76000100 Normal vs unexpected reboots -------------------
A 01/18/19 19:27:09 DGSSP 76000100 75 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 01/19/19 02:37:22 DGSSP 76000100 76 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 01/19/19 15:27:44 DGSSP 76000100 77 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 01/19/19 15:35:55 DGSSP 76000100 78 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 01/19/19 16:13:40 DGSSP 76000100 79 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 01/20/19 03:59:57 DGSSP 76000100 80 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 01/20/19 04:04:47 DGSSP 76000100 81 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 01/20/19 13:37:13 DGSSP 76000100 82 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 01/20/19 13:45:02 DGSSP 76000100 83 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 01/20/19 14:21:15 DGSSP 76000100 85 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
[ 70 lines deleted ]
A 02/11/19 02:58:01 DGSSP 76000100 185 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/11/19 17:47:09 DGSSP 76000100 192 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/11/19 19:15:33 DGSSP 76000100 193 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/11/19 22:46:03 DGSSP 76000100 196 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/12/19 01:41:14 DGSSP 76000100 197 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/12/19 02:14:01 DGSSP 76000100 198 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/12/19 03:38:59 DGSSP 76000100 199 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/12/19 03:58:21 DGSSP 76000100 200 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/12/19 06:45:00 DGSSP 76000100 201 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/12/19 09:29:04 DGSSP 76000100 202 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/12/19 09:56:07 DGSSP 76000100 203 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/12/19 11:00:44 DGSSP 76000100 204 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/12/19 11:11:04 DGSSP 76000100 205 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/12/19 11:16:02 DGSSP 76000100 206 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/12/19 14:26:10 DGSSP 76000100 207 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/12/19 18:25:13 DGSSP 76000100 208 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/12/19 18:52:46 DGSSP 76000100 209 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/14/19 18:42:38 DGSSP 76000100 210 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
B 02/27/19 15:36:25 DGSSP 76000100 3 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
A 02/27/19 15:36:29 DGSSP 76000100 211 normal reboot(s) since the
last unexpected reboot; 0 unexpected reboot(s) since the last normal reboot
71518011 Either an SP unexpectedly rebooted -------------------
SP Removed ----------------------------------------------------
B 02/04/19 10:50:00 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 11:00:55 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 11:25:12 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 11:30:32 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 11:35:32 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 11:59:37 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 12:07:53 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 12:25:58 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 12:34:32 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 13:13:03 SP A a23 Peer SP Down.
3 0 0
[ 60 lines deleted ]
B 02/11/19 17:35:40 SP A a23 Peer SP Down.
3 0 0
B 02/11/19 17:53:22 SP A a23 Peer SP Down.
3 0 0
B 02/11/19 19:15:56 SP A a23 Peer SP Down.
3 0 0
B 02/11/19 20:49:44 SP A a23 Peer SP Down.
3 0 0
B 02/11/19 21:37:07 SP A a23 Peer SP Down.
3 0 0
B 02/11/19 22:48:27 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 02:08:31 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 02:31:41 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 03:52:39 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 05:00:02 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 06:49:53 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 09:33:59 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 10:57:25 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 11:08:00 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 11:12:31 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 14:13:21 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 14:36:08 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 18:48:50 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 21:54:13 SP A a23 Peer SP Down.
3 0 0
B 02/14/19 19:11:01 SP A a23 Peer SP Down.
3 0 0
944 Hard Peer Bus Error ---------------------------------------
B 02/04/19 10:50:00 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
B 02/04/19 10:50:00 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
B 02/04/19 11:00:55 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
B 02/04/19 11:00:55 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
B 02/04/19 11:25:12 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
B 02/04/19 11:25:12 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
B 02/04/19 11:30:32 SP B 944 Hard Peer Bus Error
2 a242f7a8 0
B 02/04/19 11:35:32 SP B 944 Hard Peer Bus Error
2 a242f7a8 0
B 02/04/19 11:59:37 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
B 02/04/19 11:59:37 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
[ 125 lines deleted ]
B 02/12/19 06:49:53 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
B 02/12/19 06:49:53 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
B 02/12/19 09:33:59 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
B 02/12/19 09:33:59 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
B 02/12/19 10:57:25 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
B 02/12/19 10:57:25 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
B 02/12/19 11:08:00 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
B 02/12/19 11:08:00 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
B 02/12/19 11:12:31 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
B 02/12/19 11:12:31 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
B 02/12/19 14:13:21 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
B 02/12/19 14:13:21 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
B 02/12/19 14:36:08 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
B 02/12/19 14:36:08 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
B 02/12/19 18:48:50 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
B 02/12/19 18:48:50 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
B 02/12/19 21:54:13 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
B 02/12/19 21:54:13 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
B 02/14/19 19:11:01 SP B 944 Hard Peer Bus Error
2 a24b3cc4 0
B 02/14/19 19:11:01 SP B 944 Hard Peer Bus Error
1 a24b3cf4 0
Reboot requested ----------------------------------------------

***********************************************************************************
***********
INVALID CHECKPOINT INFORMATION
[Checkpoint Script]
***********************************************************************************
***********
***********************************************************************************
***********
ARRAY HARDWARE ERROR INFORMATION
1. DMI ( Desktop Management Interface ) log entries reported by DGSSP.
***********************************************************************************
***********
Flare Driver Reported COMPONENT Faults ------------------------
B 02/04/19 11:33:28 SP A 7127ca2a SP is faulted. Fault Code: 0.
FRU: SP board - Part Number: SeeNavi should be replaced.
B 02/04/19 12:02:30 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/04/19 12:44:11 SP A 7127ca2a SP is faulted. Fault Code: 0.
FRU: SP board - Part Number: SeeNavi should be replaced.
B 02/04/19 12:46:58 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/04/19 13:17:58 SP A 7127ca2d SP is in a hung state. The
state code is: 57. Last state entered was: 'POST testing CPU module '.
B 02/04/19 13:26:11 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/06/19 08:18:18 SP A 7127ca2a SP is faulted. Fault Code: 0.
FRU: SP board - Part Number: SeeNavi should be replaced.
B 02/06/19 08:21:35 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/06/19 16:39:04 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/06/19 16:55:45 SP A 7127ca2d SP is in a hung state. The
state code is: 57. Last state entered was: 'POST testing CPU module '.
[ 18 lines deleted ]
B 02/07/19 17:59:13 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/07/19 18:05:44 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/07/19 21:16:49 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/08/19 04:26:26 SP A 7127ca2d SP is in a hung state. The
state code is: 45. Last state entered was: 'O/S running'.
B 02/08/19 04:53:50 SP A 7127ca2d SP is in a hung state. The
state code is: 57. Last state entered was: 'POST testing CPU module '.
B 02/08/19 05:18:59 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/08/19 12:28:20 SP A 7127ca2d SP is in a hung state. The
state code is: 45. Last state entered was: 'O/S running'.
B 02/08/19 19:56:14 SP A 7127ca2d SP is in a hung state. The
state code is: 45. Last state entered was: 'O/S running'.
B 02/09/19 07:24:31 SP A 7127ca2a SP is faulted. Fault Code: 0.
FRU: SP board - Part Number: SeeNavi should be replaced.
B 02/09/19 07:26:07 SP A 7127ca2d SP is in a hung state. The
state code is: 59. Last state entered was: 'BIOS testing CPU module & I/O module
0'.
B 02/09/19 08:17:57 SP A 7127ca2d SP is in a hung state. The
state code is: 58. Last state entered was: 'POST operation complete'.
B 02/09/19 09:54:12 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/09/19 10:41:53 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/10/19 05:00:47 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/10/19 12:05:23 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/11/19 15:11:47 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/11/19 16:19:19 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/11/19 16:30:22 SP A 7127ca2d SP is in a hung state. The
state code is: 57. Last state entered was: 'POST testing CPU module '.
B 02/11/19 19:18:12 SP A 7127ca2d SP is in a hung state. The
state code is: 62. Last state entered was: 'BIOS testing CPU module & all DIMMs '.
B 02/12/19 17:31:42 SP A 7127ca2d SP is in a hung state. The
state code is: 57. Last state entered was: 'POST testing CPU module '.
DGSSP entries -------------------------------------------------

***********************************************************************************
***********
FRU and DRT ISSUES INFORMATION [FRUcheck and
DRTcheck Scripts]
***********************************************************************************
***********

---------- Reported SP CRU flag errors:

***********************************************************************************
***********
FCOSCAN INFORMATION
[Fcoscan Script]
Decode Information:
http://opseroom02.corp.emc.com/eRoom/SPOmidrangesysdiv/sustaining/0_bcb49
***********************************************************************************
***********

***********************************************************************************
***********
DISK ERROR SUMMARY INFORMATION
[DiskSummary Script]
***********************************************************************************
***********

Disk Hard Soft PFA& Abort Remap Xfer Tmout Par Bad Inval
Recon Recov
Drive Rg Type Media Media Hdwr ByDev Errs Errs Errs ity Blks Sects
Sects ByDrv
0.0.0 0 r5 0 0 0 0 0 0 54 0 0 0
0 0
0.0.1 0 r5 0 0 0 0 0 0 1 0 0 0
0 0
0.0.2 0 r5 0 0 0 0 0 0 51 0 0 0
0 0
0.0.5 1 hs 0 0 1 0 0 0 0 0 0 0
0 0
0.0.9 8 r5 0 1 5 0 0 0 7 0 1 0
0 28
0.1.0 9 r5 0 0 0 0 0 0 0 0 0 0
0 25
0.1.1 9 r5 0 3 367 0 0 0 1132 0 3 0
1 0
0.2.5 11 r5 0 0 0 0 0 0 0 0 0 0
0 4
0.2.11 19 hs 0 0 328 0 0 0 1137 0 0 0
0 0
***********************************************************************************
***********
RAID GROUP ERROR SUMMARY INFORMATION
[DiskSummary Script]
***********************************************************************************
***********
This table provides a summary of the health of a raid group. Consider running RAID
GROUP
HEALTH CHECK [rghc -help for usage] against any disk{s} listed in the last column.
RGHC
analyzes a RG in detail and determines if it safe to proactively replace a disk.
***********************************************************************************
***********

Raid Hard Soft PFA& Abort Remap Xfer Tmout Par Bad Inval
Recon Recov Affected
Group RgType State Media Media Hdwr ByDev Errs Errs Errs ity Blks Sects
Sects ByDrv Disks
0 r5 ENA 0 0 0 0 0 0 106 0 0 0
0 0 0.0.0 0.0.1 0.0.2
1 hs BRK* 0 0 1 0 0 0 0 0 0 0
0 0 0.0.5
8 r5 ENA 0 1 5 0 0 0 7 0 1 0
0 28 0.0.9
9 r5 ENA 0 3 367 0 0 0 1132 0 3 0
1 25 0.1.0 0.1.1
11 r5 ENA 0 0 0 0 0 0 0 0 0 0
0 4 0.2.5
19 hs BRK* 0 0 328 0 0 0 1137 0 0 0
0 0 0.2.11

***********************************************************************************
***********
DISK CHECK INFORMATION
[diskcheck Script]
***********************************************************************************
***********

Could not find 'diskcheck.dat' file

***********************************************************************************
***********
PROACTIVE COPY INFORMATION
[paco Script]
***********************************************************************************
***********

Disk TLA Status Start Time End Time

----------------- ------------- ------ ----------------- -----------------

***********************************************************************************
***********
RAID GROUP DAMAGE INFORMATION
[RGdamage Script]
***********************************************************************************
***********

A TRiiAGE_RGdamage.txt file has been created listing invalidation counts per LBA.
This output
displays log entry counts and is not a substitute for the exact number of
invalidated sectors
reported by a BGverify.

***********************************************************************************
***********
FLARE CHECKSUM INFORMATION
[AnalyzeChecksum Script]
***********************************************************************************
***********

Checksum Errors detected by SPA: 0

Checksum Errors detected by SPB: 0

***********************************************************************************
***********
RAIDGROUP ISSUE INFORMATION
[RGcheck Script]
***********************************************************************************
***********

Raidgroup 1 has 1 out of 1 shutdown disks! (Disks: Bus0 Enc0 Dsk5)

Raidgroup 19 has 1 out of 1 shutdown disks! (Disks: Bus0 Enc2 DskB)

Raidgroups with one or more bad disks: 2

Raidgroup 1 has 1 out of 1 shutdown disks! (Disks: Bus0 Enc0 Dsk5)
Raidgroup 19 has 1 out of 1 shutdown disks! (Disks: Bus0 Enc2 DskB)

Raidgroups with one or more bad disks: 2

***********************************************************************************
***********
STUCK REMAP INFORMATION
[StuckRemap Script]
***********************************************************************************
***********

This is a check for illegal block counts [aka HS STUCK REMAP] and new remap start
requests
that aren't followed by completions [aka UNBIND STUCK REMAP]. The HS issue is
fixed in
R19.034, R16.024 or Vulcan R22.505. The UNBIND issue is fixed in R19.040, R22.510
and R24.
Both SP_kt_std.txt files must be available for the results to be accurate. A
summary of the
results is displayed here. This summary is also displayed at the beginning of the
TRiiAGE_Ktracelogs.txt file along with a more verbose output.
Recovery Procedure:
http://opseroom02.corp.emc.com/eRoom/SPOmidrangesustaining/0_5b354

***********************************************************************************
***********
Summary display of Stuck Remaps if applicable:

***********************************************************************************
***********
FLARECENTRIC LOG ERROR REPORTING INFORMATION
Many extended status entries not decoded in brackets are documented in the Ulog
extended
status document:
http://opseroom02.corp.emc.com/eRoom/SPOmidrangesysdiv/sustaining/0_7d84c
***********************************************************************************
***********

If one error occurs, run a BGverify. If there are two or more errors reported
against the same
disk, replace the disk.

0x7611B000 BE Redirect Started, 0x7611B001 Cancelled ----------

741b/7216 [Missing CFD= Critical Foreign Drive] errors --------
B 02/07/19 06:16:58 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/07/19 08:46:19 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/07/19 09:31:47 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/07/19 11:22:30 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/07/19 11:25:32 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
A 02/07/19 19:08:41 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/08/19 04:59:46 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/08/19 05:02:49 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/08/19 05:39:22 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
A 02/08/19 15:41:50 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
[ 46 lines deleted ]
B 02/14/19 20:25:48 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/14/19 23:14:09 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/14/19 23:27:48 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 01:54:57 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 02:14:45 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 06:45:00 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 06:54:09 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 07:00:15 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 07:07:52 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 11:24:10 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 13:42:36 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 16:27:56 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 19:10:10 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 19:40:37 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 19:43:40 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 20:00:26 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/15/19 21:39:12 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
A 02/27/19 15:37:07 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
A 02/27/19 16:48:26 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
B 02/27/19 17:03:54 Bus0 Enc0 Dsk9 741b Disk was removed from the
storage system.
b3c START, b3d ABORT, b3e COMPLETE [Read-Only BV] -------------
b09 RST, b0a OFF, b0b UP, boc DOWN: USER STATE CHANGES -------
Navi or Fcli USER initiated disk state change event count: 0

a52 Commit, a53 Slot, a54 WWNseed, a55 LUN: CRU SIG Errors ---
a51 LBA Stamp Error Detected, Should help isolate COH errors --
a50 -----------------------------------------------------------

Checksum Errors detected by SPA: 0

Checksum Errors detected by SPB: 0

a4c/a4d/684/689 [Disk CRC reconstruct events] -----------------

a4b / COHerency error Enhanced Detailed Output-----------------

***********************************************************************************
***********
COHERENCY INFORMATION
[CoherencyCheck Script]
Coherency error entries listed as "Expected" are a secondary effect of an SP reboot
or sudden
loss of access to a given enclosure or enclosures while write operations are in
progress [i.e.
during a site AC power fail event]. These messages are indicative of the fact that
FLARE has
taken the necessary actions to recover from the event. These entries should not be
of concern
and can safely be ignored.
***********************************************************************************
***********

Total Coherency Errors: 0 (0 Expected 0 Unexpected)

a37-a43/98d [Copy to Hot Spare errors, aka Proactive Sparing] -
a31/a25/88a/878/855/852/851/850/7a8 [Enclosure events] --------
A 01/19/19 02:36:54 Bus0 Enc2 a25 Enclosure state change
[missing->ok] 1 0 0
A 01/19/19 02:36:54 Bus0 Enc3 a25 Enclosure state change
[missing->ok] 1 0 0
A 01/19/19 02:36:54 Bus0 Enc1 a25 Enclosure state change
[missing->ok] 1 0 0
A 01/19/19 15:27:13 Bus0 Enc3 a25 Enclosure state change
[missing->ok] 1 0 0
A 01/19/19 15:27:13 Bus0 Enc1 a25 Enclosure state change
[missing->ok] 1 0 0
A 01/19/19 15:27:13 Bus0 Enc2 a25 Enclosure state change
[missing->ok] 1 0 0
A 01/19/19 15:35:28 Bus0 Enc3 a25 Enclosure state change
[missing->ok] 1 0 0
A 01/19/19 15:35:28 Bus0 Enc1 a25 Enclosure state change
[missing->ok] 1 0 0
A 01/19/19 15:35:28 Bus0 Enc2 a25 Enclosure state change
[missing->ok] 1 0 0
A 01/19/19 16:13:11 Bus0 Enc3 a25 Enclosure state change
[missing->ok] 1 0 0
[ 312 lines deleted ]
A 02/12/19 11:15:31 Bus0 Enc1 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/12/19 11:15:31 Bus0 Enc2 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/12/19 14:25:38 Bus0 Enc3 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/12/19 14:25:38 Bus0 Enc1 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/12/19 14:25:38 Bus0 Enc2 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/12/19 18:24:43 Bus0 Enc3 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/12/19 18:24:43 Bus0 Enc1 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/12/19 18:24:43 Bus0 Enc2 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/12/19 18:52:16 Bus0 Enc3 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/12/19 18:52:16 Bus0 Enc1 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/12/19 18:52:16 Bus0 Enc2 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/14/19 18:42:07 Bus0 Enc3 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/14/19 18:42:07 Bus0 Enc1 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/14/19 18:42:07 Bus0 Enc2 a25 Enclosure state change
[missing->ok] 1 0 0
B 02/27/19 15:35:12 Bus0 Enc1 a25 Enclosure state change
[missing->ok] 1 0 0
B 02/27/19 15:35:12 Bus0 Enc2 a25 Enclosure state change
[missing->ok] 1 0 0
B 02/27/19 15:35:12 Bus0 Enc3 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/27/19 15:35:29 Bus0 Enc3 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/27/19 15:35:29 Bus0 Enc1 a25 Enclosure state change
[missing->ok] 1 0 0
A 02/27/19 15:35:29 Bus0 Enc2 a25 Enclosure state change
[missing->ok] 1 0 0
a23 Peer SP Down ----------------------------------------------
B 02/04/19 10:50:00 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 11:00:55 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 11:25:12 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 11:30:32 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 11:35:32 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 11:59:37 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 12:07:53 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 12:25:58 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 12:34:32 SP A a23 Peer SP Down.
3 0 0
B 02/04/19 13:13:03 SP A a23 Peer SP Down.
3 0 0
[ 60 lines deleted ]
B 02/11/19 17:35:40 SP A a23 Peer SP Down.
3 0 0
B 02/11/19 17:53:22 SP A a23 Peer SP Down.
3 0 0
B 02/11/19 19:15:56 SP A a23 Peer SP Down.
3 0 0
B 02/11/19 20:49:44 SP A a23 Peer SP Down.
3 0 0
B 02/11/19 21:37:07 SP A a23 Peer SP Down.
3 0 0
B 02/11/19 22:48:27 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 02:08:31 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 02:31:41 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 03:52:39 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 05:00:02 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 06:49:53 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 09:33:59 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 10:57:25 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 11:08:00 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 11:12:31 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 14:13:21 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 14:36:08 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 18:48:50 SP A a23 Peer SP Down.
3 0 0
B 02/12/19 21:54:13 SP A a23 Peer SP Down.
3 0 0
B 02/14/19 19:11:01 SP A a23 Peer SP Down.
3 0 0
a18 CRU Drive Causing Loop Failure ----------------------------
a24 Drive has a bad transmitter -------------------------------
a17 CRU Unformatted -------------------------------------------
a09 CRU Drive too Small ---------------------------------------
a08 Database Sync Error ---------------------------------------
a07 CRU Powered Down/BE Fault Recovery ------------------------
[a07 CRU OR 799 Peer Requested Down OR 7a5-7 Drive Removed OR
7ab CRU REM OR 7ac CRU INS OR 4600 CRU_ON_OFF OR Disk Failed] -
B 01/29/19 14:16:13 Bus0 Enc0 Dsk9 a07 CRU Powered Down [DH: Select
timeout DHRequested] 0 ffff000d 70d
B 01/29/19 14:16:13 Bus0 Enc0 Dsk9 a07 CRU Powered Down [CM: Killed by
CM DHRequested] 0 ffff000d 920c
B 01/29/19 14:16:13 Bus0 Enc0 Dsk9 7127897c Disk failed or was physically
removed.TLA Part Number is 005048960, Serial Number is 3SS05D1B .
B 01/29/19 14:16:13 Bus0 Enc0 Dsk9 7127897c Disk failed or was physically
removed.TLA Part Number is 005048960, Serial Number is 3SS05D1B .
B 01/29/19 14:16:53 Bus0 Enc0 Dsk9 7a5 Drive removed, seen by local
SP. [queued] 0 80009 10001
B 01/29/19 14:16:53 Bus0 Enc0 Dsk9 7a7 Drive removed, seen by either
SP, acknowledged by both SPs completes. 0 80009 10000
B 01/29/19 16:09:36 Bus0 Enc1 Dsk1 7127897c Disk failed or was physically
removed.TLA Part Number is 005048960, Serial Number is 3SS03RAQ .
B 01/29/19 16:09:36 Bus0 Enc1 Dsk1 7a7 Drive removed, seen by either
SP, acknowledged by both SPs completes. 0 9000d 10000
B 01/29/19 16:09:36 Bus0 Enc1 Dsk1 7a5 Drive removed, seen by local
SP. [queued] 0 9000d 10001
B 01/29/19 16:09:36 Bus0 Enc1 Dsk1 a07 CRU Powered Down [DH: Hardware
error DHRequested] 0 ffff000d 90d
[ 2000 lines deleted ]
A 02/27/19 16:47:50 Bus0 Enc0 Dsk5 a07 CRU Powered Down [CM: Killed by
CM DHRequested] 0 ffff000d 920c
A 02/27/19 16:47:52 Bus0 Enc0 Dsk9 78b Drive physically removed from
slot 0 0 0
A 02/27/19 16:49:07 Bus0 Enc0 Dsk9 78c Drive physically inserted into
slot 0 0 0
B 02/27/19 16:49:07 Bus0 Enc0 Dsk9 78c Drive physically inserted into
slot 0 0 0
B 02/27/19 16:49:09 Bus0 Enc0 Dsk9 7127897c Disk failed or was physically
removed.TLA Part Number is 005048960, Serial Number is 3SS05D1B .
B 02/27/19 16:49:09 Bus0 Enc0 Dsk5 a07 CRU Powered Down [CM: Killed by
CM PhsicallyRemoved] 0 ffff0001 920c
B 02/27/19 16:49:09 Bus0 Enc0 Dsk5 799 Peer Requested Drive Power
Down. 0 0 9
A 02/27/19 16:49:10 Bus0 Enc0 Dsk9 78b Drive physically removed from
slot 0 0 0
A 02/27/19 16:49:10 Bus0 Enc0 Dsk5 a07 CRU Powered Down [CM: Killed by
CM PhsicallyRemoved] 0 ffff0001 920c
A 02/27/19 16:49:10 Bus0 Enc0 Dsk9 7127897c Disk failed or was physically
removed.TLA Part Number is 005048960, Serial Number is 3SS05D1B .
B 02/27/19 16:49:10 Bus0 Enc0 Dsk9 78b Drive physically removed from
slot 0 0 0
A 02/27/19 17:01:25 Bus0 Enc0 Dsk9 78c Drive physically inserted into
slot 0 0 0
B 02/27/19 17:01:25 Bus0 Enc0 Dsk9 78c Drive physically inserted into
slot 0 0 0
B 02/27/19 17:03:06 Bus0 Enc0 Dsk9 7127897c Disk failed or was physically
removed.TLA Part Number is 005048960, Serial Number is 3SS05D1B .
B 02/27/19 17:03:06 Bus0 Enc0 Dsk5 a07 CRU Powered Down [CM: Killed by
CM PhsicallyRemoved] 0 ffff0001 920c
B 02/27/19 17:03:06 Bus0 Enc0 Dsk5 799 Peer Requested Drive Power
Down. 0 0 9
A 02/27/19 17:03:07 Bus0 Enc0 Dsk9 7127897c Disk failed or was physically
removed.TLA Part Number is 005048960, Serial Number is 3SS05D1B .
A 02/27/19 17:03:07 Bus0 Enc0 Dsk5 a07 CRU Powered Down [CM: Killed by
CM PhsicallyRemoved] 0 ffff0001 920c
A 02/27/19 17:03:07 Bus0 Enc0 Dsk9 78b Drive physically removed from
slot 0 0 0
B 02/27/19 17:03:11 Bus0 Enc0 Dsk9 78b Drive physically removed from
slot 0 0 0
985 Unit init OR 986 Unrecoverable [Fast Bind] errors ---------
90a/966 Write Cache -------------------------------------------

***********************************************************************************
***********
CORRECTED UNCORRECTABLE INFORMATION
[BVA_Check Script]
***********************************************************************************
***********

True Uncorrectable Errors = 0 Corrected Error Count = 0

960/961/784/783 Power Issues ----------------------------------

953/957/71248003 Uncorrectable Sector -------------------------
953/957 Uncorrectable Sector due to media errors --------------
***********************************************************************************
***********
%%%%% Ulog_extended_status_1.2.doc: C:\Program Files
(x86)\EMC\NGTRiiAGE\Ulog_extended_status_1.2.doc %%%%%
***********************************************************************************
***********
951 CRU Signature ---------------------------------------------
941 Battery Online --------------------------------------------
920 Hard Media Error ------------------------------------------
90a Can't Assign ----------------------------------------------
906 Unit Shutdown ---------------------------------------------
B 01/29/19 14:16:53 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
B 01/29/19 16:09:36 Bus0 Enc2 DskB 906 Unit Shutdown [ALU 201]
0 130013 c90023
B 02/06/19 07:03:32 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
A 02/06/19 07:03:35 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
B 02/07/19 06:16:07 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
A 02/07/19 06:16:09 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
B 02/07/19 14:39:47 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
A 02/07/19 14:39:49 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
B 02/07/19 19:08:08 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
A 02/07/19 19:08:10 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
B 02/08/19 04:53:46 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
B 02/08/19 15:40:44 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
A 02/08/19 15:40:46 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
B 02/14/19 08:39:43 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
B 02/14/19 12:17:32 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
B 02/15/19 01:35:45 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
B 02/15/19 06:06:50 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
B 02/15/19 11:23:58 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
B 02/15/19 18:56:01 Bus0 Enc0 Dsk5 906 Unit Shutdown [ALU 200]
0 10000 c80005
904 VSC Shutdown OR Overtemp, 988 XPE Overtemp, 88d Overtemp -
***********************************************************************************
***********
1. CX non-stiletto DAE VSCs parallel 12 volts, A-branch feeds LCCA and disks 2-9,
B-branch feeds LCCB and disks 0,1,10-14.
If the 12 volts shorts out, all of the disks on the branch will be shut down.
Look for a07 entries.
If the 12 volts is removed, all of the disks in the ENC and LCC will be shut
down.
2. CX stiletto DAE VSCs parallel 12 volts, A-branch feeds LCCA and disks
2,3,6,7,10,11,14.
3. Reference KB 427053 for over temperature sensing. Indicates an ENC temperature
exceeded 55c.
***********************************************************************************
***********
A 01/19/19 02:36:54 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
A 01/19/19 15:27:13 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
A 01/19/19 15:35:28 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
A 01/19/19 16:13:11 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
A 01/20/19 03:59:27 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
A 01/20/19 04:04:16 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
A 01/20/19 13:36:45 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
A 01/20/19 13:44:34 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
A 01/20/19 14:20:47 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
A 01/20/19 14:29:21 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
[ 518 lines deleted ]
B 02/14/19 19:10:52 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/15/19 19:51:41 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/15/19 19:53:56 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/15/19 19:54:06 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/15/19 19:59:01 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/15/19 19:59:17 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/15/19 20:10:50 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/15/19 20:29:58 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/15/19 20:34:40 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/15/19 20:40:45 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/15/19 22:25:31 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/15/19 22:27:26 Bus0 Enc0 PowA 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/27/19 15:35:12 Bus0 Enc3 PowB 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/27/19 15:35:12 Bus0 Enc3 PowB 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/27/19 15:35:12 Bus0 Enc3 PowB 904 VSC Shutdown/Removed [Faulted]
0 0 4
B 02/27/19 15:35:14 Bus0 Enc3 PowB 904 VSC Shutdown/Removed [Faulted]
0 0 4
A 02/27/19 15:35:29 Bus0 Enc3 PowB 904 VSC Shutdown/Removed [Faulted]
0 0 4
A 02/27/19 15:35:29 Bus0 Enc3 PowB 904 VSC Shutdown/Removed [Faulted]
0 0 4
A 02/27/19 15:35:29 Bus0 Enc3 PowB 904 VSC Shutdown/Removed [Faulted]
0 0 4
A 02/27/19 15:35:31 Bus0 Enc3 PowB 904 VSC Shutdown/Removed [Faulted]
0 0 4
873 CMI Connection is degraded --------------------------------
B 02/04/19 11:02:40 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/04/19 12:24:35 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/04/19 12:29:30 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/04/19 12:58:33 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/04/19 22:59:53 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/05/19 00:32:32 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/05/19 09:23:59 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/06/19 08:50:30 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/06/19 15:52:44 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/06/19 20:09:23 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
[ 7 lines deleted ]
B 02/08/19 00:04:01 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/08/19 04:36:58 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/08/19 07:31:15 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/09/19 09:08:05 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/09/19 09:45:46 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/09/19 10:52:39 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/10/19 09:14:21 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/10/19 18:58:58 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/11/19 01:30:15 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/11/19 16:03:53 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/11/19 16:06:37 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/11/19 16:14:03 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/11/19 17:43:02 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/12/19 03:34:58 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/12/19 09:55:16 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/12/19 10:57:14 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/12/19 11:12:19 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/12/19 14:25:19 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/12/19 18:24:24 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
B 02/14/19 18:41:48 SP B 873 Flare's ATM detects one CMI
connection is down. 0 0 0
866 LCC Mcode upgrade error -----------------------------------
853 LCC Cables crossed ----------------------------------------
820 Soft Media Error ------------------------------------------
B 01/29/19 16:07:53 Bus0 Enc1 Dsk1 820 Soft Media Error [Bad block]
0 0 5
B 01/29/19 16:07:56 Bus0 Enc1 Dsk1 820 Soft Media Error [Bad block]
0 0 5
B 01/29/19 16:08:08 Bus0 Enc1 Dsk1 820 Soft Media Error [Bad block]
0 0 5
A 02/08/19 10:18:07 Bus0 Enc0 Dsk9 820 Soft Media Error [Bad block]
0 0 5
803 Recommend Disk --------------------------------------------
B 01/29/19 14:16:12 Bus0 Enc0 Dsk9 803 Recommend Disk Replacement [PFA
threshold reached] 0 0 19
B 01/29/19 16:06:46 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
B 01/29/19 16:06:55 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
B 01/29/19 16:06:55 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
B 01/29/19 16:06:56 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
B 01/29/19 16:06:57 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
B 01/29/19 16:06:58 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
B 01/29/19 16:06:58 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
B 01/29/19 16:06:59 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
B 01/29/19 16:07:00 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
[ 673 lines deleted ]
A 02/12/19 06:42:55 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 06:42:55 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 06:42:55 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 06:42:55 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 06:42:55 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 06:42:59 Bus0 Enc2 DskB 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 06:43:05 Bus0 Enc2 DskB 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 06:43:11 Bus0 Enc2 DskB 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 06:43:17 Bus0 Enc2 DskB 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 06:43:45 Bus0 Enc2 DskB 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 06:43:51 Bus0 Enc2 DskB 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 06:43:57 Bus0 Enc2 DskB 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 09:27:54 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 09:27:54 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 09:27:54 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 09:27:54 Bus0 Enc1 Dsk1 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 09:28:21 Bus0 Enc2 DskB 803 Recommend Disk Replacement
[Hardware error] 0 0 9
A 02/12/19 09:28:22 Bus0 Enc2 DskB 803 Recommend Disk Replacement
[Hardware error] 0 0 9
B 02/27/19 15:35:12 Bus0 Enc0 Dsk9 803 Recommend Disk Replacement [PFA
threshold reached] 0 0 19
A 02/27/19 15:35:29 Bus0 Enc0 Dsk9 803 Recommend Disk Replacement [PFA
threshold reached] 0 0 19
801 Soft SCSI Bus Error ---------------------------------------
B 01/29/19 14:34:05 Bus0 Enc1 Dsk1 801 Soft SCSI Bus Error [Command
timeout] 0 0 6
B 01/29/19 15:04:16 Bus0 Enc1 Dsk1 801 Soft SCSI Bus Error [Command
timeout] 0 0 6
B 01/29/19 15:04:21 Bus0 Enc1 Dsk1 801 Soft SCSI Bus Error [Command
timeout] 0 0 6
B 01/29/19 15:05:52 Bus0 Enc1 Dsk1 801 Soft SCSI Bus Error [Command
timeout] 0 0 6
B 01/29/19 15:14:30 Bus0 Enc1 Dsk1 801 Soft SCSI Bus Error [Command
timeout] 0 0 6
B 01/29/19 15:16:01 Bus0 Enc1 Dsk1 801 Soft SCSI Bus Error [Command
timeout] 0 0 6
B 01/29/19 15:26:08 Bus0 Enc1 Dsk1 801 Soft SCSI Bus Error [Command
timeout] 0 0 6
B 01/29/19 15:44:18 Bus0 Enc1 Dsk1 801 Soft SCSI Bus Error [Command
timeout] 0 0 6
B 01/29/19 15:44:24 Bus0 Enc1 Dsk1 801 Soft SCSI Bus Error [Command
timeout] 0 0 6
B 01/29/19 15:44:29 Bus0 Enc1 Dsk1 801 Soft SCSI Bus Error [Command
timeout] 0 0 6
[ 2502 lines deleted ]
B 02/27/19 15:35:14 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
B 02/27/19 15:35:14 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
B 02/27/19 15:35:15 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
B 02/27/19 15:35:15 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
B 02/27/19 15:35:15 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
B 02/27/19 15:35:15 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
B 02/27/19 15:35:15 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
A 02/27/19 15:35:29 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
A 02/27/19 15:35:29 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
A 02/27/19 15:35:30 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
A 02/27/19 15:35:30 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
A 02/27/19 15:35:30 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
A 02/27/19 15:35:30 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
A 02/27/19 15:35:31 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
A 02/27/19 15:35:31 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
A 02/27/19 15:35:31 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
A 02/27/19 15:35:31 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
A 02/27/19 15:35:32 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
A 02/27/19 15:35:32 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
A 02/27/19 15:35:32 Bus0 Enc2 DskB 801 Soft SCSI Bus Error [Not ready]
0 0 8
801 Soft SCSI Bus Error with extended status = 2 = Parity.
---------------------------------------------------------------
801 Soft SCSI Bus Error with extended status = 9 = Hardware.
---------------------------------------------------------------
801 Soft SCSI Bus Error with extended status = 11 = Aborted by device.
---------------------------------------------------------------
7fa LCC statistics threshold exceeded. ------------------------
REBUILD LOGGING disk probation state event count:0
7b4 ADD TO, 7b5 REMOVE FROM, 7ca N/A, 7cb CANCEL: RB LOGGING --
6a4-b0 [Copy to Hot Spare events, aka Proactive Sparing] ------
6a0 Disk soft media error remapped via disk ECC ---------------
B 01/29/19 16:35:05 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
B 01/29/19 16:35:05 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
B 01/29/19 16:35:05 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
B 01/29/19 16:35:05 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
B 01/29/19 16:35:05 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
B 01/29/19 16:35:05 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
B 02/05/19 04:40:56 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
B 02/05/19 07:44:01 Bus0 Enc0 Dsk9 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
B 02/05/19 07:56:35 Bus0 Enc0 Dsk9 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
B 02/05/19 08:21:35 Bus0 Enc0 Dsk9 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
[ 27 lines deleted ]
A 02/08/19 10:29:36 Bus0 Enc0 Dsk9 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/08/19 11:23:36 Bus0 Enc0 Dsk9 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/08/19 11:23:48 Bus0 Enc0 Dsk9 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/08/19 11:35:42 Bus0 Enc0 Dsk9 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/09/19 09:48:25 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/09/19 10:55:38 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/09/19 16:03:16 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/09/19 16:03:22 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/10/19 09:17:13 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/10/19 23:55:23 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/10/19 23:55:28 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/10/19 23:55:29 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/10/19 23:55:35 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/10/19 23:55:35 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/11/19 01:34:28 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
A 02/11/19 01:34:33 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
B 02/13/19 15:52:31 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
B 02/13/19 23:25:58 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
B 02/15/19 05:08:30 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
B 02/15/19 20:44:00 Bus0 Enc1 Dsk0 6a0 Disk soft media error
[Recovered error (on-drive ECC)] 0 0 22
63e A port glitch ---------------------------------------------
Rebuilds: Starts, Halts, Aborts and Completes ----------------
B 01/29/19 14:16:55 Bus0 Enc0 Dsk9 603 CRU Unit Rebuild Started [to
0_0_5 ALU 18] 0 ffff0009 120005
B 01/29/19 15:13:27 Bus0 Enc0 Dsk9 604 CRU Unit Rebuild Complete [to
0_0_5 ALU 18] 0 ffff0009 120005
B 01/29/19 15:13:27 Bus0 Enc0 Dsk9 603 CRU Unit Rebuild Started [to
0_0_5 ALU 19] 0 ffff000a 130005
B 01/29/19 16:09:38 Bus0 Enc1 Dsk1 603 CRU Unit Rebuild Started [to
0_2_11 ALU 20] 0 ffff000b 140023
B 01/29/19 16:11:45 Bus0 Enc0 Dsk9 604 CRU Unit Rebuild Complete [to
0_0_5 ALU 19] 0 ffff000a 130005
B 01/29/19 16:11:45 Bus0 Enc0 Dsk9 67d All rebuilds for a FRU have
completed 0 ffffffff ffffffff
B 01/29/19 17:05:02 Bus0 Enc1 Dsk1 604 CRU Unit Rebuild Complete [to
0_2_11 ALU 20] 0 ffff000b 140023
B 01/29/19 17:05:02 Bus0 Enc1 Dsk1 603 CRU Unit Rebuild Started [to
0_2_11 ALU 21] 0 ffff000c 150023
B 01/29/19 18:03:45 Bus0 Enc1 Dsk1 604 CRU Unit Rebuild Complete [to
0_2_11 ALU 21] 0 ffff000c 150023
B 01/29/19 18:03:45 Bus0 Enc1 Dsk1 67d All rebuilds for a FRU have
completed 0 ffffffff ffffffff
[ 220 lines deleted ]
B 02/15/19 15:11:51 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 19 40%] 0 40000a 130009
B 02/15/19 15:33:14 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 18 52%] 0 520009 120009
B 02/15/19 16:27:26 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 19 26%] 0 26000a 130009
B 02/15/19 18:56:03 Bus0 Enc0 Dsk9 603 CRU Unit Rebuild Started [to
0_0_5 ALU 18] 0 ffff0009 120005
B 02/15/19 19:49:55 Bus0 Enc0 Dsk9 604 CRU Unit Rebuild Complete [to
0_0_5 ALU 18] 0 ffff0009 120005
B 02/15/19 19:49:55 Bus0 Enc0 Dsk9 603 CRU Unit Rebuild Started [to
0_0_5 ALU 19] 0 ffff000a 130005
B 02/15/19 20:47:50 Bus0 Enc0 Dsk9 604 CRU Unit Rebuild Complete [to
0_0_5 ALU 19] 0 ffff000a 130005
B 02/15/19 20:47:50 Bus0 Enc0 Dsk9 67d All rebuilds for a FRU have
completed 0 ffffffff ffffffff
B 02/15/19 20:48:01 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 18 0%] 0 ffff0009 120009
B 02/15/19 20:52:23 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 18 10%] 0 100009 120009
B 02/15/19 20:58:05 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 18 13%] 0 130009 120009
B 02/15/19 21:33:15 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 18 85%] 0 850009 120009
B 02/15/19 21:34:50 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 18 3%] 0 30009 120009
B 02/15/19 21:35:16 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 18 0%] 0 ffff0009 120009
B 02/15/19 21:36:51 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 18 3%] 0 30009 120009
B 02/15/19 21:38:33 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 18 3%] 0 30009 120009
B 02/15/19 21:39:35 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 18 0%] 0 ffff0009 120009
B 02/27/19 16:47:48 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 19 25%] 0 25000a 130009
A 02/27/19 16:49:10 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 18 0%] 0 ffff0009 120009
A 02/27/19 17:03:07 Bus0 Enc0 Dsk5 605 CRU Unit Rebuild Halted [to
0_0_9 ALU 18 4%] 0 40009 120009
Equalizes: Starts, Halts, and Completes ----------------------
B 02/04/19 10:59:32 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
A 02/04/19 11:00:03 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 10009 120009
B 02/04/19 11:00:57 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 20009 120009
A 02/04/19 11:06:34 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 70009 120009
B 02/04/19 11:25:14 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 520009 120009
A 02/04/19 11:40:45 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 790009 120009
B 02/04/19 11:49:33 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 19] 0 ffff000a 130009
A 02/04/19 11:49:35 Bus0 Enc0 Dsk5 614 CRU Unit Equalize Complete [to
0_0_9 ALU 18] 0 ffff0009 120009
B 02/04/19 12:46:31 Bus0 Enc0 Dsk5 614 CRU Unit Equalize Complete [to
0_0_9 ALU 19] 0 ffff000a 130009
B 02/06/19 17:42:24 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
[ 215 lines deleted ]
B 02/15/19 17:09:34 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 19] 0 ffff000a 130009
B 02/15/19 17:09:34 Bus0 Enc0 Dsk5 614 CRU Unit Equalize Complete [to
0_0_9 ALU 18] 0 ffff0009 120009
B 02/15/19 18:01:27 Bus0 Enc0 Dsk5 614 CRU Unit Equalize Complete [to
0_0_9 ALU 19] 0 ffff000a 130009
B 02/15/19 20:47:51 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
B 02/15/19 20:48:16 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
B 02/15/19 20:52:38 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
B 02/15/19 20:58:20 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
B 02/15/19 21:33:30 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
B 02/15/19 21:35:05 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
B 02/15/19 21:35:31 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
B 02/15/19 21:37:06 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
B 02/15/19 21:39:27 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
B 02/15/19 21:39:50 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
B 02/15/19 22:21:20 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 19] 0 ffff000a 130009
B 02/15/19 22:21:20 Bus0 Enc0 Dsk5 614 CRU Unit Equalize Complete [to
0_0_9 ALU 18] 0 ffff0009 120009
A 02/27/19 15:54:28 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
B 02/27/19 16:35:56 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 19] 0 ffff000a 130009
A 02/27/19 16:35:58 Bus0 Enc0 Dsk5 614 CRU Unit Equalize Complete [to
0_0_9 ALU 18] 0 ffff0009 120009
A 02/27/19 16:49:10 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009
A 02/27/19 17:01:29 Bus0 Enc0 Dsk5 613 CRU Unit Equalize Started [to
0_0_9 ALU 18] 0 ffff0009 120009

***********************************************************************************
***********
DISKS SENSE DATA INFORMATION
[Logfiltercsv Script]
Created csv sense data file from the SP*_System.evt files. This file helps
identify potential
disks problems to a finer granularity than what is reported in the SP logs.
Examine an ANSI
spec for generic sense key definitions. You can view the Flare interpretations by
viewing the
Disk Error Codes in
http://opseroom02.corp.emc.com/eRoom/SPOmidrangesysdiv/sustaining/0_7d84c
***********************************************************************************
***********

***********************************************************************************
***********
FBI ERROR INFORMATION
[FBIstats Script]
***********************************************************************************
***********

NO FBI INFORMATION IS PRESENT IN THESE SPCOLLECTS

***********************************************************************************
***********
STATISTICAL INFORMATION
[Stats Script]
***********************************************************************************
***********

INITIATORS: SPA (Registered Initiator/Logged Initiator): Port0: 4/0, Port1:

4/0, Port2: 4/1, Port3: 4/1
SPB (Registered Initiator/Logged Initiator): Port0: 4/0, Port1:
4/0, Port2: 4/1, Port3: 4/1

FE PORT SPEEDS (TYPE): SPA Port0: N/A (FC), Port1: N/A (FC), Port2: 4Gbps (FC),
Port3: 4Gbps (FC)
SPB Port0: N/A (FC), Port1: N/A (FC), Port2: 4Gbps (FC),
Port3: 4Gbps (FC)

BE PORT SPEEDS: (Current Speed/Maximum Speed):

+----------------+--------------+-------------------+---------------
+----------------+----------------+------------------+
| SP_CORRECT_ECC | HS_SWAPS | SHUTDOWNS | EQUALIZES | EXPANSIONS
| FIX_DISK | LUNS |
+----------------+--------------+-------------------+---------------
+----------------+----------------+------------------+
| (ECC) :0 | (6a2)In :19 | (906)Unit :19 | (613)Str :0 | (6f0)Str :0
| (6b2)Str :0 | Bound :0 |
| | (6a3)Out :16 | (606)Trespass :49 | (614)Cplt :0 | (6f1)Finish :
0 | (6b3)Cplt :0 | Unbound :0 |
| | | | (615)Abort :0 | (6f2)Halt :0
| (6b4)Failed :0 | (71550001)CCD :0 |
+----------------+--------------+-------------------+---------------
+----------------+----------------+------------------+

+--------------------+--------------+--------------+----------------
+----------------+-------------------+--------------------+
| PROACTIVE_REP | MIGRATIONS | REPLACEMENTS | LUNS_ZEROED | METALUNS
| REBUILDS | BGVERIFIES |
+--------------------+--------------+--------------+----------------
+----------------+-------------------+--------------------+
| (6a9)Str :0 | (4600)Str :0 | Disk :0 | (7d0)Str :0 | Create :0
| (603)Str :34 | (621)Str :7 |
| (6b0)Cplt :0 | Cplt :0 | LCC A :0 | (7d3)Cplt :0 | Destroy :0
| (604)Cplt :28 | (622)Cplt :7 |
| Threshold_8019 :0 | Queued :0 | LCC B :0 | (7d1)Cont :0 | Stripe_Str :0
| (605)Halt :0 | (642)Abort :0 |
| Threshold_803 :703 | Cancelled :0 | SPA :0 | (7d4)BGstr :0 | Stripe_Cplt :
0 | (641)Abort :0 | (b3c)Str :0 |
| | | SPB :0 | (7d5)BGhalt :0 | Cplt :0
| (67b)Str :0 | (b3d)Abort :0 |
| | | | |
| (67d)All_Cplt :17 | (b3e)Cplt :0 |
| | | | |
| | (b3f)Correcting :0 |
+--------------------+--------------+--------------+----------------
+----------------+-------------------+--------------------+

[Drives recommended for PACO with event code 803]

+----------------+-------+
| Drive | Times |
+----------------+-------+
| Bus0 Enc0 Dsk5 | 1 |
| Bus0 Enc0 Dsk9 | 7 |
| Bus0 Enc1 Dsk1 | 367 |
| Bus0 Enc2 DskB | 328 |
+----------------+-------+

***********************************************************************************
***********
TRESPASS, SHUTDOWN and REDIRECTION COUNTS INFORMATION
[TrespassCounts Script]
***********************************************************************************
***********

Lun RG RGtype Meta Trespass Assign Shutdown LwrPfail LwrPrest UprPfail

UprPrest Storage Group
0 0 r5 3 6 0 0 0 0
0 Celerra_EMCNAS
1 0 r5 3 6 0 0 0 0
0 Celerra_EMCNAS
2 0 r5 2 103 0 0 0 0
0 Celerra_EMCNAS
3 0 r5 2 103 0 0 0 0
0 Celerra_EMCNAS
 4 0 r5 2 103 0 0 0 0
0 Celerra_EMCNAS
5 0 r5 2 103 0 0 0 0
0 Celerra_EMCNAS
16 0 r5 2 103 0 0 0 0
0 Celerra_EMCNAS
17 0 r5 1 4 0 0 0 0
0 Celerra_EMCNAS
18 8 r5 21 87 0 0 0 0
0 Celerra_EMCNAS
19 8 r5 0 3 0 0 0 0
0 Celerra_EMCNAS
20 9 r5 2 67 0 0 0 0
0 Celerra_EMCNAS
21 9 r5 0 3 0 0 0 0
0 Celerra_EMCNAS
22 10 r5 2 67 0 0 0 0
0 Celerra_EMCNAS
23 10 r5 1 4 0 0 0 0
0 Celerra_EMCNAS
24 11 r5 2 67 0 0 0 0
0 Celerra_EMCNAS
25 11 r5 1 4 0 0 0 0
0 Celerra_EMCNAS
26 12 r5 2 103 0 0 0 0
0 Celerra_EMCNAS
27 12 r5 1 4 0 0 0 0
0 Celerra_EMCNAS
200 1 hs 0 16 18 0 0 0
0
201 19 hs 0 1 1 0 0 0
0
202 20 hs 0 3 0 0 0 0
0
2052 0 106 0 0 0 0
0

***********************************************************************************
***********
STORAGE GROUP TRESPASS INFORMATION
[TrespassCounts Script]
***********************************************************************************
***********

Lun HLU RG RGtype Meta Trespass Assign Shutdown LwrPfail LwrPrest

UprPfail UprPrest Storage Group

StorageGroup "Celerra_EMCNAS"
0 0 0 r5 3 6 0 0 0
0 0
1 1 0 r5 3 6 0 0 0
0 0
2 2 0 r5 2 103 0 0 0
0 0
3 3 0 r5 2 103 0 0 0
0 0
4 4 0 r5 2 103 0 0 0
0 0
5 5 0 r5 2 103 0 0 0
0 0
16 16 0 r5 2 103 0 0 0
0 0
17 17 0 r5 1 4 0 0 0
0 0
18 18 8 r5 21 87 0 0 0
0 0
19 19 8 r5 0 3 0 0 0
0 0
20 20 9 r5 2 67 0 0 0
0 0
21 21 9 r5 0 3 0 0 0
0 0
22 22 10 r5 2 67 0 0 0
0 0
23 23 10 r5 1 4 0 0 0
0 0
24 24 11 r5 2 67 0 0 0
0 0
25 25 11 r5 1 4 0 0 0
0 0
26 26 12 r5 2 103 0 0 0
0 0
27 27 12 r5 1 4 0 0 0
0 0
---------------------------- -------- -------- -------- -------- --------
-------- --------
Totals for this StorageGroup 49 940 0 0 0
0 0

***********************************************************************************
***********
STORAGE GROUP and INITIATOR INFORMATION
[SGinfo Script]
***********************************************************************************
***********
Failover Modes: 0=Lun Based Trespass [LBT]=Default [DEF], 1=Passive Not Ready
[PNR],
2=Dynamic Multipathing [DMP], 3=Passive Always Ready [PAR],
4=Asymmetric Logical Unit Access [ALUA]
***********************************************************************************
***********

Summary Count Totals: SG: 1 Initiator: 32 RG: 9 Lun: 18 Trespass (TR Cnt):
49

SG Initiator Check: PASSED

* = Excessive Trespassing ** = Single Physical/Logical Path [T] = Thin Lun

[D] = Direct LUN

===================================================================================
======================================
|SG Name/Host Name |IP |Port|Adapter |Log/Reg|Failover|
Path |HLU |ALU | TR|
| | | | | |Mode |
Count| | |Count|
===================================================================================
======================================
|Celerra_EMCNAS/Celerra_EMCNAS|192.168.1.35|A:0 |N/A |NO/YES |DEF(0) |
32 |0,1,2,3,4,5,|0,1,2,3,4,5,| 49|
| | | | | | |
|16,17,18,19,|16,17,18,19,| |
| | | | | | |
|20,21,22,23,|20,21,22,23,| |
| | | | | | |
|24,25,26,27 |24,25,26,27 | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:0 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:0 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:0 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:1 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:1 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:1 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:1 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:2 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:2 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:2 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:2 |server_2:scsi-0 |YES/YES|DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:3 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:3 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:3 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |A:3 |server_3:scsi-0 |YES/YES|DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:0 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:0 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:0 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:0 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:1 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:1 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:1 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:1 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:2 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:2 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:2 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:2 |server_2:scsi-16|YES/YES|DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:3 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:3 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:3 |N/A |NO/YES |DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+
| | |B:3 |server_3:scsi-16|YES/YES|DEF(0) |
| | | |
+-----------------------------+------------+----+----------------+-------+--------
+-----+------------+------------+-----+

***********************************************************************************
***********
RESERVATION CONFLICT INFORMATION
[reservation_conflict_check Script]
***********************************************************************************
***********

***********************************************************************************
***********
HLU CONFLICT INFORMATION
[HLUconflict Script]
***********************************************************************************
***********

Storage groups defined: 1

ALUs defined in multiple storage groups: 0
ALUs whose HLU is different in multiple storage groups: 0

***********************************************************************************
***********
THIN PROVISIONING INFORMATION
[ThinLunInfo Script]
***********************************************************************************
***********

Test Name VP Enabler Check

Status PASS
Action Virtual Provisioning feature is not supported on
revision 02230505711!

***********************************************************************************
***********
THIN LUN MIGRATION INFORMATION
[ThinLunMigration Script]
***********************************************************************************
***********

***********************************************************************************
***********
THIN LUN RECOVERY ESTIMATE INFORMATION
[ThinRecoveryEstimator Script]
***********************************************************************************
***********

***********************************************************************************
***********
MIDDLE LAYERED DRIVER INFORMATION
[mlu_mr_check Script]
***********************************************************************************
***********

***********************************************************************************
***********
STORAGE POOL SAFE OPERATING CAPACITY INFORMATION
[SafeOperatingCapacityCheck Script]
***********************************************************************************
***********

***********************************************************************************
***********
FAST CACHE INFORMATION
[fastcacheinfo Script]
***********************************************************************************
***********

EFD/FAST Cache is not available on this array release

***********************************************************************************
*******************
SPA KTCONS INFORMATION
[Aspstat 1.3.6]
***********************************************************************************
*******************
Statistics Logging: DISABLED PEER SP: PRESENT WRITE CACHE: DISABLED READ
CACHE: ENABLED
SPA: DP 00% TOTAL 11135 DIRTY 0000 SPB: TOTAL 11136 U: DP 00% TOTAL 0000
Requests Complete: 267521 SPS A: OK SPS B: FLT
-----------------------------------------------------------------------------------
-------------------
|Slot | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10| 11|POS|ENC|ENC--SPD|FLT|PSA|
PSB|FP0|FP1|FP2|FP3|
|-------|---|---|---|---|---|---|---|---|---|---|---|---|---|---|--------|---|---|-
--|---|---|---|---|
|DAE 0 |ENA|ENA|ENA|ENA|ENA|ENA|ENA|ENA|ENA|REM|ENA|ENA|0-0|0_0|ATA - 3G|FLT| OK|
OK| OK| OK| OK| OK|Fault: DEG - COOL FLT
|RG |000|000|000|000|000|008|008|008|008|SWP|008|008| | | | | |
| | | | |
|-------|---|---|---|---|---|---|---|---|---|---|---|---|---|---|--------|---|---|-
--|---|---|---|---|
|DAE 1 |ENA|REM|ENA|ENA|ENA|ENA|ENA|ENA|ENA|ENA|ENA|ENA|0-1|0_1|ATA - 3G| NO| OK|
OK| OK| OK| OK| OK|
|RG |009|SWP|009|009|009|009|010|010|010|010|010|010| | | | | |
| | | | |
|-------|---|---|---|---|---|---|---|---|---|---|---|---|---|---|--------|---|---|-
--|---|---|---|---|
|DAE 2 |ENA|ENA|ENA|ENA|ENA|ENA|ENA|ENA|ENA|ENA|ENA|ENA|0-2|0_2|ATA - 3G| NO| OK|
OK| OK| OK| OK| OK|
|RG |011|011|011|011|011|011|012|012|012|012|012|009| | | | | |
| | | | |
|-------|---|---|---|---|---|---|---|---|---|---|---|---|---|---|--------|---|---|-
--|---|---|---|---|
|DAE 3 |HSR|REM|REM|REM|REM|REM|REM|REM|REM|REM|REM|REM|0-3|0_3|ATA - 3G| NO| OK|
FLT| OK| OK| OK| OK|
|RG |020| | | | | | | | | | | | | | | | |
| | | | |
-----------------------------------------------------------------------------------
-------------------

***********************************************************************************
***********
SPA LOGICAL UNIT INFORMATION
[Alustat Script]
***********************************************************************************
***********

-----------------------------------------------------------------------------------
--------------------------------------------------
MLU TPID ALU FLU RGRP ENCTYPE TYPE PRIV LD CAPACITY CACHE DEFOWN
STATE NAVIFRUS
-----------------------------------------------------------------------------------
--------------------------------------------------
- - 200 0 1 HotSpare Y - 536.5 GB --- SP-A
BRK* 0.0.5 (S:0.0.9 )(DEAD)
- - 0 1 0 RAID-5 N - 11.0 GB RW- SP-A
ENA 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 1 2 0 RAID-5 N - 11.0 GB RW- SP-A
ENA 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 2 3 0 RAID-5 N - 2.0 GB RW- SP-A
ENA 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 3 4 0 RAID-5 N - 2.0 GB RW- SP-A
ENA 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 4 5 0 RAID-5 N - 2.0 GB RW- SP-A
ENA 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 5 6 0 RAID-5 N - 32.0 GB RW- SP-A
ENA 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 16 7 0 RAID-5 N - 202.5 GB RW- SP-A
ENA 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 17 8 0 RAID-5 N - 202.5 GB RW- SP-B
ENA 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 18 9 8 RAID-5 N - 1.3 TB RW- SP-A
ENA 0.0.6 0.0.7 0.0.8 0.0.9 (S:0.0.5 ) 0.0.10 0.0.11
- - 19 10 8 RAID-5 N - 1.3 TB RW- SP-B
ENA:PEER 0.0.6 0.0.7 0.0.8 0.0.9 (S:0.0.5 ) 0.0.10 0.0.11
- - 20 11 9 RAID-5 N - 1.3 TB RW- SP-A
ENA 0.1.0 0.1.1 (S:0.2.11) 0.1.2 0.1.3 0.1.4 0.1.5
- - 21 12 9 RAID-5 N - 1.3 TB RW- SP-B
ENA:PEER 0.1.0 0.1.1 (S:0.2.11) 0.1.2 0.1.3 0.1.4 0.1.5
- - 22 13 10 RAID-5 N - 1.3 TB RW- SP-A
ENA 0.1.6 0.1.7 0.1.8 0.1.9 0.1.10 0.1.11
- - 23 14 10 RAID-5 N - 1.3 TB RW- SP-B
ENA 0.1.6 0.1.7 0.1.8 0.1.9 0.1.10 0.1.11
- - 24 15 11 RAID-5 N - 1.3 TB RW- SP-A
ENA 0.2.0 0.2.1 0.2.2 0.2.3 0.2.4 0.2.5
- - 25 16 11 RAID-5 N - 1.3 TB RW- SP-B
ENA 0.2.0 0.2.1 0.2.2 0.2.3 0.2.4 0.2.5
- - 26 17 12 RAID-5 N - 1.0 TB RW- SP-A
ENA 0.2.6 0.2.7 0.2.8 0.2.9 0.2.10
- - 27 18 12 RAID-5 N - 1.0 TB RW- SP-B
ENA 0.2.6 0.2.7 0.2.8 0.2.9 0.2.10
 - - 201 19 19 HotSpare Y - 536.5 GB --- SP-A
BRK* 0.2.11(S:0.1.1 )(DEAD)
- - 202 20 20 HotSpare Y - 536.5 GB --- SP-A
ENA 0.3.0
- - - 2048 240 RAID-1 - - 1.7 GB R-- SP-B
ENA 0.0.0 0.0.1 0.0.2
- - - 2052 241 RAID-3 - - 2.0 GB --- SP-B
ENA 0.0.0 0.0.1 0.0.2
-----------------------------------------------------------------------------------
--------------------------------------------------
Total number of luns listed: 23
-----------------------------------------------------------------------------------
--------------------------------------------------

***********************************************************************************
*******************
SPB KTCONS INFORMATION
[Aspstat 1.3.6]
***********************************************************************************
*******************
Statistics Logging: DISABLED PEER SP: PRESENT WRITE CACHE: DISABLED READ
CACHE: ENABLED
SPA: TOTAL 11135 SPB: DP 00% TOTAL 11136 DIRTY 0000 U: DP 00% TOTAL 0000
Requests Complete: 819 SPS A: OK SPS B: FLT
-----------------------------------------------------------------------------------
-------------------
|Slot | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10| 11|POS|ENC|ENC--SPD|FLT|PSA|
PSB|FP0|FP1|FP2|FP3|
|-------|---|---|---|---|---|---|---|---|---|---|---|---|---|---|--------|---|---|-
--|---|---|---|---|
|DAE 0 |ENA|ENA|ENA|RDY|RDY|ENA|ENA|ENA|ENA|REM|ENA|ENA|0-0|0_0|ATA - 3G|FLT| OK|
OK| OK| OK| OK| OK|Fault: DEG - COOL FLT
|RG |000|000|000|000|000|008|008|008|008|SWP|008|008| | | | | |
| | | | |
|-------|---|---|---|---|---|---|---|---|---|---|---|---|---|---|--------|---|---|-
--|---|---|---|---|
|DAE 1 |ENA|REM|ENA|ENA|ENA|ENA|RDY|RDY|RDY|RDY|RDY|RDY|0-1|0_1|ATA - 3G| NO| OK|
OK| OK| OK| OK| OK|
|RG |009|SWP|009|009|009|009|010|010|010|010|010|010| | | | | |
| | | | |
|-------|---|---|---|---|---|---|---|---|---|---|---|---|---|---|--------|---|---|-
--|---|---|---|---|
|DAE 2 |RDY|RDY|RDY|RDY|RDY|RDY|RDY|RDY|RDY|RDY|RDY|ENA|0-2|0_2|ATA - 3G| NO| OK|
OK| OK| OK| OK| OK|
|RG |011|011|011|011|011|011|012|012|012|012|012|009| | | | | |
| | | | |
|-------|---|---|---|---|---|---|---|---|---|---|---|---|---|---|--------|---|---|-
--|---|---|---|---|
|DAE 3 |HSR|REM|REM|REM|REM|REM|REM|REM|REM|REM|REM|REM|0-3|0_3|ATA - 3G| NO| OK|
FLT| OK| OK| OK| OK|
|RG |020| | | | | | | | | | | | | | | | |
| | | | |
-----------------------------------------------------------------------------------
-------------------

***********************************************************************************
***********
SPB LOGICAL UNIT INFORMATION
[Alustat Script]
***********************************************************************************
***********

-----------------------------------------------------------------------------------
--------------------------------------------------
MLU TPID ALU FLU RGRP ENCTYPE TYPE PRIV LD CAPACITY CACHE DEFOWN
STATE NAVIFRUS
-----------------------------------------------------------------------------------
--------------------------------------------------
- - 200 0 1 HotSpare Y - 536.5 GB --- SP-A
BRK* 0.0.5 (S:0.0.9 )(DEAD)
- - 0 1 0 RAID-5 N - 11.0 GB RW- SP-A
ENA:PEER 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 1 2 0 RAID-5 N - 11.0 GB RW- SP-A
ENA:PEER 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 2 3 0 RAID-5 N - 2.0 GB RW- SP-A
ENA:PEER 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 3 4 0 RAID-5 N - 2.0 GB RW- SP-A
ENA:PEER 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 4 5 0 RAID-5 N - 2.0 GB RW- SP-A
ENA:PEER 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 5 6 0 RAID-5 N - 32.0 GB RW- SP-A
ENA:PEER 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 16 7 0 RAID-5 N - 202.5 GB RW- SP-A
ENA:PEER 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 17 8 0 RAID-5 N - 202.5 GB RW- SP-B
ENA:PEER 0.0.0 0.0.1 0.0.2 0.0.3 0.0.4
- - 18 9 8 RAID-5 N - 1.3 TB RW- SP-A
ENA:PEER 0.0.6 0.0.7 0.0.8 0.0.9 (S:0.0.5 ) 0.0.10 0.0.11
- - 19 10 8 RAID-5 N - 1.3 TB RW- SP-B
ENA 0.0.6 0.0.7 0.0.8 0.0.9 (S:0.0.5 ) 0.0.10 0.0.11
- - 20 11 9 RAID-5 N - 1.3 TB RW- SP-A
ENA:PEER 0.1.0 0.1.1 (S:0.2.11) 0.1.2 0.1.3 0.1.4 0.1.5
- - 21 12 9 RAID-5 N - 1.3 TB RW- SP-B
ENA 0.1.0 0.1.1 (S:0.2.11) 0.1.2 0.1.3 0.1.4 0.1.5
- - 22 13 10 RAID-5 N - 1.3 TB RW- SP-A
ENA:PEER 0.1.6 0.1.7 0.1.8 0.1.9 0.1.10 0.1.11
- - 23 14 10 RAID-5 N - 1.3 TB RW- SP-B
ENA:PEER 0.1.6 0.1.7 0.1.8 0.1.9 0.1.10 0.1.11
- - 24 15 11 RAID-5 N - 1.3 TB RW- SP-A
ENA:PEER 0.2.0 0.2.1 0.2.2 0.2.3 0.2.4 0.2.5
- - 25 16 11 RAID-5 N - 1.3 TB RW- SP-B
ENA:PEER 0.2.0 0.2.1 0.2.2 0.2.3 0.2.4 0.2.5
- - 26 17 12 RAID-5 N - 1.0 TB RW- SP-A
ENA:PEER 0.2.6 0.2.7 0.2.8 0.2.9 0.2.10
- - 27 18 12 RAID-5 N - 1.0 TB RW- SP-B
ENA:PEER 0.2.6 0.2.7 0.2.8 0.2.9 0.2.10
- - 201 19 19 HotSpare Y - 536.5 GB --- SP-A
BRK* 0.2.11(S:0.1.1 )(DEAD)
- - 202 20 20 HotSpare Y - 536.5 GB --- SP-A
ENA 0.3.0
- - - 2048 240 RAID-1 - - 1.7 GB R-- SP-B
ENA:PEER 0.0.0 0.0.1 0.0.2
- - - 2052 241 RAID-3 - - 2.0 GB --- SP-B
ENA 0.0.0 0.0.1 0.0.2
-----------------------------------------------------------------------------------
--------------------------------------------------
Total number of luns listed: 23
-----------------------------------------------------------------------------------
--------------------------------------------------

***********************************************************************************
***********************************************************************************
********************************************
Avpstat Ktcons Vpstat and NaviCLI getsniffer combination status
INFORMATION. [Avpstat Script]
***********************************************************************************
***********************************************************************************
********************************************
Summary of Verifies:
___________________________________________________________________________________
___________________________________________________________________________________
___________________________________________
|| || || || ||Sniff|| || Verify % ||Sniff|| BV ||Total ||
|| CORRECTABLES (Current / Historical) || UNCORRECTABLES
(Current / Historical) ||
SP||ALU ||FLU || RG ||Type||State||Cap(GB)|| Type |Done||Rate ||Time||Passes||
Pri || CRC | WS | TS | SS | COH || UCRC |
UWS | UTS | USS | UCOH ||
---||-----||----||----||----||-----||-------||--------|----||-----||----||------||-
-----||-----------|-----------|-----------|-----------|-----------||-----------|---
--------|-----------|-----------|-----------||
A || 0|| 1|| 0|| R5|| Ena|| 11.0|| sniff| 79|| 10|| 12|| 565||
Medium|| 0/36 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 0|| 1|| 0|| R5|| Ena|| 11.0||-------------|| 10|| 12||
565||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
A || 1|| 2|| 0|| R5|| Ena|| 11.0||-------------|| 10|| 12|| 572||
Medium|| 0/27 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 1|| 2|| 0|| R5|| Ena|| 11.0||-------------|| 10|| 12||
572||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
A || 2|| 3|| 0|| R5|| Ena|| 2.0||-------------|| 10|| 12|| 516||
Medium|| 0/1 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 2|| 3|| 0|| R5|| Ena|| 2.0||-------------|| 10|| 12||
516||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
A || 3|| 4|| 0|| R5|| Ena|| 2.0||-------------|| 10|| 12|| 511||
Medium|| 0/0 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 3|| 4|| 0|| R5|| Ena|| 2.0||-------------|| 10|| 12||
511||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
A || 4|| 5|| 0|| R5|| Ena|| 2.0||-------------|| 10|| 12|| 490||
Medium|| 0/2 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 4|| 5|| 0|| R5|| Ena|| 2.0||-------------|| 10|| 12||
490||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
A || 5|| 6|| 0|| R5|| Ena|| 32.0||-------------|| 10|| 12|| 479||
Medium|| 0/16 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 5|| 6|| 0|| R5|| Ena|| 32.0||-------------|| 10|| 12||
479||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
 A || 16|| 7|| 0|| R5|| Ena|| 202.0||-------------|| 10|| 12|| 452||
Medium|| 0/48 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 16|| 7|| 0|| R5|| Ena|| 202.0||-------------|| 10|| 12||
452||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
A || 17|| 8|| 0|| R5|| Ena|| 202.0||-------------|| 10|| 12|| 470||
Medium|| 0/250 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 17|| 8|| 0|| R5|| Ena|| 202.0||-------------|| 10|| 12||
470||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
A || 200|| 0|| 1|| HS|| Ena|| 536.0||-------------|| 254|| 0|| 100||
ASAP|| 0/0 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 200|| 0|| 1|| HS|| Ena|| 536.0||-------------|| 254|| 0|| 100||
ASAP|| 0/0 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
A || 18|| 9|| 8|| R5|| Ena|| 1341.0|| sniff| 42|| 10|| 12|| 111||
Medium|| 15/831 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 18|| 9|| 8|| R5|| Ena|| 1341.0||-------------|| 0|| 10||
12||------||-----------|-----------|-----------|-----------|-----------||----------
-|-----------|-----------|-----------|-----------||
A || 19|| 10|| 8|| R5|| Ena|| 1341.0||-------------|| 10|| 12||
90||------||-----------|-----------|-----------|-----------|-----------||----------
-|-----------|-----------|-----------|-----------||
B || 19|| 10|| 8|| R5|| Ena|| 1341.0||-------------|| 10|| 12|| 90||
Medium|| 0/873 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
A || 20|| 11|| 9|| R5|| Ena|| 1341.0|| sniff| 5|| 10|| 12|| 104||
Medium|| 16/2060 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 20|| 11|| 9|| R5|| Ena|| 1341.0||-------------|| 0|| 10||
12||------||-----------|-----------|-----------|-----------|-----------||----------
-|-----------|-----------|-----------|-----------||
A || 21|| 12|| 9|| R5|| Ena|| 1341.0||-------------|| 10|| 12||
97||------||-----------|-----------|-----------|-----------|-----------||----------
-|-----------|-----------|-----------|-----------||
B || 21|| 12|| 9|| R5|| Ena|| 1341.0||-------------|| 10|| 12|| 97||
Medium|| 4/41 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
A || 22|| 13|| 10|| R5|| Ena|| 1341.0|| sniff| 6|| 10|| 12|| 104||
Medium|| 0/0 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 22|| 13|| 10|| R5|| Ena|| 1341.0||-------------|| 10|| 12||
104||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
A || 23|| 14|| 10|| R5|| Ena|| 1341.0||-------------|| 10|| 12|| 98||
Medium|| 0/11 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 23|| 14|| 10|| R5|| Ena|| 1341.0||-------------|| 10|| 12||
98||------||-----------|-----------|-----------|-----------|-----------||----------
-|-----------|-----------|-----------|-----------||
A || 24|| 15|| 11|| R5|| Ena|| 1341.0|| sniff| 79|| 10|| 12|| 106||
Medium|| 0/35 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 24|| 15|| 11|| R5|| Ena|| 1341.0||-------------|| 10|| 12||
106||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
A || 25|| 16|| 11|| R5|| Ena|| 1341.0||-------------|| 10|| 12|| 96||
Medium|| 0/16 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 25|| 16|| 11|| R5|| Ena|| 1341.0||-------------|| 10|| 12||
96||------||-----------|-----------|-----------|-----------|-----------||----------
-|-----------|-----------|-----------|-----------||
A || 26|| 17|| 12|| R5|| Ena|| 1073.0|| sniff| 0|| 10|| 12|| 107||
Medium|| 0/5 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 26|| 17|| 12|| R5|| Ena|| 1073.0||-------------|| 10|| 12||
107||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
A || 27|| 18|| 12|| R5|| Ena|| 1073.0||-------------|| 10|| 12|| 102||
Medium|| 0/200 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 27|| 18|| 12|| R5|| Ena|| 1073.0||-------------|| 10|| 12||
102||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
A || 201|| 19|| 19|| HS|| Ena|| 536.0||-------------|| 254|| 0|| 109||
ASAP|| 0/0 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 201|| 19|| 19|| HS|| Ena|| 536.0||-------------|| 254|| 0|| 109||
ASAP|| 0/0 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
A || 202|| 20|| 20|| HS|| Ena|| 536.0||-------------|| 254|| 0|| 109||
ASAP|| 0/0 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
B || 202|| 20|| 20|| HS|| Ena|| 536.0|| sniff| 82|| 254|| 0|| 109||
ASAP|| 0/0 | 0/0 | 0/0 | 0/0 | 0/0 || 0/0 |
0/0 | 0/0 | 0/0 | 0/0 ||
A || ---||2048|| 240|| R1|| Ena|| 1.0|| sniff| 81|| 123|| 0||
400||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
B || ---||2048|| 240|| R1|| Ena|| 1.0||-------------|| 0|| 123||
0||------||-----------|-----------|-----------|-----------|-----------||-----------
|-----------|-----------|-----------|-----------||
A || ---||2052|| 241|| R3|| Ena|| 2.0||-------------|| 254|| 0||
475||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||
B || ---||2052|| 241|| R3|| Ena|| 2.0|| sniff| 50|| 254|| 0||
475||------||-----------|-----------|-----------|-----------|-----------||---------
--|-----------|-----------|-----------|-----------||

***********************************************************************************
***********
DETAILED DISK INFORMATION
[ArrayInfo Script]
***********************************************************************************
***********

Raid Drive
Cur Max Drive Drive Wear
Disk Group Capacity Intfc Vendor Drive Type Serial Number
Part Number TLA Number Firmware State Replacing Speed Speed Age Uptim
Remain
0.0.0 0 146GB SAS SEAGATE Firefly 6SD2RWVH
118032649 005049083 FF03 Enabled --
0.0.1 0 146GB SAS SEAGATE Firefly 6SD2RZ2D
118032649 005049083 FF03 Enabled --

0.0.2 0 146GB SAS SEAGATE Firefly 6SD2R7QR

118032649 005049083 FF03 Enabled --

0.0.3 0 146GB SAS SEAGATE Firefly 6SD2RZ2Z

118032649 005049083 FF03 Enabled --

0.0.4 0 146GB SAS SEAGATE Firefly 6SD2RCGD

118032649 005049083 FF03 Enabled --

0.0.5 1 600GB SAS SEAGATE EagleRP

118032658 005048960 RS05 Enabled 0_0_9

0.0.6 8 600GB SAS SEAGATE EagleRP 3SS04FT7

118032658 005048960 RS05 Enabled --

0.0.7 8 600GB SAS SEAGATE EagleRP 3SS05ED0

118032658 005048960 RS05 Enabled --

0.0.8 8 600GB SAS SEAGATE EagleRP 3SS05AEV

118032658 005048960 RS05 Enabled --

0.0.9 8
Removed --
0.0.10 8 600GB SAS SEAGATE EagleRP 3SS0M22S
118032658 005048960 RS05 Enabled --

0.0.11 8 600GB SAS SEAGATE EagleRP 3SS0M6YJ

118032658 005048960 RS05 Enabled --

0.1.0 9 600GB SAS SEAGATE EagleRP 3SS03K4D

118032658 005048960 RS05 Enabled --

0.1.1 9
Removed --
0.1.2 9 600GB SAS SEAGATE EagleRP 3SS0MK10
118032658 005048960 RS05 Enabled --

0.1.3 9 600GB SAS SEAGATE EagleRP 3SS04CBV

118032658 005048960 RS05 Enabled --

0.1.4 9 600GB SAS SEAGATE EagleRP 3SS03ML8

118032658 005048960 RS05 Enabled --

0.1.5 9 600GB SAS SEAGATE EagleRP 3SS05C9W

118032658 005048960 RS05 Enabled --

0.1.6 10 600GB SAS SEAGATE EagleRP 3SS0M6ZK

118032658 005048960 RS05 Enabled --

0.1.7 10 600GB SAS SEAGATE EagleRP 3SS03H0M

118032658 005048960 RS05 Enabled --

0.1.8 10 600GB SAS SEAGATE EagleRP 3SS0LPMH

118032658 005048960 RS05 Enabled --

0.1.9 10 600GB SAS SEAGATE EagleRP 3SS0M6WA

118032658 005048960 RS05 Enabled --

0.1.10 10 600GB SAS SEAGATE EagleRP 3SS0LPNX

118032658 005048960 RS05 Enabled --

0.1.11 10 600GB SAS SEAGATE EagleRP 3SS04PA9

118032658 005048960 RS05 Enabled --

0.2.0 11 600GB SAS SEAGATE EagleRP 3SS056Y5

118032658 005048960 RS05 Enabled --

0.2.1 11 600GB SAS SEAGATE EagleRP 3SS03RGZ

118032658 005048960 RS05 Enabled --

0.2.2 11 600GB SAS SEAGATE EagleRP 3SS01W55

118032658 005048960 RS05 Enabled --

0.2.3 11 600GB SAS SEAGATE EagleRP 3SS03NPH

118032658 005048960 RS05 Enabled --

0.2.4 11 600GB SAS SEAGATE EagleRP 3SS04WVE

118032658 005048960 RS05 Enabled --

0.2.5 11 600GB SAS SEAGATE EagleRP 3SS05ED2

118032658 005048960 RS05 Enabled --

0.2.6 12 600GB SAS SEAGATE EagleRP 6SS0FBNY

118032658 005048960 RS05 Enabled --

0.2.7 12 600GB SAS SEAGATE EagleRP 3SS04WX6

118032658 005048960 RS05 Enabled --

0.2.8 12 600GB SAS SEAGATE EagleRP 6SS00TDL

118032658 005048960 RS05 Enabled --

0.2.9 12 600GB SAS SEAGATE EagleRP 3SS0MFS5

118032658 005048960 RS05 Enabled --

0.2.10 12 600GB SAS SEAGATE EagleRP 3SS0LYQ8

118032658 005048960 RS05 Enabled --

0.2.11 19 600GB SAS SEAGATE EagleRP

118032658 005048960 RS05 Enabled 0_1_1

0.3.0 20 600GB SAS SEAGATE EagleRP 3SS03HQ6

118032658 005048960 RS05 HS Ready Inactive

0.3.1
Empty --
0.3.2
Empty --
0.3.3
Empty --
0.3.4
Empty --
0.3.5
Empty --
0.3.6
Empty --
0.3.7
Empty --
0.3.8
Empty --
0.3.9
Empty --
0.3.10
Empty --
0.3.11
Empty --

***********************************************************************************
***********
MetaLUN INFORMATION
[MetaInfo Script]
***********************************************************************************
***********
Number of metaLUNs in the system: 0

MetaLUN State Capacity(GB) Components Luns Layout

***********************************************************************************
***********
LAYERED CONFIGURATION INFORMATION
[LayeredInfo Script]
***********************************************************************************
***********

No mirrors.

No mirror groups.

No snaps.

No snap sessions.

No clones.

No sancopy sessions.

***********************************************************************************
***********
SNAPVIEW INFORMATION
[SnapReport Script]
***********************************************************************************
***********

***********************************************************************************
***********
NAVI and NDU INFORMATION
[Monitorcheck Script]
***********************************************************************************
***********
Event Monitoring Type: CENTRALIZED
SP time difference --------------------------------------------
B 02/04/19 04:03:19 NDU 71510000 Info: Peer is ahead by 1
seconds @ SP.cpp:1643
B 02/27/19 15:37:18 NDU 71510000 Info: Peer is ahead by 1
seconds @ SP.cpp:1643
The audit log was cleared -------------------------------------
Navi logging stopped ------------------------------------------
Navi agent problems -------------------------------------------
NaviCIMOM exiting ---------------------------------------------

NDU
NDU noteworthy entries. ---------------------------------------
DBPrep Activates or HsConversions -----------------------------
Diagnostic Services Started -----------------------------------
EMCRemote Service: 0
ktcons.exe: 0
smbtool.exe: 0
psmtool.exe: 0
Commits -------------------------------------------------------

***********************************************************************************
***********
NDU STATUS INFORMATION
[ndu_report Script]
***********************************************************************************
***********

***********************************************************************************
***********
CIMOM MEMORY LEAK INFORMATION [CimomLeakCheck and
cimomcheck Scripts]
***********************************************************************************
***********

Array Model: AX4-5F8

Array Revision: 2.23.50.5.711
XLUs: 18
MV/A Luns: 0
CIMOM Exit Messages: 0
Occurrences (total): 0
Occurrences (non-overlapping): 0
Log Duration: 39 days 21 hours
Occurrence Window: 10 messages in 60 days

***********************************************************************************
***********
Number of times SPcollects were taken: 66

NGTRiiAGE-partner(eng) CompleteStart: 02/28/2019 12:09:27 End: 02/28/2019

12:14:06
*******************************************************************************
Maintained by: "CBU Core Sustaining Tools [email protected]"
Submit an Incident Report if you encounter any problems.
Include the TRiiAGE_Collects.zip file with the incident by running "Tcollects".