0% found this document useful (0 votes)

347 views75 pages

Extra Session Troubleshooting-Session QnA

The document describes different types of Oracle database configurations. Standalone databases can run without or with ASM, as standalone or Oracle Restart servers. RAC databases can have a single instance as a RAC One Node configuration or multiple instances as a RAC database. Examples show processes running on standalone databases on oraclelab1 and oraclelab2, and configuration details of a RAC One Node database.

Uploaded by

Vamsi Chowdary

We take content rights seriously. If you suspect this is your content, claim it here.

Available Formats

Download as DOCX, PDF, TXT or read online on Scribd

0% found this document useful (0 votes)

347 views75 pages

Extra Session Troubleshooting-Session QnA

Uploaded by

Vamsi Chowdary

We take content rights seriously. If you suspect this is your content, claim it here.

Available Formats

Download as DOCX, PDF, TXT or read online on Scribd

You are on page 1/ 75

Database Types:

1. Standalone Database
- Standalone without ASM --- Standalone Server
- Standalone with ASM ------ Oracle Restart Server

[root@oraclelab1 ~]# ps -ef|grep smon

oracle 21174 1 0 Jan11 ? 00:00:09 ora_smon_DEVDB
root 32024 31962 0 20:29 pts/0 00:00:00 grep --color=auto smon
[root@oraclelab1 ~]#

[root@oraclelab2 ~]# ps -ef|grep smon

oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11605 1 0 2022 ? 00:00:29 ora_smon_TESTDB
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
root 30671 30330 0 20:31 pts/0 00:00:00 grep --color=auto smon
[root@oraclelab2 ~]#

2. RAC Database
- RAC Database with single Instance ---- RAC Onenode
- RAC Database with multiple Instance --- RAC Database

[oracle@node2 ~]$ srvctl status database -d ORADB

Instance ORADB1 is not running on node node1
Instance ORADB2 is not running on node node2
[oracle@node2 ~]$

[oracle@node2 ~]$ srvctl config database -d ORADB

Database unique name: ORADB
Database name: ORADB
Oracle home: /u01/app/oracle/product/19.0.0.0/dbhome_1
Oracle user: oracle
Spfile: +DATA/ORADB/PARAMETERFILE/spfile.331.1100127329
Password file: +DATA/ORADB/PASSWORD/pwdoradb.321.1100126845
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools:
Disk Groups: RECO,DATA
Mount point paths:
Services:
Type: RAC
Start concurrency:
Stop concurrency:
OSDBA group: oinstall
OSOPER group: oinstall
Database instances: ORADB1,ORADB2
Configured nodes: node1,node2
CSS critical: no
CPU count: 0
Memory target: 0
Maximum memory: 0
Default network number for database services:
Database is administrator managed
[oracle@node2 ~]$

Type: RAC
Type: RACOneNode

[oracle@node2 ~]$ srvctl status database -d RAC1N

Instance RAC1N_1 is running on node node1
Online relocation: INACTIVE
[oracle@node2 ~]$

[oracle@node2 ~]$ srvctl status database -d RAC1N

Instance RAC1N_2 is running on node node2
Online relocation: INACTIVE
[oracle@node2 ~]$

[oracle@node2 ~]$ srvctl config database -d RAC1N

Database unique name: RAC1N
Database name: RAC1N
Oracle home: /u01/app/oracle/product/12.2.0.1/dbhome_1
Oracle user: oracle
Spfile: +DATA/RAC1N/PARAMETERFILE/spfile.318.1067549521
Password file: +DATA/RAC1N/PASSWORD/pwdrac1n.286.1067549269
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools:
Disk Groups: RECO,DATA
Mount point paths:
Services: RACNODE
Type: RACOneNode
Online relocation timeout: 30
Instance name prefix: RAC1N
Candidate servers: node1,node2
OSDBA group: oinstall
OSOPER group: oinstall
Database instances: RAC1N_2
CSS critical: no
CPU count: 0
Memory target: 0
Maximum memory: 0
Default network number for database services:
Database is administrator managed
[oracle@node2 ~]$

login as: root

[email protected]'s password:

┌───────────────────────────────────────────────────────────
───────────┐
│ • MobaXterm Personal Edition v21.2 • │
│ (SSH client, X server and network tools) │
│ │
│ ➤ SSH session to [email protected] │
│ • Direct SSH : ✔ │
│ • SSH compression : ✔ │
│ • SSH-browser : ✔ │
│ • X11-forwarding : ✔ (remote display is forwarded through SSH) │
│ │
│ ➤ For more info, ctrl+click on help or visit our website. │

└───────────────────────────────────────────────────────────
───────────┘

Last login: Fri Jan 13 10:39:04 2023 from 172.29.0.99

[root@oraclelab1 ~]# ps -ef|grep smon
oracle 21174 1 0 Jan11 ? 00:00:09 ora_smon_DEVDB
root 32024 31962 0 20:29 pts/0 00:00:00 grep --color=auto smon
[root@oraclelab1 ~]# su - oracle
Last login: Fri Jan 13 10:39:07 IST 2023 on pts/2
[oracle@oraclelab1 ~]$ . oraenv
ORACLE_SID = [oracle] ? DEVDB
The Oracle base has been set to /u01/app/oracle
[oracle@oraclelab1 ~]$ sqlplus / as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 19 20:33:13 2023

Version 19.17.0.0.0

Copyright (c) 1982, 2022, Oracle. All rights reserved.

Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.17.0.0.0

SQL> select name from v$datafile;

NAME
--------------------------------------------------------------------------------
/u01/app/oracle/oradata/DEVDB/datafile/o1_mf_system_ktbgb353_.dbf
/u01/app/oracle/oradata/DEVDB/datafile/o1_mf_sysaux_ktbgb34z_.dbf
/u01/app/oracle/oradata/DEVDB/datafile/o1_mf_undotbs1_ktbgb356_.dbf
/tmp/users_1.dbf

SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.17.0.0.0
[oracle@oraclelab1 ~]$ cd /u01/app/oracle/oradata/DEVDB/datafile/
[oracle@oraclelab1 datafile]$ ls -ltr
total 7283316
-rw-r-----. 1 oracle oinstall 20979712 Dec 23 10:34 o1_mf_temp_ktbfqjfx_.tmp
-rw-r-----. 1 oracle oinstall 1226842112 Dec 23 10:39 o1_mf_system_ktbfo8kh_.dbf
-rw-r-----. 1 oracle oinstall 1845501952 Dec 23 10:39 o1_mf_sysaux_ktbfo8k3_.dbf
-rw-r-----. 1 oracle oinstall 644882432 Dec 23 10:39 o1_mf_undotbs1_ktbfo8km_.dbf
-rw-r-----. 1 oracle oinstall 23076864 Jan 18 22:00 o1_mf_temp_ktbgcobn_.tmp
-rw-r-----. 1 oracle oinstall 1237327872 Jan 19 20:21 o1_mf_system_ktbgb353_.dbf
-rw-r-----. 1 oracle oinstall 1845501952 Jan 19 20:31 o1_mf_sysaux_ktbgb34z_.dbf
-rw-r-----. 1 oracle oinstall 644882432 Jan 19 20:31 o1_mf_undotbs1_ktbgb356_.dbf
[oracle@oraclelab1 datafile]$ kill -9 21174
[oracle@oraclelab1 datafile]$ sqlplus / as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 19 20:35:07 2023

Version 19.17.0.0.0

Copyright (c) 1982, 2022, Oracle. All rights reserved.

Connected.
SQL> exit
Disconnected
[oracle@oraclelab1 datafile]$ . oraenv^C
[oracle@oraclelab1 datafile]$
[oracle@oraclelab1 datafile]$
[oracle@oraclelab1 datafile]$ ps -ef|grep smon
oracle 32414 32225 0 20:35 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab1 datafile]$

login as: root

[email protected]'s password:

Last login: Thu Dec 29 09:26:24 2022 from 172.29.0.99

[root@oraclelab2 ~]# ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11605 1 0 2022 ? 00:00:29 ora_smon_TESTDB
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
root 30671 30330 0 20:31 pts/0 00:00:00 grep --color=auto smon
[root@oraclelab2 ~]# su - oracle
Last login: Tue Dec 27 10:41:58 IST 2022 on pts/2
[oracle@oraclelab2 ~]$ . oraenv
ORACLE_SID = [TESTCDB] ? TESTDB
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@oraclelab2 ~]$ sqlplus / as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 19 20:32:32 2023

Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.17.0.0.0

SQL> select name from v$datafile;

NAME
--------------------------------------------------------------------------------
+DATA/TESTDB/DATAFILE/system.265.1122370375
+DATA/TESTDB/DATAFILE/sysaux.259.1122370411
+DATA/TESTDB/DATAFILE/undotbs1.295.1122370435
+DATA/TESTDB/DATAFILE/users.296.1122370437

SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.17.0.0.0
[oracle@oraclelab2 ~]$ ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11605 1 0 2022 ? 00:00:29 ora_smon_TESTDB
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
oracle 30918 30739 0 20:33 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab2 ~]$ kill -9 11605
[oracle@oraclelab2 ~]$ ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
oracle 30926 30739 0 20:34 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab2 ~]$ ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
oracle 30942 30739 0 20:34 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab2 ~]$ ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
oracle 30956 30739 0 20:34 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab2 ~]$ ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
oracle 30959 30739 0 20:34 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab2 ~]$ ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
oracle 30961 30739 0 20:34 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab2 ~]$ ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
oracle 30964 30739 0 20:34 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab2 ~]$ ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
oracle 30968 30739 0 20:34 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab2 ~]$ ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
oracle 30970 30739 0 20:34 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab2 ~]$ ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
oracle 30973 30739 0 20:34 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab2 ~]$ ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
oracle 30976 30739 0 20:34 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab2 ~]$ ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
oracle 30978 30739 0 20:34 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab2 ~]$ ps -ef|grep smon
oracle 11361 1 0 2022 ? 00:00:29 asm_smon_+ASM
oracle 11610 1 0 2022 ? 00:03:07 ora_smon_TESTCDB
oracle 31048 1 0 20:34 ? 00:00:00 ora_smon_TESTDB
oracle 31115 30739 0 20:34 pts/0 00:00:00 grep --color=auto smon
[oracle@oraclelab2 ~]$

login as: root

[email protected]'s password:

Last login: Thu Jan 12 14:51:18 2023 from 172.29.0.99

[root@node1 ~]# ps -ef|grep smon
oraprod 21673 1 0 Jan05 ? 00:03:07 ora_smon_SINGLE
oraprod 22328 1 0 Jan05 ? 00:00:37 ora_smon_ORAPROD1
oracle 22969 1 0 Jan05 ? 00:00:38 ora_smon_RAC12C1
oracle 23076 1 0 Jan05 ? 00:00:40 ora_smon_CDBDB1
oracle 23398 1 0 Jan05 ? 00:00:39 ora_smon_ORADB1
root 25041 1 1 2022 ? 12:31:51 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 25779 1 0 2022 ? 00:01:15 asm_smon_+ASM1
oracle 26950 1 0 Jan12 ? 00:00:06 ora_smon_ORA19C
root 32147 32078 0 20:28 pts/0 00:00:00 grep --color=auto smon
[root@node1 ~]# su - oracle
Last login: Thu Jan 19 20:25:45 IST 2023
[oracle@node1 ~]$ . oraenv
ORACLE_SID = [oracle] ? ORADB1
The Oracle base has been set to /u01/app/oracle
[oracle@node1 ~]$ srvctl startus database -d ORADB1
Usage: srvctl <command> <object> [<options>]
commands: enable|disable|export|import|start|stop|relocate|status|add|remove|modify|getenv|
setenv|unsetenv|config|convert|update|upgrade|downg rade|predict
objects: database|instance|service|nodeapps|vip|network|asm|asmnetwork|diskgroup|listener|
srvpool|server|scan|scan_listener|qosmserver|home|fi lesystem|gns|cvu|havip|exportfs|
rhpserver|rhpclient|mgmtdb|mgmtlsnr|volume|cha|mountfs|vm|ovmm|acfsrapps|oraclehome|
rhpplsnr|cdp|cdpproxy|tfa|iose rver|ons|netstorageservice
For detailed help on each command and object and its options use:
srvctl <command> -help [-compatible] or
srvctl <command> <object> -help [-compatible]
PRKO-2001 : Invalid command line syntax
[oracle@node1 ~]$ srvctl startus database -d ORADB
Usage: srvctl <command> <object> [<options>]
commands: enable|disable|export|import|start|stop|relocate|status|add|remove|modify|getenv|
setenv|unsetenv|config|convert|update|upgrade|downg rade|predict
objects: database|instance|service|nodeapps|vip|network|asm|asmnetwork|diskgroup|listener|
srvpool|server|scan|scan_listener|qosmserver|home|fi lesystem|gns|cvu|havip|exportfs|
rhpserver|rhpclient|mgmtdb|mgmtlsnr|volume|cha|mountfs|vm|ovmm|acfsrapps|oraclehome|
rhpplsnr|cdp|cdpproxy|tfa|iose rver|ons|netstorageservice
For detailed help on each command and object and its options use:
srvctl <command> -help [-compatible] or
srvctl <command> <object> -help [-compatible]
PRKO-2001 : Invalid command line syntax
[oracle@node1 ~]$ srvctl status database -d ORADB
Instance ORADB1 is running on node node1
Instance ORADB2 is not running on node node2
[oracle@node1 ~]$ srvctl status database -d ORADB
Instance ORADB1 is running on node node1
Instance ORADB2 is not running on node node2
[oracle@node1 ~]$ srvctl status database -d ORADB
Instance ORADB1 is running on node node1
Instance ORADB2 is not running on node node2
[oracle@node1 ~]$ srvctl status database -d ORADB
Instance ORADB1 is running on node node1
Instance ORADB2 is not running on node node2
[oracle@node1 ~]$ crsctl stat res ^C
[oracle@node1 ~]$
[oracle@node1 ~]$
[oracle@node1 ~]$ . oraenv
ORACLE_SID = [ORADB1] ? +ASM1
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@node1 ~]$ crsclt stat res -t
bash: crsclt: command not found...
[oracle@node1 ~]$ crsctl stat res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE node1 Started,STABLE
ora.cluster_interconnect.haip
1 ONLINE ONLINE node1 STABLE
ora.crf
1 ONLINE ONLINE node1 STABLE
ora.crsd
1 ONLINE ONLINE node1 CHECK TIMED OUT,STAB
LE
ora.cssd
1 ONLINE ONLINE node1 STABLE
ora.cssdmonitor
1 ONLINE ONLINE node1 STABLE
ora.ctssd
1 ONLINE ONLINE node1 OBSERVER,STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.drivers.acfs
1 ONLINE ONLINE node1 STABLE
ora.evmd
1 ONLINE ONLINE node1 STABLE
ora.gipcd
1 ONLINE ONLINE node1 STABLE
ora.gpnpd
1 ONLINE ONLINE node1 STABLE
ora.mdnsd
1 ONLINE ONLINE node1 STABLE
ora.storage
1 ONLINE ONLINE node1 STABLE
--------------------------------------------------------------------------------
[oracle@node1 ~]$
[oracle@node1 ~]$
[oracle@node1 ~]$ exit
logout
[root@node1 ~]# . oraenv
ORACLE_SID = [root] ? +ASM1
The Oracle base has been set to /u01/app/oracle
[root@node1 ~]# crsctl stop crs -f
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on
'node1'
CRS-2673: Attempting to stop 'ora.crsd' on 'node1'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'node1'
CRS-2673: Attempting to stop 'ora.chad' on 'node1'
CRS-2673: Attempting to stop 'ora.qosmserver' on 'node1'
CRS-2673: Attempting to stop 'ora.rac1n.racnode.svc' on 'node1'
CRS-2677: Stop of 'ora.rac1n.racnode.svc' on 'node1' succeeded
CRS-2677: Stop of 'ora.qosmserver' on 'node1' succeeded
CRS-2677: Stop of 'ora.chad' on 'node1' succeeded
^C
[root@node1 ~]#
[root@node1 ~]#
[root@node1 ~]#
[root@node1 ~]#
[root@node1 ~]# ps -ef|grep d.bin
root 2261 1 1 20:30 ? 00:00:14 /u01/app/19.0.0.0/grid/bin/ologgerd -M
oracle 7263 1 0 2022 ? 02:27:45 /u01/app/19.0.0.0/grid/bin/oraagent.bin
oracle 9416 1 0 2022 ? 02:12:28 /u01/app/19.0.0.0/grid/bin/gipcd.bin
root 18582 32078 0 20:44 pts/0 00:00:00 grep --color=auto d.bin
root 20783 1 0 Jan05 ? 00:57:56 /u01/app/19.0.0.0/grid/bin/orarootagent.bin
root 20837 1 0 Jan05 ? 02:44:33 /u01/app/19.0.0.0/grid/bin/orarootagent.bin
oraprod 20985 1 0 Jan05 ? 01:15:37 /u01/app/19.0.0.0/grid/bin/oraagent.bin
root 24661 1 0 2022 ? 04:04:35 /u01/app/19.0.0.0/grid/bin/ohasd.bin reboot
oracle 24900 1 0 2022 ? 03:23:02 /u01/app/19.0.0.0/grid/bin/evmd.bin
oracle 24901 1 0 2022 ? 01:48:20 /u01/app/19.0.0.0/grid/bin/mdnsd.bin
oracle 24941 1 0 2022 ? 01:40:04 /u01/app/19.0.0.0/grid/bin/gpnpd.bin
oracle 24986 24900 0 2022 ? 01:31:35 /u01/app/19.0.0.0/grid/bin/evmlogger.bin -o
/u01/app/19.0.0.0/grid/log/[HOSTNAME]/evmd/evmlogger.i nfo -l
/u01/app/19.0.0.0/grid/log/[HOSTNAME]/evmd/evmlogger.log
root 25039 1 0 2022 ? 02:01:31 /u01/app/19.0.0.0/grid/bin/cssdmonitor
root 25041 1 1 2022 ? 12:32:10 /u01/app/19.0.0.0/grid/bin/osysmond.bin
root 25074 1 0 2022 ? 02:03:28 /u01/app/19.0.0.0/grid/bin/cssdagent
oracle 25091 1 0 2022 ? 08:16:31 /u01/app/19.0.0.0/grid/bin/ocssd.bin
root 25262 1 0 2022 ? 03:18:42 /u01/app/19.0.0.0/grid/bin/octssd.bin reboot
root 25834 1 0 2022 ? 04:12:03 /u01/app/19.0.0.0/grid/bin/crsd.bin reboot
oracle 26125 1 0 2022 ? 00:02:45 /u01/app/19.0.0.0/grid/bin/tnslsnr LISTENER -
no_crs_notify -inherit
oracle 26188 1 0 2022 ? 00:03:24 /u01/app/19.0.0.0/grid/bin/tnslsnr
LISTENER_SCAN1 -no_crs_notify -inherit
oracle 28392 1 1 Jan13 ? 02:06:37 /u01/app/19.0.0.0/grid/bin/oraagent.bin
oracle 29015 1 0 2022 ? 00:32:08 /u01/app/19.0.0.0/grid/bin/tnslsnr
ASMNET1LSNR_ASM -no_crs_notify -inherit
oracle 32292 1 0 20:28 ? 00:00:00 /u01/app/19.0.0.0/grid/bin/tnslsnr MGMTLSNR -
no_crs_notify -inherit
[root@node1 ~]# su - oracle
Last login: Thu Jan 19 20:40:48 IST 2023
[oracle@node1 ~]$ kill -9 -1
[oracle@node1 ~]$
Network error: Software caused connection abort

────────────────────────────────────────────────────────────
────────────────────────────────────────────────────────────
──────────────────────────

Session stopped
- Press <return> to exit tab
- Press R to restart session
- Press S to save terminal output to file
login as: root
[email protected]'s password:

Last login: Thu Jan 19 20:28:05 2023 from 172.29.48.23

[root@node1 ~]# ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:00 /u01/app/19.0.0.0/grid/bin/osysmond.bin
root 4519 4457 0 20:46 pts/0 00:00:00 grep --color=auto smon
[root@node1 ~]# . oraenv
ORACLE_SID = [root] ? +ASM1
The Oracle base has been set to /u01/app/oracle
[root@node1 ~]# crsclt stat res -t -init
bash: crsclt: command not found...
[root@node1 ~]# crsctl stat res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE node1 STABLE
ora.cluster_interconnect.haip
1 ONLINE ONLINE node1 STABLE
ora.crf
1 ONLINE ONLINE node1 STABLE
ora.crsd
1 ONLINE OFFLINE STABLE
ora.cssd
1 ONLINE ONLINE node1 STABLE
ora.cssdmonitor
1 ONLINE ONLINE node1 STABLE
ora.ctssd
1 ONLINE ONLINE node1 OBSERVER,STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.drivers.acfs
1 ONLINE ONLINE node1 STABLE
ora.evmd
1 ONLINE ONLINE node1 STABLE
ora.gipcd
1 ONLINE ONLINE node1 STABLE
ora.gpnpd
1 ONLINE ONLINE node1 STABLE
ora.mdnsd
1 ONLINE ONLINE node1 STABLE
ora.storage
1 ONLINE OFFLINE node1 STARTING
--------------------------------------------------------------------------------
[root@node1 ~]# crsctl stat res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE node1 STABLE
ora.cluster_interconnect.haip
1 ONLINE ONLINE node1 STABLE
ora.crf
1 ONLINE ONLINE node1 STABLE
ora.crsd
1 ONLINE OFFLINE STABLE
ora.cssd
1 ONLINE ONLINE node1 STABLE
ora.cssdmonitor
1 ONLINE ONLINE node1 STABLE
ora.ctssd
1 ONLINE ONLINE node1 OBSERVER,STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.drivers.acfs
1 ONLINE ONLINE node1 STABLE
ora.evmd
1 ONLINE ONLINE node1 STABLE
ora.gipcd
1 ONLINE ONLINE node1 STABLE
ora.gpnpd
1 ONLINE ONLINE node1 STABLE
ora.mdnsd
1 ONLINE ONLINE node1 STABLE
ora.storage
1 ONLINE OFFLINE node1 STARTING
--------------------------------------------------------------------------------
[root@node1 ~]# crsctl stat res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE node1 STABLE
ora.cluster_interconnect.haip
1 ONLINE ONLINE node1 STABLE
ora.crf
1 ONLINE ONLINE node1 STABLE
ora.crsd
1 ONLINE OFFLINE STABLE
ora.cssd
1 ONLINE ONLINE node1 STABLE
ora.cssdmonitor
1 ONLINE ONLINE node1 STABLE
ora.ctssd
1 ONLINE ONLINE node1 OBSERVER,STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.drivers.acfs
1 ONLINE ONLINE node1 STABLE
ora.evmd
1 ONLINE ONLINE node1 STABLE
ora.gipcd
1 ONLINE ONLINE node1 STABLE
ora.gpnpd
1 ONLINE ONLINE node1 STABLE
ora.mdnsd
1 ONLINE ONLINE node1 STABLE
ora.storage
1 ONLINE OFFLINE node1 STARTING
--------------------------------------------------------------------------------
[root@node1 ~]# su - oracle
Last login: Thu Jan 19 20:44:50 IST 2023 on pts/0
[oracle@node1 ~]$ . oraenv
ORACLE_SID = [oracle] ? +ASM1
The Oracle base has been set to /u01/app/oracle
[oracle@node1 ~]$ sqlplus / as sysasm

SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 19 20:46:39 2023

Version 19.11.0.0.0

Copyright (c) 1982, 2020, Oracle. All rights reserved.

Connected to an idle instance.

SQL> startup;
ASM instance started

Total System Global Area 3213349944 bytes

Fixed Size 8901688 bytes
Variable Size 3170893824 bytes
ASM Cache 33554432 bytes
ASM diskgroups mounted
SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0
[oracle@node1 ~]$ crsctl stat res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE node1 STABLE
ora.cluster_interconnect.haip
1 ONLINE ONLINE node1 STABLE
ora.crf
1 ONLINE ONLINE node1 STABLE
ora.crsd
1 ONLINE INTERMEDIATE node1 STABLE
ora.cssd
1 ONLINE ONLINE node1 STABLE
ora.cssdmonitor
1 ONLINE ONLINE node1 STABLE
ora.ctssd
1 ONLINE ONLINE node1 OBSERVER,STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.drivers.acfs
1 ONLINE ONLINE node1 STABLE
ora.evmd
1 ONLINE ONLINE node1 STABLE
ora.gipcd
1 ONLINE ONLINE node1 STABLE
ora.gpnpd
1 ONLINE ONLINE node1 STABLE
ora.mdnsd
1 ONLINE ONLINE node1 STABLE
ora.storage
1 ONLINE ONLINE node1 STABLE
--------------------------------------------------------------------------------
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:01 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 5303 4630 0 20:47 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:01 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 5316 4630 0 20:47 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:01 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 5322 4630 0 20:47 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:01 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 5357 4630 0 20:47 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:01 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 5362 4630 0 20:47 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:01 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 5496 4630 0 20:47 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:01 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 5514 4630 0 20:47 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:01 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 5533 4630 0 20:47 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$ crsctl stat res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE node1 STABLE
ora.cluster_interconnect.haip
1 ONLINE ONLINE node1 STABLE
ora.crf
1 ONLINE ONLINE node1 STABLE
ora.crsd
1 ONLINE ONLINE node1 STABLE
ora.cssd
1 ONLINE ONLINE node1 STABLE
ora.cssdmonitor
1 ONLINE ONLINE node1 STABLE
ora.ctssd
1 ONLINE ONLINE node1 OBSERVER,STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.drivers.acfs
1 ONLINE ONLINE node1 STABLE
ora.evmd
1 ONLINE ONLINE node1 STABLE
ora.gipcd
1 ONLINE ONLINE node1 STABLE
ora.gpnpd
1 ONLINE ONLINE node1 STABLE
ora.mdnsd
1 ONLINE ONLINE node1 STABLE
ora.storage
1 ONLINE ONLINE node1 STABLE
--------------------------------------------------------------------------------
[oracle@node1 ~]$ crsctl stat res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE node1 STABLE
ora.cluster_interconnect.haip
1 ONLINE ONLINE node1 STABLE
ora.crf
1 ONLINE ONLINE node1 STABLE
ora.crsd
1 ONLINE ONLINE node1 STABLE
ora.cssd
1 ONLINE ONLINE node1 STABLE
ora.cssdmonitor
1 ONLINE ONLINE node1 STABLE
ora.ctssd
1 ONLINE ONLINE node1 OBSERVER,STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.drivers.acfs
1 ONLINE ONLINE node1 STABLE
ora.evmd
1 ONLINE ONLINE node1 STABLE
ora.gipcd
1 ONLINE ONLINE node1 STABLE
ora.gpnpd
1 ONLINE ONLINE node1 STABLE
ora.mdnsd
1 ONLINE ONLINE node1 STABLE
ora.storage
1 ONLINE ONLINE node1 STABLE
--------------------------------------------------------------------------------
[oracle@node1 ~]$ crsctl stat res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE node1 STABLE
ora.cluster_interconnect.haip
1 ONLINE ONLINE node1 STABLE
ora.crf
1 ONLINE ONLINE node1 STABLE
ora.crsd
1 ONLINE ONLINE node1 STABLE
ora.cssd
1 ONLINE ONLINE node1 STABLE
ora.cssdmonitor
1 ONLINE ONLINE node1 STABLE
ora.ctssd
1 ONLINE ONLINE node1 OBSERVER,STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.drivers.acfs
1 ONLINE ONLINE node1 STABLE
ora.evmd
1 ONLINE ONLINE node1 STABLE
ora.gipcd
1 ONLINE ONLINE node1 STABLE
ora.gpnpd
1 ONLINE ONLINE node1 STABLE
ora.mdnsd
1 ONLINE ONLINE node1 STABLE
ora.storage
1 ONLINE ONLINE node1 STABLE
--------------------------------------------------------------------------------
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:01 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 6038 1 0 20:47 ? 00:00:00 ora_smon_ORADB1
oracle 6039 1 0 20:47 ? 00:00:00 ora_smon_ORA19C
oracle 6097 1 0 20:47 ? 00:00:00 ora_smon_RAC12C1
oracle 6271 4630 0 20:47 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$
[oracle@node1 ~]$
[oracle@node1 ~]$ . oraenv
ORACLE_SID = [+ASM1] ? ORADB1

The Oracle base remains unchanged with value /u01/app/oracle

[oracle@node1 ~]$
[oracle@node1 ~]$
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:02 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 6039 1 0 20:47 ? 00:00:00 ora_smon_ORA19C
oracle 8946 1 0 20:49 ? 00:00:00 ora_smon_RAC1N_2
oracle 8951 1 0 20:49 ? 00:00:00 ora_smon_RAC12C1
oracle 9047 4630 0 20:49 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$ . oraenv
ORACLE_SID = [ORADB1] ? RAC1N_2
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@node1 ~]$
[oracle@node1 ~]$ ps -ef|grep smon^C
[oracle@node1 ~]$ srvctl status database -d RAC1N
Database is not running.
Online relocation: INACTIVE
[oracle@node1 ~]$ kill -9 8946
-bash: kill: (8946) - No such process
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:03 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 6039 1 0 20:47 ? 00:00:00 ora_smon_ORA19C
oracle 9435 4630 0 20:50 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:05 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 6039 1 0 20:47 ? 00:00:00 ora_smon_ORA19C
oracle 9875 4630 0 20:52 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$
[oracle@node1 ~]$
[oracle@node1 ~]$ . oraenv
ORACLE_SID = [RAC1N_2] ? RAC1N_1
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@node1 ~]$ sqlplus / as sysdba

SQL*Plus: Release 12.2.0.1.0 Production on Thu Jan 19 20:53:11 2023

Copyright (c) 1982, 2016, Oracle. All rights reserved.

Connected to an idle instance.

SQL> startup;
ORACLE instance started.

Total System Global Area 3070230528 bytes

Fixed Size 8625416 bytes
Variable Size 838861560 bytes
Database Buffers 2214592512 bytes
Redo Buffers 8151040 bytes
Database mounted.
ORA-16038: log 3 sequence# 14317 cannot be archived
ORA-19504: failed to create file ""
ORA-00312: online log 3 thread 2:
'+DATA/RAC1N/ONLINELOG/group_3.316.1067549517'
ORA-00312: online log 3 thread 2:
'+RECO/RAC1N/ONLINELOG/group_3.263.1067549519'

SQL> exit
Disconnected from Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit
Production
[oracle@node1 ~]$ . oraenv
ORACLE_SID = [RAC1N_1] ? +ASM1
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@node1 ~]$ asmcmd -p
ASMCMD [+] > lsdg
State Type Rebal Sector Logical_Sector Block AU Total_MB Free_MB
Req_mir_free_MB Usable_file_MB Offline_disks Voting_files N ame
MOUNTED EXTERN N 512 512 4096 4194304 81904 17076 0
17076 0 Y D ATA/
MOUNTED EXTERN N 512 512 4096 4194304 40952 60 0
60 0 N R ECO/
ASMCMD [+] > lsdg
State Type Rebal Sector Logical_Sector Block AU Total_MB Free_MB
Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name
MOUNTED EXTERN N 512 512 4096 4194304 81904 17076 0
17076 0 Y DATA/
MOUNTED EXTERN N 512 512 4096 4194304 40952 60 0
60 0 N RECO/
ASMCMD [+] > cd RECO/
ASMCMD [+RECO] > ls
CDBDB/
ORADB/
ORAPROD/
PRIMDB/
PRODCDB/
RAC12C/
RAC1N/
SINGLE/
ASMCMD [+RECO] >
ASMCMD [+RECO] >
ASMCMD [+RECO] >
ASMCMD [+RECO] > cd CDBDB/
ASMCMD [+RECO/CDBDB] > ll
ASMCMD-8022: unknown command 'll' specified
ASMCMD [+RECO/CDBDB] > ls
ARCHIVELOG/
AUTOBACKUP/
CONTROLFILE/
ONLINELOG/
ASMCMD [+RECO/CDBDB] > du .
Used_MB Mirror_used_MB
1060 1060
ASMCMD [+RECO/CDBDB] > ^C
ASMCMD [+RECO/CDBDB] > cd ARCHIVELOG/
ASMCMD [+RECO/CDBDB/ARCHIVELOG] > ls -ltr
WARNING: option 'r' is deprecated for 'ls'
please use 'reverse'

Type Redund Striped Time Sys Name

Y 2023_01_15/
ASMCMD [+RECO/CDBDB/ARCHIVELOG] > rm -rf 2023_01_15/
ASMCMD [+RECO/CDBDB/ARCHIVELOG] > lsdg
State Type Rebal Sector Logical_Sector Block AU Total_MB Free_MB
Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name
MOUNTED EXTERN N 512 512 4096 4194304 81904 17076 0
17076 0 Y DATA/
MOUNTED EXTERN N 512 512 4096 4194304 40952 168 0
168 0 N RECO/
ASMCMD [+RECO/CDBDB/ARCHIVELOG] > cd ../..
ASMCMD [+RECO] > cd ORADB/
ASMCMD [+RECO/ORADB] > ls -l
Type Redund Striped Time Sys Name
Y ARCHIVELOG/
Y CONTROLFILE/
Y ONLINELOG/
ASMCMD [+RECO/ORADB] > cd ARCHIVELOG/
ASMCMD [+RECO/ORADB/ARCHIVELOG] > ls -l
Type Redund Striped Time Sys Name
Y 2023_01_15/
ASMCMD [+RECO/ORADB/ARCHIVELOG] > rm -rf *
ASMCMD [+RECO/ORADB/ARCHIVELOG] > lsdg
State Type Rebal Sector Logical_Sector Block AU Total_MB Free_MB
Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name
MOUNTED EXTERN N 512 512 4096 4194304 81904 17076 0
17076 0 Y DATA/
MOUNTED EXTERN N 512 512 4096 4194304 40952 620 0
620 0 N RECO/
ASMCMD [+RECO/ORADB/ARCHIVELOG] > cd +RECO/ORAPROD/
ASMCMD [+RECO/ORAPROD] > ls
CONTROLFILE/
ONLINELOG/
ASMCMD [+RECO/ORAPROD] > cd ../PRIMDB/
ASMCMD [+RECO/PRIMDB] > ls -l
Type Redund Striped Time Sys Name
Y ARCHIVELOG/
Y CONTROLFILE/
Y ONLINELOG/
ASMCMD [+RECO/PRIMDB] > cd ARCHIVELOG/
ASMCMD [+RECO/PRIMDB/ARCHIVELOG] > ls -l
Type Redund Striped Time Sys Name
Y 2022_11_23/
Y 2022_11_24/
Y 2022_11_25/
Y 2022_11_26/
Y 2022_11_27/
Y 2022_11_28/
Y 2022_11_29/
Y 2022_11_30/
Y 2022_12_01/
Y 2022_12_02/
Y 2022_12_03/
Y 2022_12_04/
Y 2022_12_05/
Y 2022_12_06/
Y 2022_12_07/
Y 2022_12_08/
Y 2022_12_09/
Y 2022_12_10/
Y 2022_12_11/
Y 2022_12_12/
Y 2022_12_13/
Y 2022_12_14/
Y 2022_12_15/
Y 2022_12_16/
Y 2022_12_17/
Y 2022_12_18/
Y 2022_12_19/
Y 2022_12_20/
Y 2022_12_21/
Y 2022_12_22/
Y 2022_12_23/
Y 2022_12_24/
Y 2022_12_25/
Y 2022_12_26/
Y 2022_12_27/
ASMCMD [+RECO/PRIMDB/ARCHIVELOG] > rm -rf *
ASMCMD [+RECO/PRIMDB/ARCHIVELOG] >
ASMCMD [+RECO/PRIMDB/ARCHIVELOG] > cd +RECO
ASMCMD [+RECO] > ls -l
Type Redund Striped Time Sys Name
N CDBDB/
Y ORADB/
Y ORAPROD/
Y PRIMDB/
N PRODCDB/
Y RAC12C/
Y RAC1N/
Y SINGLE/
ASMCMD [+RECO] > cd PRODCDB/
ASMCMD [+RECO/PRODCDB] > ls -l
Type Redund Striped Time Sys Name
N CONTROLFILE/
N ONLINELOG/
ASMCMD [+RECO/PRODCDB] > cd ../RAC12C/
ASMCMD [+RECO/RAC12C] > ls -l
Type Redund Striped Time Sys Name
Y ARCHIVELOG/
Y AUTOBACKUP/
Y CONTROLFILE/
Y ONLINELOG/
Y PARAMETERFILE/
ASMCMD [+RECO/RAC12C] > cd ARCHIVELOG/
ASMCMD [+RECO/RAC12C/ARCHIVELOG] > ls -ltr
WARNING: option 'r' is deprecated for 'ls'
please use 'reverse'

Type Redund Striped Time Sys Name

Y 2022_11_16/
Y 2022_11_17/
Y 2022_11_18/
Y 2022_11_21/
Y 2022_11_22/
Y 2022_12_18/
Y 2022_12_19/
Y 2022_12_20/
Y 2022_12_21/
Y 2022_12_22/
Y 2022_12_23/
Y 2022_12_24/
Y 2022_12_25/
Y 2022_12_26/
Y 2022_12_27/
Y 2022_12_28/
Y 2022_12_29/
Y 2022_12_30/
Y 2022_12_31/
Y 2023_01_01/
Y 2023_01_02/
Y 2023_01_03/
Y 2023_01_04/
Y 2023_01_05/
Y 2023_01_06/
Y 2023_01_08/
Y 2023_01_15/
ASMCMD [+RECO/RAC12C/ARCHIVELOG] > rm -rf *
ASMCMD [+RECO/RAC12C/ARCHIVELOG] > lsdg
State Type Rebal Sector Logical_Sector Block AU Total_MB Free_MB
Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name
MOUNTED EXTERN N 512 512 4096 4194304 81904 17076 0
17076 0 Y DATA/
MOUNTED EXTERN N 512 512 4096 4194304 40952 32632 0
32632 0 N RECO/
ASMCMD [+RECO/RAC12C/ARCHIVELOG] > cd ..
ASMCMD [+RECO/RAC12C] > cd ..
ASMCMD [+RECO] > ls -l
Type Redund Striped Time Sys Name
N CDBDB/
Y ORADB/
Y ORAPROD/
Y PRIMDB/
N PRODCDB/
Y RAC12C/
Y RAC1N/
Y SINGLE/
ASMCMD [+RECO] > cdRAC1N/
ASMCMD-8022: unknown command 'cdRAC1N/' specified
ASMCMD [+RECO] > cd RAC1N/
ASMCMD [+RECO/RAC1N] > ls -l
Type Redund Striped Time Sys Name
Y ARCHIVELOG/
Y AUTOBACKUP/
Y CONTROLFILE/
Y ONLINELOG/
ASMCMD [+RECO/RAC1N] > cd ARCHIVELOG/
ASMCMD [+RECO/RAC1N/ARCHIVELOG] > ls -l
Type Redund Striped Time Sys Name
Y 2022_12_17/
Y 2023_01_19/
ASMCMD [+RECO/RAC1N/ARCHIVELOG] > rm -rf *
ASMCMD [+RECO/RAC1N/ARCHIVELOG] > cd ..
ASMCMD [+RECO/RAC1N] > cd ..
ASMCMD [+RECO] > ls -l
Type Redund Striped Time Sys Name
N CDBDB/
Y ORADB/
Y ORAPROD/
Y PRIMDB/
N PRODCDB/
Y RAC12C/
Y RAC1N/
Y SINGLE/
ASMCMD [+RECO] > cd SINGLE/
ASMCMD [+RECO/SINGLE] > ls -l
Type Redund Striped Time Sys Name
Y AUTOBACKUP/
Y CONTROLFILE/
Y ONLINELOG/
ASMCMD [+RECO/SINGLE] > exit
[oracle@node1 ~]$ . oraebv
-bash: oraebv: No such file or directory
[oracle@node1 ~]$ . oraenbv
-bash: oraenbv: No such file or directory
[oracle@node1 ~]$ . oraenv
ORACLE_SID = [+ASM1] ? RAC1N_1
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@node1 ~]$ sqlplus / as sysdba

SQL*Plus: Release 12.2.0.1.0 Production on Thu Jan 19 20:59:43 2023

Copyright (c) 1982, 2016, Oracle. All rights reserved.

Connected to:
Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production

SQL> shut immediate;

ORA-01109: database not open
Database dismounted.

ORACLE instance shut down.

SQL> SQL> SQL> SQL>
SQL>
SQL>
SQL>
SQL>
SQL> startup;
ORACLE instance started.

Total System Global Area 3070230528 bytes

Fixed Size 8625416 bytes
Variable Size 838861560 bytes
Database Buffers 2214592512 bytes
Redo Buffers 8151040 bytes
Database mounted.
Database opened.
SQL> shut immediate;
Database closed.
Database dismounted.
ORACLE instance shut down.
SQL> exit
Disconnected from Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit
Production
[oracle@node1 ~]$ . oraenv^C
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:13 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 6039 1 0 20:47 ? 00:00:00 ora_smon_ORA19C
oracle 16099 1 0 21:02 ? 00:00:00 ora_smon_RAC1N_2
oracle 16990 4630 0 21:04 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$ . oraenv
ORACLE_SID = [RAC1N_1] ? +ASM1
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@node1 ~]$ asmcmd -p
lsdASMCMD [+] > g
State Type Rebal Sector Logical_Sector Block AU Total_MB Free_MB
Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name
MOUNTED EXTERN N 512 512 4096 4194304 81904 17076 0
17076 0 Y DATA/
MOUNTED EXTERN N 512 512 4096 4194304 40952 32376 0
32376 0 N RECO/
ASMCMD [+] > exit
[oracle@node1 ~]$ ps -ef|grep smon^C
[oracle@node1 ~]$
[oracle@node1 ~]$
[oracle@node1 ~]$ sqlplus / as sysasm

SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 19 21:07:17 2023

Version 19.11.0.0.0

Copyright (c) 1982, 2020, Oracle. All rights reserved.

Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0

SQL> desc v$asm_diskgroup;

Name Null? Type
----------------------------------------- -------- ----------------------------
GROUP_NUMBER NUMBER
NAME VARCHAR2(30)
SECTOR_SIZE NUMBER
LOGICAL_SECTOR_SIZE NUMBER
BLOCK_SIZE NUMBER
ALLOCATION_UNIT_SIZE NUMBER
STATE VARCHAR2(11)
TYPE VARCHAR2(6)
TOTAL_MB NUMBER
FREE_MB NUMBER
HOT_USED_MB NUMBER
COLD_USED_MB NUMBER
REQUIRED_MIRROR_FREE_MB NUMBER
USABLE_FILE_MB NUMBER
OFFLINE_DISKS NUMBER
COMPATIBILITY VARCHAR2(60)
DATABASE_COMPATIBILITY VARCHAR2(60)
VOTING_FILES VARCHAR2(1)
CON_ID NUMBER

SQL> select GROUP_NUMBER,NAME,STATE from v$asm_diskgroup;

GROUP_NUMBER NAME STATE

------------ ------------------------------ -----------
1 DATA MOUNTED
2 RECO MOUNTED

SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0
[oracle@node1 ~]$ ps -ef|grep smon
root 4146 1 1 20:45 ? 00:00:15 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 4893 1 0 20:46 ? 00:00:00 asm_smon_+ASM1
oracle 6039 1 0 20:47 ? 00:00:00 ora_smon_ORA19C
oracle 16099 1 0 21:02 ? 00:00:00 ora_smon_RAC1N_2
oracle 17585 4630 0 21:08 pts/0 00:00:00 grep --color=auto smon
[oracle@node1 ~]$ . oraenv
ORACLE_SID = [+ASM1] ? +ASM1
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@node1 ~]$ sqlplus / as sysasm

SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 19 21:08:43 2023

Version 19.11.0.0.0

Copyright (c) 1982, 2020, Oracle. All rights reserved.

Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0

SQL> select GROUP_NUMBER,NAME,STATE from v$asm_diskgroup;

GROUP_NUMBER NAME STATE

------------ ------------------------------ -----------
1 DATA MOUNTED
2 RECO MOUNTED

SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0
[oracle@node1 ~]$ sqlplus / as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 19 21:08:58 2023

Version 19.11.0.0.0

Copyright (c) 1982, 2020, Oracle. All rights reserved.

Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0

SQL> select GROUP_NUMBER,NAME,STATE from v$asm_diskgroup;

GROUP_NUMBER NAME STATE

------------ ------------------------------ -----------
1 DATA MOUNTED
2 RECO MOUNTED

SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0
[oracle@node1 ~]$ . oraenv
ORACLE_SID = [+ASM1] ? RAC1N_2
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@node1 ~]$ sqlplus / as sysasm

SQL*Plus: Release 12.2.0.1.0 Production on Thu Jan 19 21:09:56 2023

Copyright (c) 1982, 2016, Oracle. All rights reserved.

ERROR:
ORA-01031: insufficient privileges

Enter user-name: exit

Enter password:
[oracle@node1 ~]$
[oracle@node1 ~]$ sqlplus / as sysdba

SQL*Plus: Release 12.2.0.1.0 Production on Thu Jan 19 21:10:04 2023

Connected to:
Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production

SQL> select GROUP_NUMBER,NAME,STATE from v$asm_diskgroup;

GROUP_NUMBER NAME STATE
------------ ------------------------------ -----------
1 DATA CONNECTED
2 RECO CONNECTED

SQL> exit
Disconnected from Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit
Production
[oracle@node1 ~]$
[oracle@node1 ~]$
[oracle@node1 ~]$ env |grep ORA
ORACLE_SID=RAC1N_2
ORACLE_BASE=/u01/app/oracle
ORACLE_HOME=/u01/app/oracle/product/12.2.0.1/dbhome_1
[oracle@node1 ~]$ sqlplus / as sysdba

SQL*Plus: Release 12.2.0.1.0 Production on Thu Jan 19 21:10:28 2023

Connected to:
Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production

SQL> select GROUP_NUMBER,NAME,STATE from v$asm_diskgroup;

GROUP_NUMBER NAME STATE

------------ ------------------------------ -----------
1 DATA CONNECTED
2 RECO CONNECTED

SQL> exit
Disconnected from Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit
Production
[oracle@node1 ~]$ . oraenv
ORACLE_SID = [RAC1N_2] ? +ASM1
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@node1 ~]$
[oracle@node1 ~]$ env |grep ORA
ORACLE_SID=+ASM1
ORACLE_BASE=/u01/app/oracle
ORACLE_HOME=/u01/app/19.0.0.0/grid
[oracle@node1 ~]$ sqlplus / as sysasm
SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 19 21:11:12 2023
Version 19.11.0.0.0

Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0

SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0
[oracle@node1 ~]$ asmcmd -p
ASMCMD [+] > lsdg
State Type Rebal Sector Logical_Sector Block AU Total_MB Free_MB
Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name
MOUNTED EXTERN N 512 512 4096 4194304 81904 17076 0
17076 0 Y DATA/
MOUNTED EXTERN N 512 512 4096 4194304 40952 32376 0
32376 0 N RECO/
ASMCMD [+] > exit
[oracle@node1 ~]$

login as: root

[email protected]'s password:

└───────────────────────────────────────────────────────────
───────────┘
Last login: Tue Dec 13 12:16:10 2022 from 172.29.48.23
[root@node2 ~]# ps -ef|grep smon
root 2135 2011 0 20:28 pts/0 00:00:00 grep --color=auto smon
root 4201 1 1 2022 ? 14:12:01 /u01/app/19.0.0.0/grid/bin/osysmond.bin
[root@node2 ~]# . oraenv
ORACLE_SID = [root] ? +ASM2
The Oracle base has been set to /u01/app/oracle
[root@node2 ~]# crsclt stip crs -f
bash: crsclt: command not found...
[root@node2 ~]# crsctl stop crs -f
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on
'node2'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'node2'
CRS-2673: Attempting to stop 'ora.storage' on 'node2'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'node2'
CRS-2677: Stop of 'ora.storage' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'node2'
CRS-2673: Attempting to stop 'ora.evmd' on 'node2'
CRS-2673: Attempting to stop 'ora.asm' on 'node2'
CRS-2677: Stop of 'ora.mdnsd' on 'node2' succeeded
CRS-2677: Stop of 'ora.asm' on 'node2' succeeded
CRS-2677: Stop of 'ora.drivers.acfs' on 'node2' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'node2' succeeded
CRS-2677: Stop of 'ora.evmd' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'node2'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'node2'
CRS-2677: Stop of 'ora.cssd' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'node2'
CRS-2673: Attempting to stop 'ora.crf' on 'node2'
CRS-2677: Stop of 'ora.crf' on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'node2'
CRS-2677: Stop of 'ora.gpnpd' on 'node2' succeeded
CRS-2677: Stop of 'ora.gipcd' on 'node2' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'node2' has
completed
CRS-4133: Oracle High Availability Services has been stopped.
[root@node2 ~]# crstl start crs
bash: crstl: command not found...
[root@node2 ~]# crsctl start crs
CRS-4123: Oracle High Availability Services has been started.
[root@node2 ~]# ps -ef|grep smon
root 14485 1 1 20:37 ? 00:00:00 /u01/app/19.0.0.0/grid/bin/osysmond.bin
root 14772 2011 0 20:38 pts/0 00:00:00 grep --color=auto smon
[root@node2 ~]# su - racle
su: user racle does not exist
[root@node2 ~]# su - oracle
Last login: Sun Dec 18 00:51:16 IST 2022
[oracle@node2 ~]$ . oraenv
ORACLE_SID = [oracle] ? +ASM2
The Oracle base has been set to /u01/app/oracle
[oracle@node2 ~]$ sqlplus / as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 19 20:38:31 2023

Version 19.11.0.0.0

Connected to an idle instance.

SQL> exit
Disconnected
[oracle@node2 ~]$ sqlplus / as sysasm

SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 19 20:38:35 2023

Version 19.11.0.0.0

Connected to an idle instance.

SQL> startup;
ASM instance started

Total System Global Area 3213349944 bytes

Fixed Size 8901688 bytes
Variable Size 3170893824 bytes
ASM Cache 33554432 bytes
ASM diskgroups mounted
SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0
[oracle@node2 ~]$ ps -ef|greps mon
bash: greps: command not found...
Similar command is: 'grep'
[oracle@node2 ~]$ ps -ef|greps smon
bash: greps: command not found...
Similar command is: 'grep'
[oracle@node2 ~]$
[oracle@node2 ~]$
[oracle@node2 ~]$ ps -ef|grep smon
root 14485 1 1 20:37 ? 00:00:01 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 14991 1 0 20:38 ? 00:00:00 asm_smon_+ASM2
oracle 15281 14819 0 20:38 pts/0 00:00:00 grep --color=auto smon
[oracle@node2 ~]$ ps -ef|grep smon
root 14485 1 1 20:37 ? 00:00:01 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 14991 1 0 20:38 ? 00:00:00 asm_smon_+ASM2
oracle 15752 1 0 20:39 ? 00:00:00 ora_smon_RAC12C2
oracle 15815 1 0 20:39 ? 00:00:00 ora_smon_CDBDB2
oraprod 15937 1 0 20:39 ? 00:00:00 ora_smon_ORAPROD2
oracle 15977 1 0 20:39 ? 00:00:00 ora_smon_PRIMDB2
oracle 16098 1 0 20:39 ? 00:00:00 ora_smon_ORADB2
oracle 16217 14819 0 20:39 pts/0 00:00:00 grep --color=auto smon
[oracle@node2 ~]$ crsctl stat res -t
0n9--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ora.LISTENER_PRIMDB.lsnr
ONLINE ONLINE node1 STABLE
ONLINE OFFLINE node2 STABLE
ora.LISTENER_RAC12C.lsnr
ONLINE ONLINE node1 STABLE
ONLINE OFFLINE node2 STABLE
ora.chad
ONLINE ONLINE node1 CHECK TIMED OUT,STAB
LE
ONLINE ONLINE node2 STABLE
ora.helper
OFFLINE OFFLINE node1 STABLE
OFFLINE OFFLINE node2 IDLE,STABLE
ora.net1.network
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ora.ons
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE node2 STABLE
2 ONLINE ONLINE node1 STABLE
3 ONLINE OFFLINE STABLE
ora.DATA.dg(ora.asmgroup)
1 ONLINE ONLINE node2 STABLE
2 ONLINE ONLINE node1 STABLE
3 OFFLINE OFFLINE STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE node1 STABLE
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE node2 STABLE
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE node2 STABLE
ora.MGMTLSNR
1 ONLINE ONLINE node1 169.254.30.254 10.38
.9.111,STABLE
ora.RECO.dg(ora.asmgroup)
1 ONLINE ONLINE node2 STABLE
2 ONLINE ONLINE node1 STABLE
3 OFFLINE OFFLINE STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE node2 Started,STABLE
2 ONLINE ONLINE node1 Started,STABLE
3 ONLINE OFFLINE STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE node2 STABLE
2 ONLINE ONLINE node1 STABLE
3 ONLINE OFFLINE STABLE
ora.cdbdb.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oracle/prod
uct/12.2.0.1/dbhome_
1,STABLE
2 ONLINE OFFLINE node2 STARTING
ora.cvu
1 ONLINE ONLINE node1 STABLE
ora.gridtgt.db
1 OFFLINE OFFLINE STABLE
2 ONLINE OFFLINE Instance Shutdown,ST
ABLE
ora.mgmtdb
1 ONLINE ONLINE node1 Open,STABLE
ora.node1.vip
1 ONLINE ONLINE node1 STABLE
ora.node2.vip
1 ONLINE ONLINE node2 STABLE
ora.ora19c.db
1 ONLINE INTERMEDIATE node1 Dismounted,Mount Ini
tiated,HOME=/u01/app
/oracle/product/19.0
.0.0/dbhome_2,STABLE
ora.oradb.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oracle/prod
uct/19.0.0.0/dbhome_
1,STABLE
2 ONLINE OFFLINE node2 STARTING
ora.oraprod.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oraprod/pro
duct/12.2.0.1/dbhome
_1,STABLE
2 ONLINE OFFLINE node2 STARTING
ora.primdb.db
1 ONLINE OFFLINE STABLE
2 ONLINE OFFLINE Stuck Archiver,Mount
ed (Closed),Open Ini
tiated,HOME=/u01/app
/oracle/product/19.0
.0.0/dbhome_1,STABLE
ora.qosmserver
1 ONLINE ONLINE node1 STABLE
ora.rac12c.db
1 ONLINE ONLINE node1 Open,HOME=/u01/app/o
racle/product/12.2.0
.1/dbhome_1,STABLE
2 ONLINE OFFLINE node2 STARTING
ora.rac12c.rac12c_srv.svc
1 ONLINE ONLINE node1 STABLE
2 ONLINE OFFLINE STABLE
ora.rac1n.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oracle/prod
uct/12.2.0.1/dbhome_
1,STABLE
ora.rac1n.racnode.svc
2 ONLINE ONLINE node1 STABLE
ora.rhpserver
1 OFFLINE OFFLINE STABLE
ora.scan1.vip
1 ONLINE ONLINE node1 STABLE
ora.scan2.vip
1 ONLINE ONLINE node2 STABLE
ora.scan3.vip
1 ONLINE ONLINE node2 STABLE
ora.single.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oraprod/pro
duct/12.2.0.1/dbhome
_1,STABLE
--------------------------------------------------------------------------------
[oracle@node2 ~]$ crsctl stat res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE node2 STABLE
ora.cluster_interconnect.haip
1 ONLINE ONLINE node2 STABLE
ora.crf
1 ONLINE ONLINE node2 STABLE
ora.crsd
1 ONLINE ONLINE node2 STABLE
ora.cssd
1 ONLINE ONLINE node2 STABLE
ora.cssdmonitor
1 ONLINE ONLINE node2 STABLE
ora.ctssd
1 ONLINE ONLINE node2 OBSERVER,STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.drivers.acfs
1 ONLINE ONLINE node2 STABLE
ora.evmd
1 ONLINE ONLINE node2 STABLE
ora.gipcd
1 ONLINE ONLINE node2 STABLE
ora.gpnpd
1 ONLINE ONLINE node2 STABLE
ora.mdnsd
1 ONLINE ONLINE node2 STABLE
ora.storage
1 ONLINE ONLINE node2 STABLE
--------------------------------------------------------------------------------
[oracle@node2 ~]$
[oracle@node2 ~]$
[oracle@node2 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ora.LISTENER_PRIMDB.lsnr
ONLINE ONLINE node1 STABLE
ONLINE OFFLINE node2 STABLE
ora.LISTENER_RAC12C.lsnr
ONLINE ONLINE node1 STABLE
ONLINE OFFLINE node2 STABLE
ora.chad
ONLINE ONLINE node1 CHECK TIMED OUT,STAB
LE
ONLINE ONLINE node2 STABLE
ora.helper
OFFLINE OFFLINE node1 STABLE
OFFLINE OFFLINE node2 IDLE,STABLE
ora.net1.network
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ora.ons
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE node2 STABLE
2 ONLINE ONLINE node1 STABLE
3 ONLINE OFFLINE STABLE
ora.DATA.dg(ora.asmgroup)
1 ONLINE ONLINE node2 STABLE
2 ONLINE ONLINE node1 STABLE
3 OFFLINE OFFLINE STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE node1 STABLE
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE node2 STABLE
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE node2 STABLE
ora.MGMTLSNR
1 ONLINE ONLINE node1 169.254.30.254 10.38
.9.111,STABLE
ora.RECO.dg(ora.asmgroup)
1 ONLINE ONLINE node2 STABLE
2 ONLINE ONLINE node1 STABLE
3 OFFLINE OFFLINE STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE node2 Started,STABLE
2 ONLINE ONLINE node1 Started,STABLE
3 ONLINE OFFLINE STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE node2 STABLE
2 ONLINE ONLINE node1 STABLE
3 ONLINE OFFLINE STABLE
ora.cdbdb.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oracle/prod
uct/12.2.0.1/dbhome_
1,STABLE
2 ONLINE OFFLINE node2 STARTING
ora.cvu
1 ONLINE ONLINE node1 STABLE
ora.gridtgt.db
1 OFFLINE OFFLINE STABLE
2 ONLINE OFFLINE Instance Shutdown,ST
ABLE
ora.mgmtdb
1 ONLINE ONLINE node1 Open,STABLE
ora.node1.vip
1 ONLINE ONLINE node1 STABLE
ora.node2.vip
1 ONLINE ONLINE node2 STABLE
ora.ora19c.db
1 ONLINE INTERMEDIATE node1 Dismounted,Mount Ini
tiated,HOME=/u01/app
/oracle/product/19.0
.0.0/dbhome_2,STABLE
ora.oradb.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oracle/prod
uct/19.0.0.0/dbhome_
1,STABLE
2 ONLINE OFFLINE node2 STARTING
ora.oraprod.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oraprod/pro
duct/12.2.0.1/dbhome
_1,STABLE
2 ONLINE OFFLINE node2 STARTING
ora.primdb.db
1 ONLINE OFFLINE STABLE
2 ONLINE OFFLINE Stuck Archiver,Mount
ed (Closed),Open Ini
tiated,HOME=/u01/app
/oracle/product/19.0
.0.0/dbhome_1,STABLE
ora.qosmserver
1 ONLINE ONLINE node1 STABLE
ora.rac12c.db
1 ONLINE ONLINE node1 Open,HOME=/u01/app/o
racle/product/12.2.0
.1/dbhome_1,STABLE
2 ONLINE OFFLINE node2 STARTING
ora.rac12c.rac12c_srv.svc
1 ONLINE ONLINE node1 STABLE
2 ONLINE OFFLINE STABLE
ora.rac1n.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oracle/prod
uct/12.2.0.1/dbhome_
1,STABLE
ora.rac1n.racnode.svc
2 ONLINE ONLINE node1 STABLE
ora.rhpserver
1 OFFLINE OFFLINE STABLE
ora.scan1.vip
1 ONLINE ONLINE node1 STABLE
ora.scan2.vip
1 ONLINE ONLINE node2 STABLE
ora.scan3.vip
1 ONLINE ONLINE node2 STABLE
ora.single.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oraprod/pro
duct/12.2.0.1/dbhome
_1,STABLE
--------------------------------------------------------------------------------
[oracle@node2 ~]$
[oracle@node2 ~]$
[oracle@node2 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ora.LISTENER_PRIMDB.lsnr
ONLINE ONLINE node1 STABLE
ONLINE OFFLINE node2 STABLE
ora.LISTENER_RAC12C.lsnr
ONLINE ONLINE node1 STABLE
ONLINE OFFLINE node2 STABLE
ora.chad
ONLINE ONLINE node1 CHECK TIMED OUT,STAB
LE
ONLINE ONLINE node2 STABLE
ora.helper
OFFLINE OFFLINE node1 STABLE
OFFLINE OFFLINE node2 IDLE,STABLE
ora.net1.network
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ora.ons
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE node2 STABLE
2 ONLINE ONLINE node1 STABLE
3 ONLINE OFFLINE STABLE
ora.DATA.dg(ora.asmgroup)
1 ONLINE ONLINE node2 STABLE
2 ONLINE ONLINE node1 STABLE
3 OFFLINE OFFLINE STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE node1 STABLE
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE node2 STABLE
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE node2 STABLE
ora.MGMTLSNR
1 ONLINE ONLINE node1 169.254.30.254 10.38
.9.111,STABLE
ora.RECO.dg(ora.asmgroup)
1 ONLINE ONLINE node2 STABLE
2 ONLINE ONLINE node1 STABLE
3 OFFLINE OFFLINE STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE node2 Started,STABLE
2 ONLINE ONLINE node1 Started,STABLE
3 ONLINE OFFLINE STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE node2 STABLE
2 ONLINE ONLINE node1 STABLE
3 ONLINE OFFLINE STABLE
ora.cdbdb.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oracle/prod
uct/12.2.0.1/dbhome_
1,STABLE
2 ONLINE OFFLINE node2 STARTING
ora.cvu
1 ONLINE ONLINE node1 STABLE
ora.gridtgt.db
1 OFFLINE OFFLINE STABLE
2 ONLINE OFFLINE Instance Shutdown,ST
ABLE
ora.mgmtdb
1 ONLINE ONLINE node1 Open,STABLE
ora.node1.vip
1 ONLINE ONLINE node1 STABLE
ora.node2.vip
1 ONLINE ONLINE node2 STABLE
ora.ora19c.db
1 ONLINE INTERMEDIATE node1 Dismounted,Mount Ini
tiated,HOME=/u01/app
/oracle/product/19.0
.0.0/dbhome_2,STABLE
ora.oradb.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oracle/prod
uct/19.0.0.0/dbhome_
1,STABLE
2 ONLINE OFFLINE node2 STARTING
ora.oraprod.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oraprod/pro
duct/12.2.0.1/dbhome
_1,STABLE
2 ONLINE OFFLINE node2 STARTING
ora.primdb.db
1 ONLINE OFFLINE STABLE
2 ONLINE OFFLINE Stuck Archiver,Mount
ed (Closed),Open Ini
tiated,HOME=/u01/app
/oracle/product/19.0
.0.0/dbhome_1,STABLE
ora.qosmserver
1 ONLINE ONLINE node1 STABLE
ora.rac12c.db
1 ONLINE ONLINE node1 Open,HOME=/u01/app/o
racle/product/12.2.0
.1/dbhome_1,STABLE
2 ONLINE OFFLINE node2 STARTING
ora.rac12c.rac12c_srv.svc
1 ONLINE ONLINE node1 STABLE
2 ONLINE OFFLINE STABLE
ora.rac1n.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oracle/prod
uct/12.2.0.1/dbhome_
1,STABLE
ora.rac1n.racnode.svc
2 ONLINE ONLINE node1 STABLE
ora.rhpserver
1 OFFLINE OFFLINE STABLE
ora.scan1.vip
1 ONLINE ONLINE node1 STABLE
ora.scan2.vip
1 ONLINE ONLINE node2 STABLE
ora.scan3.vip
1 ONLINE ONLINE node2 STABLE
ora.single.db
1 ONLINE INTERMEDIATE node1 Stuck Archiver,HOME=
/u01/app/oraprod/pro
duct/12.2.0.1/dbhome
_1,STABLE
--------------------------------------------------------------------------------
[oracle@node2 ~]$ df -h /
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/ol_node2-root 133G 85G 49G 64% /
[oracle@node2 ~]$ ps -ef|grep smon
root 14485 1 1 20:37 ? 00:00:06 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 14991 1 0 20:38 ? 00:00:00 asm_smon_+ASM2
oracle 18113 1 0 20:45 ? 00:00:00 mdb_smon_-MGMTDB
oracle 20815 1 0 20:47 ? 00:00:00 ora_smon_CDBDB2
oracle 20821 1 0 20:47 ? 00:00:00 ora_smon_RAC12C2
oraprod 21002 1 0 20:47 ? 00:00:00 ora_smon_ORAPROD2
oracle 21111 1 0 20:47 ? 00:00:00 ora_smon_ORADB2
oracle 21122 1 0 20:47 ? 00:00:00 ora_smon_PRIMDB2
oracle 21399 14819 0 20:47 pts/0 00:00:00 grep --color=auto smon
[oracle@node2 ~]$ . oraenv
ORACLE_SID = [+ASM2] ? ORADB2
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@node2 ~]$
[oracle@node2 ~]$
[oracle@node2 ~]$ srvctl status database -d ORADB
Instance ORADB1 is not running on node node1
Instance ORADB2 is not running on node node2
[oracle@node2 ~]$ srvctl config database -d ORADB
Database unique name: ORADB
Database name: ORADB
Oracle home: /u01/app/oracle/product/19.0.0.0/dbhome_1
Oracle user: oracle
Spfile: +DATA/ORADB/PARAMETERFILE/spfile.331.1100127329
Password file: +DATA/ORADB/PASSWORD/pwdoradb.321.1100126845
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools:
Disk Groups: RECO,DATA
Mount point paths:
Services:
Type: RAC
Start concurrency:
Stop concurrency:
OSDBA group: oinstall
OSOPER group: oinstall
Database instances: ORADB1,ORADB2
Configured nodes: node1,node2
CSS critical: no
CPU count: 0
Memory target: 0
Maximum memory: 0
Default network number for database services:
Database is administrator managed
[oracle@node2 ~]$ ps -ef|grep smon
root 14485 1 1 20:37 ? 00:00:08 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 14991 1 0 20:38 ? 00:00:00 asm_smon_+ASM2
oracle 18113 1 0 20:45 ? 00:00:00 mdb_smon_-MGMTDB
oracle 23474 14819 0 20:50 pts/0 00:00:00 grep --color=auto smon
[oracle@node2 ~]$ . oraenv
ORACLE_SID = [ORADB2] ? RAC1N_2
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@node2 ~]$
[oracle@node2 ~]$
[oracle@node2 ~]$ srvclt start database -d RAC1N
bash: srvclt: command not found...
[oracle@node2 ~]$ srvctl start database -d RAC1N
PRCR-1079 : Failed to start resource ora.rac1n.db
CRS-5017: The resource action "ora.rac1n.db start" encountered the following error:
ORA-03113: end-of-file on communication channel
Process ID: 9689
Session ID: 128 Serial number: 20401
. For details refer to "(:CLSN00107:)" in
"/u01/app/oracle/diag/crs/node1/crs/trace/crsd_oraagent_oracle.trc".

CRS-2674: Start of 'ora.rac1n.db' on 'node1' failed

CRS-2674: Start of 'ora.LISTENER_PRIMDB.lsnr' on 'node2' failed
CRS-2674: Start of 'ora.LISTENER_RAC12C.lsnr' on 'node2' failed
CRS-5017: The resource action "ora.rac1n.db start" encountered the following error:
ORA-03113: end-of-file on communication channel
Process ID: 23895
Session ID: 128 Serial number: 54185
. For details refer to "(:CLSN00107:)" in
"/u01/app/oracle/diag/crs/node2/crs/trace/crsd_oraagent_oracle.trc".

CRS-2674: Start of 'ora.rac1n.db' on 'node2' failed

CRS-2632: There are no more servers to try to place resource 'ora.rac1n.db' on that would
satisfy its placement policy
[oracle@node2 ~]$ ps -ef|grep smon
root 14485 1 1 20:37 ? 00:00:09 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 14991 1 0 20:38 ? 00:00:00 asm_smon_+ASM2
oracle 18113 1 0 20:45 ? 00:00:00 mdb_smon_-MGMTDB
oracle 24076 14819 0 20:52 pts/0 00:00:00 grep --color=auto smon
[oracle@node2 ~]$ ps -ef|grep smon
root 14485 1 1 20:37 ? 00:00:13 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 14991 1 0 20:38 ? 00:00:00 asm_smon_+ASM2
oracle 18113 1 0 20:45 ? 00:00:00 mdb_smon_-MGMTDB
oracle 24971 14819 0 20:58 pts/0 00:00:00 grep --color=auto smon
[oracle@node2 ~]$
[oracle@node2 ~]$
[oracle@node2 ~]$ env |grep ORA
ORACLE_SID=RAC1N_2
ORACLE_BASE=/u01/app/oracle
ORACLE_HOME=/u01/app/oracle/product/12.2.0.1/dbhome_1
[oracle@node2 ~]$ srvctl start database -d RAC1N
[oracle@node2 ~]$ srvctl status database -d RAC1N
Instance RAC1N_2 is running on node node1
Online relocation: INACTIVE
[oracle@node2 ~]$ ps -ef|grep smon
root 14485 1 1 20:37 ? 00:00:16 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 14991 1 0 20:38 ? 00:00:00 asm_smon_+ASM2
oracle 18113 1 0 20:45 ? 00:00:00 mdb_smon_-MGMTDB
oracle 26011 14819 0 21:04 pts/0 00:00:00 grep --color=auto smon
[oracle@node2 ~]$ srvctl config database -d RAC1N
Database unique name: RAC1N
Database name: RAC1N
Oracle home: /u01/app/oracle/product/12.2.0.1/dbhome_1
Oracle user: oracle
Spfile: +DATA/RAC1N/PARAMETERFILE/spfile.318.1067549521
Password file: +DATA/RAC1N/PASSWORD/pwdrac1n.286.1067549269
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools:
Disk Groups: RECO,DATA
Mount point paths:
Services: RACNODE
Type: RACOneNode
Online relocation timeout: 30
Instance name prefix: RAC1N
Candidate servers: node1,node2
OSDBA group: oinstall
OSOPER group: oinstall
Database instances: RAC1N_2
CSS critical: no
CPU count: 0
Memory target: 0
Maximum memory: 0
Default network number for database services:
Database is administrator managed
[oracle@node2 ~]$ ps -ef|grep smon
root 14485 1 1 20:37 ? 00:00:20 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 14991 1 0 20:38 ? 00:00:00 asm_smon_+ASM2
oracle 18113 1 0 20:45 ? 00:00:00 mdb_smon_-MGMTDB
oracle 27140 14819 0 21:11 pts/0 00:00:00 grep --color=auto smon
[oracle@node2 ~]$ . oraenv
ORACLE_SID = [RAC1N_2] ? +ASM1
ORACLE_HOME = [/home/oracle] ? /u01/app/19.0.0.0/grid
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@node2 ~]$ sqlplus / as sysasm

SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 19 21:11:30 2023

Version 19.11.0.0.0

Connected to an idle instance.

SQL> exit
Disconnected
[oracle@node2 ~]$ asmcmd -p
ASMCMD [+] > lsdg
State Type Rebal Sector Logical_Sector Block AU Total_MB Free_MB
Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name
MOUNTED EXTERN N 512 512 4096 4194304 81904 17076 0
17076 0 Y DATA/
MOUNTED EXTERN N 512 512 4096 4194304 40952 32376 0
32376 0 N RECO/
ASMCMD [+] > exit
[oracle@node2 ~]$ sqlplus / as sysasm

SQL*Plus: Release 19.0.0.0.0 - Production on Thu Jan 19 21:11:59 2023

Version 19.11.0.0.0

Connected to an idle instance.

SQL> startup;
ORA-39511: Start of CRS resource for instance '223' failed with error:[CRS-5702: Resource
'ora.asm' is already running on 'node2'
CRS-0223: Resource 'ora.asm' has placement error.
clsr_start_resource:260 status:223
clsrapi_start_asm:start_asmdbs status:223
]
SQL> exit
Disconnected
[oracle@node2 ~]$
[oracle@node2 ~]$
[oracle@node2 ~]$ ps -ef|grep smon
root 14485 1 1 20:37 ? 00:00:21 /u01/app/19.0.0.0/grid/bin/osysmond.bin
oracle 14991 1 0 20:38 ? 00:00:00 asm_smon_+ASM2
oracle 18113 1 0 20:45 ? 00:00:00 mdb_smon_-MGMTDB
oracle 27375 14819 0 21:12 pts/0 00:00:00 grep --color=auto smon
[oracle@node2 ~]$ env |grep ORA
ORACLE_SID=+ASM1
ORACLE_BASE=/u01/app/oracle
ORACLE_HOME=/u01/app/19.0.0.0/grid
[oracle@node2 ~]$
Network error: Software caused connection abort

────────────────────────────────────────────────────────────
────────────────────────────────────────────────────────────
───────────────────────────────────

Session stopped
- Press <return> to exit tab
- Press R to restart session
- Press S to save terminal output to file
login as: root
[email protected]'s password:

Last login: Thu Jan 19 20:27:46 2023 from 172.29.48.23

[root@node2 ~]# cd /u01/app/oracle/diag
diag/ diagsnap/
[root@node2 ~]# cd /u01/app/oracle/diag/rdbms/
cdbdb/ dummydb/ gridtgt/ _mgmtdb/ oradb/ primdb/ prodcdb/ rac12c/ rac1n/
[root@node2 ~]# cd /u01/app/oracle/diag/rdbms/rac1n/RAC1N_2/trace/
[root@node2 trace]# tail -f alert_RAC1N_2.log
ORA-00312: online log 3 thread 2: '+DATA/RAC1N/ONLINELOG/group_3.316.1067549517'
ORA-00312: online log 3 thread 2: '+RECO/RAC1N/ONLINELOG/group_3.263.1067549519'
USER (ospid: 23895): terminating the instance due to error 16038
2023-01-19T20:52:01.020611+05:30
System state dump requested by (instance=2, osid=23895), summary=[abnormal instance
termination].
System State dumped to trace file
/u01/app/oracle/diag/rdbms/rac1n/RAC1N_2/trace/RAC1N_2_diag_23745_20230119205201.trc
2023-01-19T20:52:01.230991+05:30
Dumping diagnostic data in directory=[cdmp_20230119205201], requested by (instance=2,
osid=23895), summary=[abnormal instance termination].
2023-01-19T20:52:02.347079+05:30
Instance terminated by USER, pid = 23895
login as: root
[email protected]'s password:

Last login: Thu Jan 19 20:46:02 2023 from 172.29.48.23

[root@node1 ~]# cd /u01/app/oracle/diag/rdbms/rac1n/RAC1N_1/trace/
[root@node1 trace]# tail -f alert_RAC1N_1.log
2023-01-19T20:53:36.376250+05:30
ARC2 started with pid=68, OS id=10171
Starting background process ARC3
2023-01-19T20:53:36.410578+05:30
ARC3 started with pid=69, OS id=10176
2023-01-19T20:53:36.410886+05:30
ARC1: Archival started
ARC2: Archival started
ARC3: Archival started
ARCH: STARTING ARCH PROCESSES COMPLETE
2023-01-19T20:54:28.194889+05:30
Decreasing number of high priority LMS from 2 to 0
2023-01-19T20:59:49.920821+05:30
Shutting down instance (immediate) (OS id: 14766)
2023-01-19T20:59:52.183383+05:30
Stopping background process SMCO
2023-01-19T20:59:53.230252+05:30
Shutting down instance: further logons disabled
Stopping background process MMNL
2023-01-19T20:59:54.294677+05:30
Stopping background process MMON
2023-01-19T20:59:56.343343+05:30
License high water mark = 3
2023-01-19T20:59:56.375530+05:30
Dispatchers and shared servers shutdown
ALTER DATABASE CLOSE NORMAL
Stopping Emon pool
ORA-1109 signalled during: ALTER DATABASE CLOSE NORMAL...
ALTER DATABASE DISMOUNT
Shutting down archive processes
2023-01-19T20:59:56.380337+05:30
TT00: Gap Manager exiting (PID:10157)
2023-01-19T20:59:57.380690+05:30
Archiving is disabled
2023-01-19T20:59:57.381531+05:30
ARC3: ARCH shutting down
ARC3: Archival stopped
2023-01-19T20:59:57.381980+05:30
ARC0: ARCH shutting down
ARC0: Archival stopped
2023-01-19T20:59:57.382585+05:30
ARC2: ARCH shutting down
2023-01-19T20:59:57.382634+05:30
ARC2: Archival stopped
2023-01-19T20:59:57.382674+05:30
ARC1: ARCH shutting down
2023-01-19T20:59:57.382720+05:30
ARC1: Archival stopped
2023-01-19T20:59:58.390235+05:30
NOTE: Deferred communication with ASM instance
NOTE: deferred map free for map id 2
2023-01-19T20:59:58.433480+05:30
Completed: ALTER DATABASE DISMOUNT
2023-01-19T20:59:58.438120+05:30
ARCH: Archival disabled due to shutdown: 1089
Shutting down archive processes
Archiving is disabled
2023-01-19T20:59:59.350801+05:30
NOTE: Deferred communication with ASM instance
2023-01-19T20:59:59.444947+05:30
JIT: pid 14766 requesting stop
2023-01-19T20:59:59.466766+05:30
NOTE: force a map free for map id 2
2023-01-19T21:00:00.502700+05:30
Stopping background process VKTM
2023-01-19T21:00:00.516939+05:30
ARCH: Archival disabled due to shutdown: 1089
Shutting down archive processes
Archiving is disabled
JIT: pid 14766 requesting stop
2023-01-19T21:00:00.537273+05:30
NOTE: Shutting down MARK background process
2023-01-19T21:00:07.554066+05:30
NOTE: ASMB releasing group resources due to shutdown
NOTE: ASMB0 clearing idle groups before exit
Stopping background process RBAL
2023-01-19T21:00:08.971266+05:30
freeing rdom 0
2023-01-19T21:00:13.188090+05:30
Instance shutdown complete (OS id: 14766)
2023-01-19T21:00:19.450735+05:30
Starting ORACLE instance (normal) (OS id: 14968)
2023-01-19T21:00:19.454226+05:30
CLI notifier numLatches:7 maxDescs:554
2023-01-19T21:00:19.455936+05:30
**********************************************************************
2023-01-19T21:00:19.455991+05:30
Dump of system resources acquired for SHARED GLOBAL AREA (SGA)

2023-01-19T21:00:19.456078+05:30
Per process system memlock (soft) limit = 128G
2023-01-19T21:00:19.456123+05:30
Expected per process system memlock (soft) limit to lock
SHARED GLOBAL AREA (SGA) into memory: 2930M
2023-01-19T21:00:19.456208+05:30
Available system pagesizes:
4K, 2048K
2023-01-19T21:00:19.456290+05:30
Supported system pagesize(s):
2023-01-19T21:00:19.456345+05:30
PAGESIZE AVAILABLE_PAGES EXPECTED_PAGES ALLOCATED_PAGES ERROR(s)
2023-01-19T21:00:19.456392+05:30
4K Configured 4 749572 NONE
2023-01-19T21:00:19.456493+05:30
2048K 0 1465 0 NONE
2023-01-19T21:00:19.456539+05:30
RECOMMENDATION:
2023-01-19T21:00:19.456587+05:30
1. For optimal performance, configure system with expected number
of pages for every supported system pagesize prior to the next
instance restart operation.
2023-01-19T21:00:19.460287+05:30
**********************************************************************
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Initial number of CPU is 4
Number of processor cores in the system is 4
Number of processor sockets in the system is 4
Exafusion(Msgq-Auto) enabled
Using LOG_ARCHIVE_DEST_1 parameter default value as
USE_DB_RECOVERY_FILE_DEST
Autotune of undo retention is turned on.
LICENSE_MAX_USERS = 0
SYS auditing is enabled
NOTE: remote asm mode is remote (mode 0x2; from cluster type)
NOTE: Cluster configuration type = CLUSTER [4]
Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production.
ORACLE_HOME: /u01/app/oracle/product/12.2.0.1/dbhome_1
System name: Linux
Node name: node1.localdomain.com
Release: 4.14.35-2047.500.10.el7uek.x86_64
Version: #2 SMP Wed Feb 17 19:26:51 PST 2021
Machine: x86_64
Using parameter settings in server-side spfile
+DATA/RAC1N/PARAMETERFILE/spfile.318.1067549521
System parameters with non-default values:
processes = 320
nls_language = "AMERICAN"
nls_territory = "AMERICA"
resource_manager_plan = ""
sga_target = 2928M
control_files = "+DATA/RAC1N/CONTROLFILE/current.311.1067549413"
control_files = "+RECO/RAC1N/CONTROLFILE/current.272.1067549413"
db_block_size = 8192
compatible = "12.2.0"
log_archive_format = "%t_%s_%r.dbf"
cluster_database = TRUE
db_create_file_dest = "+DATA"
db_recovery_file_dest = "+RECO"
db_recovery_file_dest_size= 8016M
remote_login_passwordfile= "EXCLUSIVE"
dispatchers = "(PROTOCOL=TCP) (SERVICE=RAC1NXDB)"
local_listener = "-oraagent-dummy-"
audit_file_dest = "/u01/app/oracle/admin/RAC1N/adump"
audit_trail = "DB"
db_name = "RAC1N"
open_cursors = 300
pga_aggregate_target = 973M
diagnostic_dest = "/u01/app/oracle"
NOTE: remote asm mode is remote (mode 0x2; from cluster type)
2023-01-19T21:00:22.899917+05:30
Cluster Communication is configured to use IPs from: GPnP
IP: 169.254.30.254 Subnet: 169.254.0.0
KSIPC Loopback IP addresses(DEF):
127.0.0.1
KSIPC Available Transports: UDP:TCP:RDSTCP
KSIPC: Client: KCL Transport: UDP
KSIPC: Client: DLM Transport: UDP
KSIPC CAPABILITIES :IPCLW:GRPAM:TOPO:DLL
KSXP: ksxpsg_ipclwtrans: 2 UDP
cluster interconnect IPC version: [IPCLW over UDP(mode 3) ]
IPC Vendor 1 proto 2
Oracle instance running with ODM: Oracle Direct NFS ODM Library Version 4.0
============================================================
NOTE: PatchLevel of this instance 0
============================================================
Starting background process PMON
2023-01-19T21:00:22.930395+05:30
PMON started with pid=2, OS id=14990
Starting background process CLMN
2023-01-19T21:00:22.945454+05:30
CLMN started with pid=3, OS id=14992
Starting background process PSP0
2023-01-19T21:00:22.963786+05:30
PSP0 started with pid=4, OS id=14994
Starting background process IPC0
2023-01-19T21:00:24.030167+05:30
IPC0 started with pid=5, OS id=15005
2023-01-19T21:00:24.030418+05:30
Starting background process VKTM
Starting background process GEN0
2023-01-19T21:00:24.049625+05:30
VKTM started with pid=6, OS id=15007 at elevated (RT) priority
2023-01-19T21:00:24.050822+05:30
VKTM running at (1)millisec precision with DBRM quantum (100)ms
2023-01-19T21:00:24.063296+05:30
GEN0 started with pid=7, OS id=15011
Starting background process MMAN
2023-01-19T21:00:24.076810+05:30
MMAN started with pid=8, OS id=15013
Starting background process GEN1
2023-01-19T21:00:24.130846+05:30
GEN1 started with pid=10, OS id=15017_15019
Starting background process DIAG
2023-01-19T21:00:24.145667+05:30
DIAG started with pid=12, OS id=15021
Starting background process OFSD
2023-01-19T21:00:24.173786+05:30
OFSD started with pid=13, OS id=15023_15025
Starting background process DBRM
2023-01-19T21:00:24.174559+05:30
Oracle running with ofslib:'Oracle File Server Library' version=2
2023-01-19T21:00:24.188744+05:30
DBRM started with pid=15, OS id=15027
Starting background process VKRM
2023-01-19T21:00:24.202068+05:30
VKRM started with pid=16, OS id=15029
Starting background process PING
2023-01-19T21:00:24.214105+05:30
PING started with pid=17, OS id=15031
Starting background process SVCB
2023-01-19T21:00:24.226379+05:30
SVCB started with pid=18, OS id=15033
Starting background process ACMS
2023-01-19T21:00:24.238458+05:30
ACMS started with pid=19, OS id=15035
Starting background process PMAN
2023-01-19T21:00:24.250247+05:30
PMAN started with pid=20, OS id=15037
Starting background process DIA0
2023-01-19T21:00:24.261554+05:30
DIA0 started with pid=21, OS id=15039
Starting background process LMON
2023-01-19T21:00:24.273672+05:30
LMON started with pid=22, OS id=15041
Starting background process LMD0
2023-01-19T21:00:24.295027+05:30
LMS1 started with pid=25, OS id=15047 at elevated (RT) priority
2023-01-19T21:00:24.296617+05:30
LMS0 started with pid=24, OS id=15045 at elevated (RT) priority
2023-01-19T21:00:24.315326+05:30
LMD0 started with pid=23, OS id=15043
2023-01-19T21:00:24.316304+05:30
* Load Monitor used for high load check
* New Low - High Load Threshold Range = [3840 - 5120]
Starting background process LMD1
2023-01-19T21:00:24.329841+05:30
LMD1 started with pid=26, OS id=15053
Starting background process RMS0
2023-01-19T21:00:24.349321+05:30
RMS0 started with pid=27, OS id=15055
Starting background process LMHB
2023-01-19T21:00:24.361694+05:30
LMHB started with pid=28, OS id=15057
Starting background process LCK1
2023-01-19T21:00:24.383247+05:30
LCK1 started with pid=30, OS id=15061
Starting background process DBW0
2023-01-19T21:00:24.399753+05:30
DBW0 started with pid=32, OS id=15065
Starting background process LGWR
2023-01-19T21:00:24.418799+05:30
LGWR started with pid=33, OS id=15067
Starting background process CKPT
2023-01-19T21:00:24.430772+05:30
CKPT started with pid=34, OS id=15069
2023-01-19T21:00:24.442953+05:30
LGWR slave LG00 created with pid=35, OS pid=15071
Starting background process SMON
2023-01-19T21:00:24.454267+05:30
SMON started with pid=36, OS id=15073
LGWR slave LG01 created with pid=37, OS pid=15075
Starting background process SMCO
Starting background process RECO
2023-01-19T21:00:24.480354+05:30
SMCO started with pid=38, OS id=15077
2023-01-19T21:00:24.492661+05:30
RECO started with pid=39, OS id=15079
Starting background process LREG
2023-01-19T21:00:24.521967+05:30
LREG started with pid=41, OS id=15083
Starting background process PXMN
2023-01-19T21:00:24.551126+05:30
PXMN started with pid=43, OS id=15087
Starting background process RBAL
2023-01-19T21:00:24.563521+05:30
RBAL started with pid=44, OS id=15089
Starting background process ASMB
2023-01-19T21:00:24.574774+05:30
ASMB started with pid=45, OS id=15091
Starting background process FENC
2023-01-19T21:00:24.586127+05:30
FENC started with pid=46, OS id=15093
Starting background process MMON
2023-01-19T21:00:24.598113+05:30
MMON started with pid=47, OS id=15095
Starting background process MMNL
2023-01-19T21:00:24.609152+05:30
MMNL started with pid=48, OS id=15097
2023-01-19T21:00:24.609175+05:30
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)
(PROTOCOL=TCP))'...
starting up 1 shared server(s) ...
2023-01-19T21:00:24.731266+05:30
lmon registered with NM - instance number 1 (internal mem no 0)
2023-01-19T21:00:24.948815+05:30
* Load Monitor used for high load check
* New Low - High Load Threshold Range = [3840 - 5120]
2023-01-19T21:00:24.953215+05:30
* allocate domain 0, valid ? 0
Attached to domain 0 (addr: 0x81c37f90)
2023-01-19T21:00:24.955619+05:30
Reconfiguration started (old inc 0, new inc 2)
List of instances (total 1) :
1
My inst 1 (I'm a new instance)
Global Resource Directory frozen
Communication channels reestablished
Master broadcasted resource hash value bitmaps
Non-local Process blocks cleaned out
2023-01-19T21:00:25.069024+05:30
LMS 1: 0 GCS shadows cancelled, 0 closed, 0 Xw survived, skipped 0
2023-01-19T21:00:25.070212+05:30
LMS 0: 0 GCS shadows cancelled, 0 closed, 0 Xw survived, skipped 0
Set master node info
Submitted all remote-enqueue requests
Dwn-cvts replayed, VALBLKs dubious
All grantable enqueues granted
2023-01-19T21:00:25.092934+05:30
Post SMON to start 1st pass IR
Submitted all GCS remote-cache requests
Fix write in gcs resources
2023-01-19T21:00:25.111367+05:30
Reconfiguration complete (total time 0.2 secs)
2023-01-19T21:00:25.111752+05:30
Starting background process LCK0
2023-01-19T21:00:25.127848+05:30
LCK0 started with pid=53, OS id=15107
2023-01-19T21:00:25.147418+05:30
NOTE: ASMB0 registering with ASM instance as Flex client 0xffffffffffffffff (reg:1371758088)
(new connection)
NOTE: ASMB0 (15091) connected to ASM instance +ASM1, osid: 15109 (Flex mode; client id
0x10016)
NOTE: initiating MARK startup
Starting background process MARK
2023-01-19T21:00:25.194430+05:30
MARK started with pid=54, OS id=15111
2023-01-19T21:00:25.263858+05:30
NOTE: MARK has subscribed
Starting background process RSMN
2023-01-19T21:00:25.426417+05:30
RSMN started with pid=56, OS id=15122
Starting background process TMON
2023-01-19T21:00:25.459676+05:30
TMON started with pid=57, OS id=15127
ORACLE_BASE from environment = /u01/app/oracle
2023-01-19T21:00:25.788239+05:30
ALTER DATABASE MOUNT
2023-01-19T21:00:25.788731+05:30
This instance was first to mount
2023-01-19T21:00:25.905437+05:30
ALTER SYSTEM SET local_listener=' (ADDRESS=(PROTOCOL=TCP)(HOST=10.38.4.135)
(PORT=1521))' SCOPE=MEMORY SID='RAC1N_1';
2023-01-19T21:00:26.009790+05:30
ALTER SYSTEM SET remote_listener=' nodescan:1521' SCOPE=MEMORY SID='RAC1N_1';
2023-01-19T21:00:26.010814+05:30
ALTER SYSTEM SET listener_networks='' SCOPE=MEMORY SID='RAC1N_1';
2023-01-19T21:00:27.192487+05:30
Using default pga_aggregate_limit of 2048 MB
2023-01-19T21:00:28.418369+05:30
NOTE: ASMB mounting group 1 (DATA)
NOTE: ASM background process initiating disk discovery for grp 1 (reqid:0)
NOTE: Assigning number (1,3) to disk (/dev/oracleasm/disks/DATA4)
NOTE: Assigning number (1,1) to disk (/dev/oracleasm/disks/DATA3)
NOTE: Assigning number (1,2) to disk (/dev/oracleasm/disks/DATA2)
NOTE: Assigning number (1,0) to disk (/dev/oracleasm/disks/DATA1)
SUCCESS: mounted group 1 (DATA)
NOTE: grp 1 disk 3: DATA_0003 path:/dev/oracleasm/disks/DATA4
NOTE: grp 1 disk 1: DATA_0001 path:/dev/oracleasm/disks/DATA3
NOTE: grp 1 disk 2: DATA_0002 path:/dev/oracleasm/disks/DATA2
NOTE: grp 1 disk 0: DATA_0000 path:/dev/oracleasm/disks/DATA1
NOTE: ASMB mounting group 2 (RECO)
NOTE: ASM background process initiating disk discovery for grp 2 (reqid:0)
2023-01-19T21:00:28.529547+05:30
NOTE: dependency between database RAC1N and diskgroup resource ora.DATA.dg is
established
2023-01-19T21:00:28.555110+05:30
NOTE: Assigning number (2,1) to disk (/dev/oracleasm/disks/RECO2)
NOTE: Assigning number (2,0) to disk (/dev/oracleasm/disks/RECO1)
SUCCESS: mounted group 2 (RECO)
NOTE: grp 2 disk 1: RECO_0001 path:/dev/oracleasm/disks/RECO2
NOTE: grp 2 disk 0: RECO_0000 path:/dev/oracleasm/disks/RECO1
2023-01-19T21:00:28.579797+05:30
NOTE: dependency between database RAC1N and diskgroup resource ora.RECO.dg is
established
2023-01-19T21:00:29.422469+05:30
KSXPPING: KSXP selected for Ping
2023-01-19T21:00:33.024119+05:30
Network throttle feature is disabled as mount time

2023-01-19T21:00:33.085274+05:30
Successful mount of redo thread 1, with mount id 2806293097
2023-01-19T21:00:33.193776+05:30
Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
Lost write protection disabled
Using STANDBY_ARCHIVE_DEST parameter default value as
USE_DB_RECOVERY_FILE_DEST
Completed: ALTER DATABASE MOUNT
2023-01-19T21:00:33.649516+05:30
ALTER DATABASE OPEN
2023-01-19T21:00:33.658350+05:30
This instance was first to open
Ping without log force is disabled:
not an Exadata system.
Picked broadcast on commit scheme to generate SCNs
Endian type of dictionary set to little
2023-01-19T21:00:35.464106+05:30
Archived Log entry 15971 added for T-2.S-14317 ID 0xa3bfd5e1 LAD:1
ARCH: STARTING ARCH PROCESSES
Starting background process ARC0
2023-01-19T21:00:35.510746+05:30
ARC0 started with pid=9, OS id=15194
ARC0: Archival started
ARCH: STARTING ARCH PROCESSES COMPLETE
2023-01-19T21:00:35.521034+05:30
ARC0: Becoming a 'no FAL' ARCH
ARC0: Becoming the 'no SRL' ARCH
2023-01-19T21:00:35.521327+05:30
Thread 2 advanced to log sequence 14319 (before internal thread enable)
2023-01-19T21:00:35.523614+05:30
TT00: Gap Manager starting (PID:15196)
2023-01-19T21:00:35.536634+05:30
ARCH: STARTING ARCH PROCESSES
Starting background process ARC1
Starting background process ARC2
2023-01-19T21:00:35.550427+05:30
ARC1 started with pid=64, OS id=15200
2023-01-19T21:00:35.562720+05:30
ARC2 started with pid=65, OS id=15202
Starting background process ARC3
2023-01-19T21:00:35.578036+05:30
ARC3 started with pid=66, OS id=15204
ARC1: Archival started
ARC2: Archival started
ARC3: Archival started
ARCH: STARTING ARCH PROCESSES COMPLETE
2023-01-19T21:00:35.836167+05:30
Archived Log entry 15972 added for T-2.S-14318 ID 0xa3bfd5e1 LAD:1
2023-01-19T21:00:35.862204+05:30
Thread 2 advanced to log sequence 14320 (after internal thread enable)
2023-01-19T21:00:35.906515+05:30
Thread 1 opened at log sequence 1139
Current log# 1 seq# 1139 mem# 0: +DATA/RAC1N/ONLINELOG/group_1.312.1067549415
Current log# 1 seq# 1139 mem# 1: +RECO/RAC1N/ONLINELOG/group_1.267.1067549417
Successful open of redo thread 1
2023-01-19T21:00:35.907020+05:30
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
2023-01-19T21:00:35.939562+05:30
start recovery: pdb 0, passed in flags x10 (domain enable 0)
2023-01-19T21:00:35.939661+05:30
Instance recovery: looking for dead threads
Instance recovery: lock domain invalid but no dead threads
validate pdb 0, flags x10, valid 0, pdb flags x84
* validated domain 0, flags = 0x80
Instance recovery complete: valid 1 (flags x10, recovery domain flags x80)
2023-01-19T21:00:36.294507+05:30
[15181] Successfully onlined Undo Tablespace 2.
Undo initialization finished serial:0 start:927281 end:927479 diff:198 ms (0.2 seconds)
Verifying minimum file header compatibility for tablespace encryption..
Verifying file header compatibility for tablespace encryption completed for pdb 0
Database Characterset is AL32UTF8
No Resource Manager plan active
2023-01-19T21:00:36.952626+05:30
Starting background process GTX0
2023-01-19T21:00:36.965635+05:30
GTX0 started with pid=71, OS id=15222
Starting background process RCBG
2023-01-19T21:00:37.019410+05:30
RCBG started with pid=72, OS id=15225
replication_dependency_tracking turned off (no async multimaster replication found)
Starting background process AQPC
2023-01-19T21:00:37.262945+05:30
AQPC started with pid=73, OS id=15231
Starting background process CJQ0
2023-01-19T21:00:37.843242+05:30
CJQ0 started with pid=80, OS id=15249
Completed: ALTER DATABASE OPEN
2023-01-19T21:00:37.921514+05:30
Redo thread 2 internally disabled at seq 14320 (CKPT)
2023-01-19T21:00:38.073231+05:30
Archived Log entry 15973 added for T-2.S-14319 ID 0xa3bfd5e1 LAD:1
2023-01-19T21:00:38.257103+05:30
ARC3: Archiving disabled T-2.S-14320
2023-01-19T21:00:38.275907+05:30
Archived Log entry 15974 added for T-2.S-14320 ID 0xa3bfd5e1 LAD:1
2023-01-19T21:00:39.552787+05:30
Thread 1 advanced to log sequence 1140 (LGWR switch)
Current log# 2 seq# 1140 mem# 0: +DATA/RAC1N/ONLINELOG/group_2.313.1067549415
Current log# 2 seq# 1140 mem# 1: +RECO/RAC1N/ONLINELOG/group_2.271.1067549417
2023-01-19T21:00:39.962938+05:30
Archived Log entry 15975 added for T-1.S-1139 ID 0xa3bfd5e1 LAD:1
2023-01-19T21:00:43.831682+05:30
Shared IO Pool defaulting to 144MB. Trying to get it from Buffer Cache for process 15095.
===========================================================
Dumping current patch information
===========================================================
Patch Id: 32507738
Patch Description: Database Apr 2021 Release Update : 12.2.0.1.210420 (32507738)
Patch Apply Time: 2021-06-15T12:27:31+05:30
Bugs Fixed: 7391838,8480838,8932139,8975044,12763598,13554903,14221306,
14690846,15931756,16002385,16438495,16727454,16942578,17027695,17533661,
17947871,17958365,18308268,18521691,18594510,18774543,18878420,18986501,
19072655,19211433,19285025,19327292,19526548,19614243,19647894,19649997,
19702201,19721304,20003668,20087519,20118035,20120236,20324049,20436508,
20532077,20549013,20588486,20591151,20617383,20620169,20736227,20756305,
20866970,20917487,20976443,21070321,21089435,21095391,21143725,21147908,
21159907,21178363,21186167,21197098,21216226,21320338,21355390,21433452,
21479706,21517767,21520266,21547051,21638600,21744603,21788462,21837606,
21882528,21935698,21962287,21981529,21985256,22007324,22070226,22070473,
22070853,22072543,22087683,22104866,22107360,22174392,22179537,22282748,
22310426,22347493,22363790,22364044,22367053,22379010,22446455,22454940,
22468255,22495673,22503283,22503297,22504793,22522515,22530986,22564336,
22568728,22581771,22594071,22599050,22628825,22645009,22645496,22654475,
22700845,22726044,22729345,22820798,22826067,22843979,22845846,22864303,
22898198,22921674,22939829,22950945,22970869,22981722,23018676,23019710,
23026585,23035249,23055900,23056058,23061453,23065002,23066146,23080557,
23104033,23105538,23109325,23110523,23125560,23126545,23127945,23143074,
23151677,23168363,23169712,23177923,23179662,23184263,23197730,23234232,
23237091,23249829,23271203,23278750,23281269,23282973,23300142,23306590,
23308065,23310101,23312077,23328639,23333567,23336559,23342170,23481673,
23491861,23499004,23499160,23521523,23527363,23533647,23548817,23567857,
23572982,23581777,23588722,23599216,23600861,23602213,23627427,23645516,
23665623,23709062,23715460,23715518,23730961,23733981,23735292,23738304,
23741944,23743596,23746128,23749454,23761724,23763462,24006569,24010030,
24289874,24289895,24294174,24303148,24307571,24308349,24326444,24326846,
24328857,24330708,24332831,24334708,24336249,24337882,24341675,24343905,
24345420,24346821,24348685,24350620,24352981,24355111,24357348,24368004,
24371491,24373528,24373756,24374976,24376875,24376878,24383086,24385983,
24401351,24403922,24409977,24415926,24416451,24421668,24423416,24425056,
24425998,24432875,24435982,24437162,24440612,24440648,24443539,24445571,
24457597,24460392,24461826,24467122,24468470,24470606,24471079,24471473,
24473736,24480567,24484749,24485034,24485161,24485174,24485619,24486059,
24486237,24509056,24516314,24530364,24534401,24554533,24555417,24556862,
24556967,24560906,24563422,24570214,24570598,24573817,24578718,24578797,
24588377,24589081,24589590,24591506,24593740,24595699,24596874,24600330,
24609592,24609996,24611527,24616637,24617969,24623975,24624166,24642495,
24654629,24655717,24664211,24668398,24669189,24669730,24674197,24674955,
24676172,24677696,24680959,24687075,24689376,24692973,24693010,24693290,
24697323,24699619,24710696,24713381,24714096,24717183,24717859,24718260,
24719799,24735430,24737064,24737403,24737581,24737954,24739791,24744383,
24744686,24752618,24757934,24759556,24760407,24763196,24764085,24766309,
24784414,24786669,24791883,24792678,24793511,24796092,24797119,24798481,
24800423,24801152,24802934,24808504,24811725,24812047,24818566,24827228,
24827654,24831514,24835919,24841671,24843188,24844549,24844841,24845157,
24848746,24848923,24850622,24907917,24908063,24908321,24911709,24912588,
24920582,24921478,24922704,24923080,24923215,24923338,24923790,24924667,
24926999,24929210,24938784,24940060,24942749,24953434,24957555,24960044,
24960809,24965426,24966594,24966788,24967993,24968162,24976007,24978100,
25022574,25027852,25028996,25029022,25029423,25031502,25032818,25034396,
25036006,25036474,25042823,25044977,25045228,25050160,25051465,25051628,
25054064,25057811,25058080,25060506,25062592,25063971,25065563,25072986,
25077278,25078611,25086233,25087436,25091141,25092777,25093872,25095982,
25098160,25099339,25099497,25099758,25100063,25100579,25103996,25107662,
25110233,25114561,25115178,25120284,25120668,25120742,25121089,25123585,
25124363,25129925,25130312,25140197,25145163,25145215,25150925,25159176,
25162645,25164293,25166187,25171041,25171084,25175723,25176408,25178032,
25178101,25178179,25179774,25182817,25184453,25184555,25186079,25189723,
25191872,25192044,25192528,25192729,25195901,25199585,25200101,25201454,
25202355,25203656,25205368,25205954,25206864,25207410,25209912,25210268,
25210499,25210690,25211628,25219450,25223839,25224242,25225795,25226665,
25227381,25230870,25230945,25237577,25240188,25240590,25241448,25241625,
25244807,25248384,25250109,25251648,25257085,25259611,25262869,25263960,
25265499,25269133,25283790,25287072,25288078,25293659,25296876,25299227,
25299807,25300427,25303284,25303756,25305405,25307368,25309116,25313154,
25313411,25316758,25317989,25320555,25323525,25328093,25328518,25329664,
25335249,25335360,25335790,25337332,25337640,25348567,25348956,25353983,
25356118,25357142,25360661,25362958,25367588,25367721,25382812,25383204,
25384462,25386748,25388573,25388896,25392535,25393714,25395696,25397936,
25398306,25404117,25404202,25405100,25405687,25405813,25410017,25410180,
25410802,25410877,25411036,25415713,25416731,25417050,25417056,25417958,
25425005,25425451,25425760,25427662,25429959,25430120,25433696,25435038,
25437699,25440818,25442559,25444961,25445168,25451531,25452452,25455795,
25457409,25459958,25462714,25463844,25472112,25472885,25476125,25476149,
25477657,25478885,25479164,25481087,25482971,25486384,25489342,25489367,
25489607,25492379,25498930,25498994,25516250,25524955,25528838,25530080,
25530814,25535668,25536819,25537470,25539063,25540738,25546580,25546608,
25547901,25551676,25553616,25554787,25555252,25557886,25558986,25560487,
25560538,25561296,25569149,25569504,25570929,25573623,25575348,25575369,
25575628,25576115,25579458,25579761,25591394,25594901,25597525,25598473,
25599425,25600342,25600421,25601999,25602488,25603923,25606091,25607726,
25612095,25614866,25616268,25616359,25616417,25616645,25631933,25633101,
25634317,25634348,25635149,25638456,25639019,25643818,25643889,25643931,
25646373,25647325,25648731,25653109,25654459,25654936,25655390,25655966,
25659655,25660847,25661819,25662088,25662101,25662524,25663488,25667973,
25669791,25670786,25671354,25672640,25674386,25680221,25685152,25686739,
25687460,25691904,25694206,25695903,25696520,25699321,25700654,25709368,
25710420,25715167,25717371,25722055,25722608,25722720,25723097,25723158,
25728085,25729507,25730014,25734963,25736747,25739065,25740844,25741955,
25743479,25747569,25749273,25752755,25754606,25756945,25757697,25757748,
25760195,25762221,25764020,25766822,25768681,25772669,25774077,25775213,
25775444,25780343,25783447,25784002,25785331,25785441,25788879,25789041,
25789277,25789579,25790353,25792911,25795865,25797092,25797124,25797305,
25800464,25802510,25803364,25803545,25807997,25809524,25810263,25810704,
25811650,25812390,25813931,25818707,25822410,25823532,25823754,25824372,
25825910,25826740,25830492,25832935,25834581,25835365,25838361,25838755,
25852885,25856821,25858672,25861398,25865785,25866948,25870579,25871177,
25871639,25871753,25872127,25872389,25873336,25874050,25874678,25882264,
25883438,25885148,25888073,25888984,25890002,25890056,25890673,25890782,
25894239,25895224,25897615,25898228,25904273,25904490,25905130,25906117,
25906886,25908728,25911724,25914276,25919622,25932524,25932728,25933494,
25941836,25942868,25943271,25945130,25947799,25951571,25953857,25954022,
25954054,25957038,25963024,25964954,25967544,25967985,25970731,25971286,
25972417,25973152,25975723,25977302,25980605,25980770,25981498,25982666,
25986062,25990907,25995938,25997810,26006257,26007010,26019148,26024732,
26024784,26025681,26029075,26029777,26029780,26032573,26034119,26036748,
26037215,26038086,26039623,26040483,26045732,26051656,26078437,26078493,
26080410,26083298,26087754,26088426,26088836,26089669,26090767,26090893,
26091640,26091786,26095327,26095405,26096382,26108080,26108337,26110259,
26110632,26111842,26112621,26115103,26121990,26124078,26130486,26137367,
26137416,26138085,26145560,26149904,26153372,26153977,26168933,26169341,
26169345,26170659,26170715,26176002,26187943,26189861,26198757,26198926,
26201113,26203182,26223039,26237338,26237431,26237773,26238195,26242031,
26242677,26243698,26244115,26245237,26248143,26249718,26256131,26257953,
26259265,26261327,26263328,26263721,26268756,26269790,26271001,26274660,
26275023,26275415,26277439,26281476,26285062,26285933,26301540,26308650,
26309047,26317991,26318200,26318627,26323308,26324206,26324769,26325856,
26327418,26327624,26327775,26330994,26331743,26333141,26334602,26336977,
26338953,26351334,26351996,26353617,26354844,26356098,26358670,26359091,
26362155,26362821,26366517,26367012,26367460,26371725,26373967,26374791,
26375052,26375250,26375330,26380097,26385189,26386858,26388538,26396790,
26398675,26399626,26399691,26399839,26405036,26406387,26407408,26410240,
26412540,26418088,26420561,26421667,26422277,26423085,26426526,26426967,
26430323,26430737,26434436,26434999,26435073,26436168,26438612,26439748,
26440142,26440169,26440749,26441345,26442308,26444601,26444887,26446098,
26452606,26474662,26474703,26475419,26476090,26476244,26478970,26479173,
26482376,26486365,26492666,26492866,26493289,26498354,26513067,26513709,
26521043,26522439,26523432,26526726,26526799,26536320,26537307,26542135,
26542236,26542835,26544823,26545688,26546070,26546664,26546754,26548363,
26556014,26558437,26569225,26575788,26580633,26582460,26584641,26588069,
26597140,26599395,26608137,26608238,26609942,26615291,26615690,26617804,
26623652,26626879,26629381,26633355,26633558,26635897,26637273,26637824,
26639167,26641610,26641852,26650226,26650540,26654363,26658759,26659182,
26669550,26680105,26712331,26714486,26714910,26717528,26724511,26725687,
26727397,26729494,26729611,26740700,26743240,26744595,26745002,26751106,
26751171,26755171,26758193,26764561,26765212,26768025,26775602,26784509,
26790923,26794786,26797591,26798411,26798514,26798516,26802503,26816582,
26820076,26822314,26822620,26824833,26828994,26829845,26830694,26832296,
26833932,26837569,26837702,26840654,26844406,26844870,26849779,26855855,
26871815,26875822,26883456,26895149,26896659,26898563,26907236,26907327,
26908788,26909100,26909504,26910716,26911000,26923777,26939314,26943004,
26944190,26947373,26958896,26963310,26966616,26966916,26967713,26968670,
26969321,26970175,26970717,26981902,26983259,26985002,26986173,26992964,
26999139,27000158,27006120,27006664,27009164,27013146,27028251,27032785,
27033520,27033652,27034890,27036163,27037839,27038986,27039712,27044169,
27044297,27045634,27052607,27056711,27058530,27060167,27060859,27061736,
27072923,27073314,27079140,27079651,27084613,27087426,27090765,27092508,
27093423,27097854,27100800,27101105,27105900,27106179,27110878,27115422,
27117822,27119621,27119861,27122162,27124624,27125872,27133662,27134734,
27135647,27135993,27138325,27142120,27142373,27142529,27144928,27151826,
27153641,27160922,27161071,27162390,27162405,27163928,27165231,27169796,
27170305,27181537,27181897,27185188,27195935,27199245,27200959,27202015,
27203055,27207110,27207634,27208795,27213224,27216046,27217412,27223075,
27229389,27231051,27234962,27236722,27242226,27244337,27244999,27248917,
27249531,27250547,27251690,27254335,27255377,27256000,27258578,27259307,
27262945,27264464,27266245,27274456,27274536,27275533,27276231,27283960,
27284499,27285244,27288638,27292213,27293599,27302711,27302730,27303287,
27303938,27304410,27304906,27305039,27308088,27314206,27314390,27314697,
27320576,27321179,27329612,27333106,27334316,27338912,27338946,27339115,
27345231,27346709,27348081,27349393,27350267,27351628,27359178,27364854,
27365014,27367194,27369515,27370965,27375542,27381498,27383281,27386467,
27392968,27393570,27394703,27395416,27396624,27396672,27396813,27397048,
27400416,27400598,27404573,27404668,27405645,27416997,27423251,27424405,
27426363,27432062,27432826,27433385,27433870,27434193,27439835,27441326,
27442041,27443406,27445727,27452046,27457891,27459593,27459948,27466597,
27468303,27486805,27487919,27489107,27493674,27494663,27501373,27501413,
27502420,27504770,27505229,27508985,27510959,27525909,27529661,27533780,
27533819,27534509,27540613,27544973,27548131,27554074,27555481,27558861,
27560602,27562488,27565906,27567477,27576342,27576354,27587905,27588271,
27589260,27593501,27595973,27601118,27601441,27607563,27611612,27613080,
27613530,27613554,27615649,27617978,27620808,27623159,27629756,27629928,
27632114,27634676,27634991,27645231,27657712,27658186,27666312,27671633,
27680669,27686599,27687880,27688036,27688099,27688692,27691920,27691939,
27693416,27693713,27695063,27698953,27700466,27704237,27709046,27710072,
27717210,27719000,27726780,27729678,27739006,27740424,27745728,27748954,
27751755,27757567,27757888,27758544,27758653,27758972,27759077,27769361,
27779886,27793533,27799032,27801337,27818389,27819881,27824540,27824543,
27825241,27828794,27828892,27829295,27833672,27834551,27834569,27835925,
27837219,27839353,27839616,27846298,27846499,27847259,27850112,27855490,
27861226,27873412,27882176,27886087,27897759,27898015,27902561,27908396,
27909478,27927431,27929287,27929509,27931299,27935493,27940876,27945870,
27951817,27959048,27959594,27964513,27966472,27967484,27983174,27986817,
27994325,27995215,27995248,27997875,27998003,27999073,27999638,28000269,
28007516,28019592,28022101,28023081,28023399,28023482,28024793,28025414,
28026866,28033429,28040776,28043157,28045903,28066655,28067846,28071549,
28072383,28072567,28073470,28074713,28079127,28090453,28092783,28098040,
28098160,28099662,28104176,28108003,28111583,28120036,28120951,28124631,
28125947,28129791,28140658,28157786,28164480,28165439,28171079,28174827,
28180464,28181021,28184554,28188330,28190796,28194173,28199085,28201419,
28204262,28209985,28215510,28218832,28220398,28223871,28226179,28229360,
28236305,28238264,28242712,28250929,28256164,28271119,28276054,28279837,
28281094,28282606,28287484,28290434,28294563,28302049,28305001,28305362,
28305607,28309406,28319114,28320399,28330714,28330971,28350595,28354603,
28357401,28361221,28365111,28369092,28371123,28373960,28375383,28378446,
28384353,28386259,28388910,28389153,28390273,28391210,28396445,28397317,
28401116,28402823,28420042,28420457,28423598,28432129,28434028,28435902,
28437315,28439086,28454215,28454242,28468312,28468493,28481149,28483184,
28489150,28501075,28502343,28503038,28507324,28508053,28508557,28512336,
28521330,28522441,28528349,28530171,28535127,28535272,28537715,28538439,
28542455,28545134,28546290,28547068,28547478,28564479,28566241,28571483,
28572407,28572834,28578164,28578945,28585411,28587723,28589509,28600233,
28602253,28606598,28608211,28612674,28614372,28617631,28617959,28621470,
28622202,28627255,28636676,28639299,28642899,28678804,28690694,28691965,
28692103,28692275,28697526,28697806,28703812,28708023,28709063,28710469,
28710734,28714988,28715655,28728272,28730044,28734355,28740708,28742555,
28749289,28749724,28758090,28758722,28774416,28776431,28777174,28791725,
28797711,28803345,28808314,28817449,28819640,28820669,28821847,28827682,
28830691,28831971,28835937,28836716,28838066,28844866,28847136,28849751,
28852691,28855922,28856060,28856172,28863263,28863487,28867992,28887305,
28889730,28891984,28905390,28910498,28927452,28945922,28948554,28949888,
28951026,28951382,28956908,28959493,28960211,28965095,28965787,28986231,
28986257,28987439,28991884,28993295,28993590,29002488,29006527,29007321,
29007353,29009513,29013832,29024054,29026309,29026582,29027694,29032276,
29039510,29040739,29044086,29044954,29048498,29048728,29050886,29060216,
29061016,29115857,29125374,29154725,29158680,29163567,29170232,29173817,
29179097,29182517,29182901,29189889,29198092,29200700,29203604,29213320,
29213351,29224605,29237575,29247712,29249289,29250230,29250317,29260956,
29278684,29296257,29301463,29307638,29312889,29337294,29338348,29339155,
29343086,29343156,29343861,29347943,29353821,29372069,29372460,29375355,
29375984,29376346,29378913,29379978,29383695,29388020,29398488,29399336,
29405462,29409149,29409455,29418165,29420254,29426241,29434301,29436454,
29437712,29450812,29452251,29454978,29463047,29464779,29472618,29477015,
29483626,29483672,29483723,29483771,29500257,29500963,29501218,29504682,
29511611,29524985,29530515,29536342,29538631,29542449,29542580,29548592,
29549071,29559395,29564592,29580394,29591343,29608023,29614575,29614987,
29621961,29625065,29626154,29629430,29633753,29637526,29637560,29645349,
29651520,29656843,29667994,29676089,29678163,29685137,29687220,29688867,
29689697,29690625,29703195,29705793,29707896,29717901,29719146,29724063,
29726695,29741319,29766435,29767177,29769901,29782211,29791152,29794174,
29794462,29796916,29807964,29813494,29815341,29817278,29822714,29825525,
29836659,29841687,29844131,29846645,29853485,29865188,29869404,29869906,
29875459,29876358,29881050,29881575,29884958,29893132,29902299,29902311,
29914449,29930457,29933718,29941062,29942554,29944035,29944159,29944660,
29951620,29951759,29961353,29962927,29962939,29965888,29991257,30008125,
30018017,30018903,30031027,30039959,30064268,30068871,30076253,30078934,
30086166,30088912,30092280,30098251,30099302,30114477,30116203,30120608,
30125995,30128047,30131286,30139392,30147928,30150731,30163243,30164714,
30173113,30177597,30179644,30186706,30189023,30193736,30196358,30200680,
30200758,30215130,30218044,30218317,30223712,30225443,30239480,30241567,
30244787,30246179,30247305,30252098,30252156,30253255,30265523,30265615,
30272329,30281591,30282501,30283932,30293345,30305880,30312094,30312568,
30316897,30320029,30325407,30331356,30342878,30345926,30352623,30355490,
30357897,30364613,30365745,30368482,30368668,30372081,30374739,30377692,
30381207,30384121,30384152,30387666,30391272,30397100,30402386,30403763,
30408515,30413137,30416034,30421204,30431274,30441687,30443393,30453442,
30458593,30460922,30464250,30464655,30473634,30474774,30475115,30476768,
30485255,30489582,30496957,30497057,30498824,30501574,30503943,30509277,
30510527,30517516,30522998,30528547,30528704,30532811,30533198,30578221,
30581448,30582500,30606345,30613937,30623138,30624864,30635302,30652853,
30654409,30662736,30668407,30671813,30679595,30679771,30681462,30698289,
30741263,30749644,30755348,30758943,30783551,30803210,30809087,30814266,
30814285,30815852,30816938,30822919,30826474,30856358,30866988,30887501,
30904672,30905638,30914674,30919804,30922870,30937340,30964194,30968208,
30980615,30985027,30987088,30994996,30998759,31001455,31004719,31013127,
31022858,31028986,31061482,31100172,31104809,31106577,31109506,31115502,
31156383,31172207,31182793,31192039,31194264,31200845,31201001,31215438,
31228670,31233170,31254535,31257826,31258101,31302499,31306248,31309867,
31315876,31326608,31331354,31341859,31343752,31347532,31377487,31393600,
31408636,31430722,31501139,31508450,31525783,31527103,31544097,31570161,
31600023,31628311,31637680,31658464,31658943,31668061,31696577,31711889,
31718134,31726483,31748000,31749740,31771858,31786838,31816631,31836113,
31862611,31867037,31886745,31897786,31905033,31909295,31945038,31986836,
32089820,32105135,32162748,32186646,32222473,32234161,32246090,32296941,
32478429,32505009

Patch Id: 31802727

Patch Description: OCW OCT 2020 RELEASE UPDATE 12.2.0.1.201020 (31802727)
Patch Apply Time: 2021-06-15T12:28:18+05:30
Bugs Fixed: 12816839,13250991,18701017,20171696,20559126,20674742,21477269,
21679331,21887932,22144696,22322021,22600464,22734786,22900591,22986384,
22999793,23087119,23170674,23297046,23301767,23340259,23346234,23560460,
23706534,23722215,23728054,23760401,23762756,23840305,24330981,24363144,
24372941,24388824,24396050,24403376,24403950,24411578,24412150,24422155,
24423011,24445255,24445680,24451580,24462646,24464953,24493684,24509984,
24526947,24546078,24578464,24581220,24583356,24584419,24600431,24608727,
24622062,24651269,24657753,24663993,24664849,24665035,24670214,24673586,
24686368,24696235,24732650,24736511,24746427,24792446,24796183,24797972,
24801915,24808260,24813163,24820676,24824518,24831158,24831217,24902553,
24902999,24908629,24932026,24953946,25025157,25026470,25031461,25037011,
25037836,25047363,25049033,25066549,25089164,25100966,25103333,25115568,
25131365,25131739,25137752,25164540,25183818,25197395,25197670,25205861,
25216003,25230051,25233797,25245759,25247443,25251382,25269635,25291358,
25301463,25304126,25307145,25308883,25320716,25325522,25326099,25327670,
25329178,25331681,25354530,25360754,25361169,25368979,25369170,25371632,
25385515,25397498,25397620,25408895,25409838,25412450,25448462,25448476,
25485737,25492219,25493588,25496699,25499276,25505841,25509979,25515359,
25518447,25537905,25539530,25540583,25541343,25546960,25556203,25562316,
25564644,25569634,25575414,25576767,25580664,25591658,25604442,25633406,
25644425,25646592,25655495,25662028,25667162,25685286,25697364,25698636,
25714525,25715140,25715179,25715730,25716769,25717212,25728787,25729214,
25730614,25735830,25736599,25742471,25742704,25749324,25763989,25764295,
25774482,25776294,25784424,25785073,25789051,25790438,25790699,25792699,
25795447,25801922,25802473,25803563,25810476,25825732,25825755,25832312,
25832375,25851874,25856024,25865563,25873311,25885834,25890662,25893570,
25915863,25927065,25943805,25947195,25948946,25951778,25956724,25970667,
25982596,25987595,25996923,25998093,26000988,26002739,26026583,26035888,
26052877,26088770,26111524,26115835,26116932,26121788,26144044,26171113,
26185271,26185431,26187578,26198324,26198627,26230199,26238801,26248428,
26257547,26264417,26271545,26276901,26282865,26301456,26307166,26308703,
26313403,26316238,26319152,26326556,26333037,26357098,26372145,26376208,
26379711,26387283,26391418,26391543,26399297,26406731,26418606,26419112,
26431982,26433972,26433979,26439462,26439893,26473232,26474627,26477705,
26493466,26494006,26494536,26527054,26529142,26546632,26547521,26552807,
26554987,26567325,26578587,26581118,26586174,26587652,26588288,26591240,
26593581,26624184,26633228,26654615,26657593,26664476,26675491,26709107,
26710631,26716037,26733329,26747738,26754328,26755613,26791882,26817081,
26817275,26817995,26818064,26818368,26822082,26827699,26860285,26875825,
26877592,26884984,26910536,26943660,26950548,26958202,26966588,26973611,
26979409,26987606,26996813,27006180,27012234,27018734,27023569,27040560,
27047274,27068526,27070729,27080761,27085646,27092991,27094352,27096108,
27106915,27114112,27119820,27130514,27133637,27142581,27148384,27153755,
27154002,27163766,27174938,27177852,27182006,27186837,27190262,27212837,
27213140,27222423,27222938,27238077,27249544,27252023,27267992,27274143,
27297582,27300007,27309182,27309269,27358232,27370933,27374405,27377219,
27378959,27379846,27399499,27399762,27403244,27404599,27426277,27440094,
27447782,27465480,27475272,27496806,27505699,27507494,27516078,27525224,
27526362,27532009,27534289,27536738,27541863,27542831,27554103,27554304,
27555886,27560928,27561848,27566153,27577122,27579726,27581484,27593587,
27595801,27600706,27609819,27624923,27628221,27657467,27663388,27664844,
27668379,27682288,27686197,27691717,27695334,27702244,27703242,27704335,
27708711,27712736,27735534,27739957,27747407,27753602,27757427,27757979,
27766679,27768034,27769638,27786669,27803672,27811439,27830080,27833486,
27833785,27850736,27862636,27870441,27877830,27899060,27912127,27922179,
27935826,27953102,27965004,27970426,27971015,27972271,27979494,27984314,
27990479,28030440,28032758,28050201,28071462,28084656,28086550,28097951,
28105136,28127661,28143609,28146584,28161214,28161727,28168790,28182364,
28220651,28266751,28285234,28306020,28310558,28319989,28326679,28340023,
28375138,28383213,28393555,28396217,28396311,28406406,28408915,28447958,
28451300,28462215,28477613,28493368,28494942,28504730,28515917,28526389,
28535778,28540666,28553832,28558622,28562244,28567875,28578962,28588574,
28593407,28596549,28642469,28647065,28650460,28655841,28661623,28666719,
28697242,28747282,28790623,28805158,28805475,28863424,28865162,28865429,
28871945,28887933,28897229,28901519,28912188,28915251,28944387,28958624,
28969877,28973538,28979734,28988072,29123444,29131772,29139727,29146157,
29161923,29173618,29218185,29254863,29256021,29261171,29268887,29293928,
29307090,29307109,29311336,29379299,29380201,29400176,29420825,29420884,
29427806,29462569,29494011,29504303,29505022,29505730,29529973,29600906,
29615077,29632978,29637215,29698779,29797504,29799836,29852422,29876493,
29878079,29893839,29896074,29936936,29939536,29955305,29997804,30006937,
30007337,30070902,30131854,30140462,30159782,30236372,30239459,30275786,
30303080,30331269,30334538,30338260,30424257,30444173,30469380,30503923,
30539675,30609048,30641829,30649907,30657466,30662447,30663428,30816230,
30953043,31064628,31074907,31081083,31107076,31317215,31374442,31427866,
31499605,31561819,31584305,31640871,31752990,31783643
===========================================================
2023-01-19T21:00:44.832378+05:30
db_recovery_file_dest_size of 8016 MB is 15.18% used. This is a
user-specified limit on the amount of space that will be used by this
database for recovery-related files, and does not reflect the amount of
space available in the underlying filesystem or ASM diskgroup.
2023-01-19T21:00:45.210682+05:30
WARNING: too many parse errors, count=100 SQL hash=0x750004bb
PARSE ERROR: ospid=15718, error=933 for statement:
2023-01-19T21:00:45.210773+05:30
DELETE FROM wri$_adv_sqlt_rtn_planWHERE task_id = :tid AND exec_name
= :execution_name
Additional information: hd=0x69f2bd00 phd=0x69f5f360 flg=0x28 cisid=0 sid=0 ciuid=0 uid=0
2023-01-19T21:00:45.210878+05:30
----- PL/SQL Call Stack -----
object line object
handle number name
0x69869e28 259 type body SYS.WRI$_ADV_SQLTUNE.SUB_DELETE_EXECUTION
0x69c31948 2134 package body SYS.PRVT_ADVISOR.COMMON_DELETE_TASK
0x69c31948 7342 package body SYS.PRVT_ADVISOR.DELETE_EXPIRED_TASKS
0x69c8c1c0 1 anonymous block
WARNING: too many parse errors, count=200 SQL hash=0x750004bb
PARSE ERROR: ospid=15718, error=933 for statement:
2023-01-19T21:00:45.334176+05:30
DELETE FROM wri$_adv_sqlt_rtn_planWHERE task_id = :tid AND exec_name
= :execution_name
Additional information: hd=0x69f2bd00 phd=0x69f5f360 flg=0x28 cisid=0 sid=0 ciuid=0 uid=0
2023-01-19T21:00:45.334297+05:30
----- PL/SQL Call Stack -----
object line object
handle number name
0x69869e28 259 type body SYS.WRI$_ADV_SQLTUNE.SUB_DELETE_EXECUTION
0x69c31948 2134 package body SYS.PRVT_ADVISOR.COMMON_DELETE_TASK
0x69c31948 7342 package body SYS.PRVT_ADVISOR.DELETE_EXPIRED_TASKS
0x69c8c1c0 1 anonymous block
WARNING: too many parse errors, count=300 SQL hash=0x750004bb
PARSE ERROR: ospid=15718, error=933 for statement:
2023-01-19T21:00:45.452991+05:30
DELETE FROM wri$_adv_sqlt_rtn_planWHERE task_id = :tid AND exec_name
= :execution_name
Additional information: hd=0x69f2bd00 phd=0x69f5f360 flg=0x28 cisid=0 sid=0 ciuid=0 uid=0
2023-01-19T21:00:45.453092+05:30
----- PL/SQL Call Stack -----
object line object
handle number name
0x69869e28 259 type body SYS.WRI$_ADV_SQLTUNE.SUB_DELETE_EXECUTION
0x69c31948 2134 package body SYS.PRVT_ADVISOR.COMMON_DELETE_TASK
0x69c31948 7342 package body SYS.PRVT_ADVISOR.DELETE_EXPIRED_TASKS
0x69c8c1c0 1 anonymous block
WARNING: too many parse errors, count=400 SQL hash=0x750004bb
PARSE ERROR: ospid=15718, error=933 for statement:
2023-01-19T21:00:45.572532+05:30
DELETE FROM wri$_adv_sqlt_rtn_planWHERE task_id = :tid AND exec_name
= :execution_name
Additional information: hd=0x69f2bd00 phd=0x69f5f360 flg=0x28 cisid=0 sid=0 ciuid=0 uid=0
2023-01-19T21:00:45.572669+05:30
----- PL/SQL Call Stack -----
object line object
handle number name
0x69869e28 259 type body SYS.WRI$_ADV_SQLTUNE.SUB_DELETE_EXECUTION
0x69c31948 2134 package body SYS.PRVT_ADVISOR.COMMON_DELETE_TASK
0x69c31948 7342 package body SYS.PRVT_ADVISOR.DELETE_EXPIRED_TASKS
0x69c8c1c0 1 anonymous block
WARNING: too many parse errors, count=500 SQL hash=0x750004bb
PARSE ERROR: ospid=15718, error=933 for statement:
2023-01-19T21:00:45.676794+05:30
DELETE FROM wri$_adv_sqlt_rtn_planWHERE task_id = :tid AND exec_name
= :execution_name
Additional information: hd=0x69f2bd00 phd=0x69f5f360 flg=0x28 cisid=0 sid=0 ciuid=0 uid=0
2023-01-19T21:00:45.676897+05:30
----- PL/SQL Call Stack -----
object line object
handle number name
0x69869e28 259 type body SYS.WRI$_ADV_SQLTUNE.SUB_DELETE_EXECUTION
0x69c31948 2134 package body SYS.PRVT_ADVISOR.COMMON_DELETE_TASK
0x69c31948 7342 package body SYS.PRVT_ADVISOR.DELETE_EXPIRED_TASKS
0x69c8c1c0 1 anonymous block
WARNING: too many parse errors, count=600 SQL hash=0x750004bb
PARSE ERROR: ospid=15718, error=933 for statement:
2023-01-19T21:00:45.783982+05:30
DELETE FROM wri$_adv_sqlt_rtn_planWHERE task_id = :tid AND exec_name
= :execution_name
Additional information: hd=0x69f2bd00 phd=0x69f5f360 flg=0x28 cisid=0 sid=0 ciuid=0 uid=0
2023-01-19T21:00:45.784095+05:30
----- PL/SQL Call Stack -----
object line object
handle number name
0x69869e28 259 type body SYS.WRI$_ADV_SQLTUNE.SUB_DELETE_EXECUTION
0x69c31948 2134 package body SYS.PRVT_ADVISOR.COMMON_DELETE_TASK
0x69c31948 7342 package body SYS.PRVT_ADVISOR.DELETE_EXPIRED_TASKS
0x69c8c1c0 1 anonymous block
2023-01-19T21:00:57.809803+05:30
Shutting down instance (immediate) (OS id: 15181)
2023-01-19T21:01:00.411141+05:30
Stopping background process SMCO
2023-01-19T21:01:01.463073+05:30
Shutting down instance: further logons disabled
2023-01-19T21:01:01.495704+05:30
Stopping background process CJQ0
Stopping background process MMNL
2023-01-19T21:01:02.582648+05:30
Stopping background process MMON
2023-01-19T21:01:04.633684+05:30
License high water mark = 9
2023-01-19T21:01:05.974635+05:30
Waiting for shared server 'S001' to die
2023-01-19T21:01:10.647215+05:30
OS process OFSD (ospid 15023) idle for 30 seconds, exiting
2023-01-19T21:01:34.646639+05:30
Dispatchers and shared servers shutdown
2023-01-19T21:01:36.696664+05:30
ALTER DATABASE CLOSE NORMAL
2023-01-19T21:01:36.746808+05:30
Stopping Emon pool
Stopping background process RCBG
2023-01-19T21:01:37.783003+05:30
Stopping Emon pool
2023-01-19T21:01:37.830624+05:30
Shutting down archive processes
2023-01-19T21:01:37.830937+05:30
TT00: Gap Manager exiting (PID:15196)
2023-01-19T21:01:38.831107+05:30
Archiving is disabled
2023-01-19T21:01:38.831551+05:30
ARC3: ARCH shutting down
2023-01-19T21:01:38.831696+05:30
ARC3: Archival stopped
2023-01-19T21:01:38.831685+05:30
ARC2: ARCH shutting down
2023-01-19T21:01:38.831829+05:30
ARC2: Archival stopped
2023-01-19T21:01:38.832527+05:30
ARC0: ARCH shutting down
2023-01-19T21:01:38.832531+05:30
ARC1: ARCH shutting down
2023-01-19T21:01:38.832665+05:30
ARC0: Archival stopped
2023-01-19T21:01:38.832671+05:30
ARC1: Archival stopped
2023-01-19T21:01:39.832119+05:30
NOTE: Deferred communication with ASM instance
NOTE: deferred map free for map id 28
Thread 1 closed at log sequence 1140
Successful close of redo thread 1
2023-01-19T21:01:39.869868+05:30
NOTE: Deferred communication with ASM instance
NOTE: deferred map free for map id 4
2023-01-19T21:01:39.997685+05:30
Completed: ALTER DATABASE CLOSE NORMAL
ALTER DATABASE DISMOUNT
Shutting down archive processes
Archiving is disabled
2023-01-19T21:01:40.006504+05:30
NOTE: Deferred communication with ASM instance
NOTE: deferred map free for map id 2
Completed: ALTER DATABASE DISMOUNT
2023-01-19T21:01:40.066216+05:30
ARCH: Archival disabled due to shutdown: 1089
Shutting down archive processes
Archiving is disabled
2023-01-19T21:01:41.072481+05:30
JIT: pid 15181 requesting stop
2023-01-19T21:01:41.094894+05:30
NOTE: force a map free for map id 2
NOTE: force a map free for map id 4
NOTE: force a map free for map id 28
2023-01-19T21:01:42.135694+05:30
Stopping background process VKTM
2023-01-19T21:01:42.136915+05:30
ARCH: Archival disabled due to shutdown: 1089
Shutting down archive processes
Archiving is disabled
JIT: pid 15181 requesting stop
2023-01-19T21:01:42.163681+05:30
NOTE: Shutting down MARK background process
2023-01-19T21:01:45.625046+05:30
NOTE: ASMB releasing group resources due to shutdown
NOTE: ASMB0 clearing idle groups before exit
Stopping background process RBAL
2023-01-19T21:01:47.550393+05:30
freeing rdom 0
2023-01-19T21:01:51.731048+05:30
Instance shutdown complete (OS id: 15181)

Oracle Golden Gate 19c
No ratings yet
Oracle Golden Gate 19c
164 pages
MobaXterm 172.24.136.141oracle 20230918 155621
No ratings yet
MobaXterm 172.24.136.141oracle 20230918 155621
7,265 pages
Vendor: Oracle Exam Name: Oracle Financials Cloud: Payables 2024 Implementation Essentials Exam Exam Code: 1Z0-1055-24 Product Questions: 112
100% (2)
Vendor: Oracle Exam Name: Oracle Financials Cloud: Payables 2024 Implementation Essentials Exam Exam Code: 1Z0-1055-24 Product Questions: 112
47 pages
Install Oracle Database 19c On Oracle Linux 8
No ratings yet
Install Oracle Database 19c On Oracle Linux 8
8 pages
Build Linux Server of Oracle Linux 8
No ratings yet
Build Linux Server of Oracle Linux 8
9 pages
Advantages and Disadvantages of Multimedia
100% (1)
Advantages and Disadvantages of Multimedia
3 pages
Unix Commands
No ratings yet
Unix Commands
11 pages
10.94.49.133 Art
No ratings yet
10.94.49.133 Art
28 pages
Steps To Add A Node in Oracle RAC 19c
No ratings yet
Steps To Add A Node in Oracle RAC 19c
35 pages
10.94.140.46 DB Drop
No ratings yet
10.94.140.46 DB Drop
24 pages
Linux Commands 01OCT2025
No ratings yet
Linux Commands 01OCT2025
9 pages
Full Database Recover
No ratings yet
Full Database Recover
41 pages
Database Upgrade Steps From 12c To 19c - 26DEC21
No ratings yet
Database Upgrade Steps From 12c To 19c - 26DEC21
54 pages
Oracle Zte Logs
No ratings yet
Oracle Zte Logs
429 pages
Oracle
No ratings yet
Oracle
45 pages
Mypractice Primary
No ratings yet
Mypractice Primary
5 pages
Create Oracle RAC and Oracle RAC ONE Node Database Using Dbca
No ratings yet
Create Oracle RAC and Oracle RAC ONE Node Database Using Dbca
41 pages
DBCA Silent
No ratings yet
DBCA Silent
33 pages
Svconfing
No ratings yet
Svconfing
12 pages
10.94.206.113 Art
No ratings yet
10.94.206.113 Art
29 pages
Changes DBNAME & DBID
No ratings yet
Changes DBNAME & DBID
7 pages
Manual Viewer
No ratings yet
Manual Viewer
36 pages
ASM Architecture ASM Disk Group Administration
No ratings yet
ASM Architecture ASM Disk Group Administration
135 pages
Cloning
No ratings yet
Cloning
21 pages
02) Duplicating - Databse - From - Non - Rac - To - Rac
No ratings yet
02) Duplicating - Databse - From - Non - Rac - To - Rac
18 pages
Inc Restore
No ratings yet
Inc Restore
131 pages
Spfile - Case Sensitive (Environment)
No ratings yet
Spfile - Case Sensitive (Environment)
8 pages
Worker, DB Checker Patch NP 1
No ratings yet
Worker, DB Checker Patch NP 1
25 pages
Upgarede 12c - Arg8prd - Upgrade
No ratings yet
Upgarede 12c - Arg8prd - Upgrade
43 pages
Rman Cold - Consistent - Offline Backup
No ratings yet
Rman Cold - Consistent - Offline Backup
4 pages
Final 19 C
No ratings yet
Final 19 C
4 pages
Oracle 19c RAC Step by Step Part 1 Installation of RHEL 7.8
No ratings yet
Oracle 19c RAC Step by Step Part 1 Installation of RHEL 7.8
9 pages
Clone ORACLE - HOME 11.2.0.3 With PSU 20760997 & Convert To Single Instance
No ratings yet
Clone ORACLE - HOME 11.2.0.3 With PSU 20760997 & Convert To Single Instance
7 pages
For COLD BACK Removed Files
No ratings yet
For COLD BACK Removed Files
3 pages
CTASK369503 - I31 Decomm DB
No ratings yet
CTASK369503 - I31 Decomm DB
10 pages
How To Configure DG4ODBC On 64bit LEB Live Oracle RAC DB To Connect To L..
No ratings yet
How To Configure DG4ODBC On 64bit LEB Live Oracle RAC DB To Connect To L..
18 pages
11gR2 DataGuard Master NEW
No ratings yet
11gR2 DataGuard Master NEW
86 pages
CTASK369517 - Q31 DB Decomm
No ratings yet
CTASK369517 - Q31 DB Decomm
6 pages
DB Decomm CTASK362520 - CHG496860
No ratings yet
DB Decomm CTASK362520 - CHG496860
6 pages
Creating Duplicate Database Using RMAN
100% (2)
Creating Duplicate Database Using RMAN
9 pages
Installing Oracle Database 11 On OEL 6.5
No ratings yet
Installing Oracle Database 11 On OEL 6.5
63 pages
DBID Chnage Standalon Database
No ratings yet
DBID Chnage Standalon Database
7 pages
Database Silent Install and Creation
No ratings yet
Database Silent Install and Creation
1 page
Tablespace Management Theory 30092022
No ratings yet
Tablespace Management Theory 30092022
11 pages
Introduction of Oracle Database
No ratings yet
Introduction of Oracle Database
37 pages
How To Generate AWR Report
No ratings yet
How To Generate AWR Report
25 pages
Oracle 12c Software and Database Installation GUI
No ratings yet
Oracle 12c Software and Database Installation GUI
48 pages
Rman Tutorial
No ratings yet
Rman Tutorial
19 pages
Oraset 12c
No ratings yet
Oraset 12c
7 pages
Errors & Documentation
No ratings yet
Errors & Documentation
46 pages
20 Most Frequently Used Unix Commands For Oracle DBA
No ratings yet
20 Most Frequently Used Unix Commands For Oracle DBA
6 pages
Oratop
100% (1)
Oratop
8 pages
Top For Oracle 143
No ratings yet
Top For Oracle 143
10 pages
Database Creation
No ratings yet
Database Creation
3 pages
Singer Touch and Sew 648
No ratings yet
Singer Touch and Sew 648
80 pages
Oracle
No ratings yet
Oracle
5 pages
Alert Log From Sqlplus Prompt
No ratings yet
Alert Log From Sqlplus Prompt
5 pages
IPSec VPN With Certificate Based Authentication 1736067186
No ratings yet
IPSec VPN With Certificate Based Authentication 1736067186
45 pages
Data Analytics Course
No ratings yet
Data Analytics Course
10 pages
CCNP Labs
No ratings yet
CCNP Labs
315 pages
Cis
No ratings yet
Cis
9 pages
Mod Menu Crash 2025 05 20-17 39 49
No ratings yet
Mod Menu Crash 2025 05 20-17 39 49
2 pages
Oracle Database Backup & Recovery Using RMAN: Tutorial One
No ratings yet
Oracle Database Backup & Recovery Using RMAN: Tutorial One
20 pages
AI & ML Glossary
No ratings yet
AI & ML Glossary
30 pages
AWS Migration
No ratings yet
AWS Migration
14 pages
Leaf Spine Architecture - High Level DC Design
No ratings yet
Leaf Spine Architecture - High Level DC Design
20 pages
DBA Shell Scripts
No ratings yet
DBA Shell Scripts
9 pages
DevOps Resume 74
No ratings yet
DevOps Resume 74
4 pages
C4ISR
No ratings yet
C4ISR
21 pages
SQL SERVER BASIC 1 Training
100% (1)
SQL SERVER BASIC 1 Training
29 pages
MEF E-Tree Service Over MPLS
No ratings yet
MEF E-Tree Service Over MPLS
15 pages
Https Bestdotnettraining - Azureedge.net Documents Kubernetes 12 Helm 12 Helm
No ratings yet
Https Bestdotnettraining - Azureedge.net Documents Kubernetes 12 Helm 12 Helm
18 pages
Collision Domain and Broadcast Domain in Computer Network
No ratings yet
Collision Domain and Broadcast Domain in Computer Network
4 pages
3-Tier Application
No ratings yet
3-Tier Application
28 pages
Referat Microsoft Office by Lucian
No ratings yet
Referat Microsoft Office by Lucian
1 page
6 Terms
No ratings yet
6 Terms
74 pages
Https Bestdotnettraining - Azureedge.net Documents Kubernetes 5 Kubernetes Services 5 Kubernetes Services and Ingress
No ratings yet
Https Bestdotnettraining - Azureedge.net Documents Kubernetes 5 Kubernetes Services 5 Kubernetes Services and Ingress
13 pages
Learning@Cisco Cisco Training On Demand Implementing Cisco Wireless Network Fundamentals (WIFUND) v1.0
No ratings yet
Learning@Cisco Cisco Training On Demand Implementing Cisco Wireless Network Fundamentals (WIFUND) v1.0
6 pages
Https Bestdotnettraining - Azureedge.net Documents Kubernetes 8 Configuring and Managing Storage 8 Configuring and Managing Storage
No ratings yet
Https Bestdotnettraining - Azureedge.net Documents Kubernetes 8 Configuring and Managing Storage 8 Configuring and Managing Storage
14 pages
Computing Essentials Ch2
No ratings yet
Computing Essentials Ch2
47 pages
Https Bestdotnettraining - Azureedge.net Documents Kubernetes 9 Deep Dive Into Pods and Containers 9 Deep Dive Into Pods and Containers
No ratings yet
Https Bestdotnettraining - Azureedge.net Documents Kubernetes 9 Deep Dive Into Pods and Containers 9 Deep Dive Into Pods and Containers
11 pages
820-1501 (Project Q26)
No ratings yet
820-1501 (Project Q26)
74 pages
Report Response From Office of CFO Jeff Atwater
No ratings yet
Report Response From Office of CFO Jeff Atwater
3 pages
DevOps Resume 69
No ratings yet
DevOps Resume 69
4 pages
Ricoh Soc821 PSG
No ratings yet
Ricoh Soc821 PSG
34 pages
Day 1
No ratings yet
Day 1
3 pages
Https Bestdotnettraining - Azureedge.net Documents Kubernetes 7 Environment Variables ConfigMaps and Secrets 6 Environment Variables and ConfigMaps
No ratings yet
Https Bestdotnettraining - Azureedge.net Documents Kubernetes 7 Environment Variables ConfigMaps and Secrets 6 Environment Variables and ConfigMaps
4 pages
RDS DR Presentation
No ratings yet
RDS DR Presentation
12 pages
ACID Loks IsolationLevels
No ratings yet
ACID Loks IsolationLevels
10 pages
Systems Admin GRP 3 (Test 1 QTN 5)
No ratings yet
Systems Admin GRP 3 (Test 1 QTN 5)
20 pages
Real Time Deployment Process
No ratings yet
Real Time Deployment Process
2 pages
Day+4 Task List Ed2
No ratings yet
Day+4 Task List Ed2
2 pages
Day+1 Task List Ed1
No ratings yet
Day+1 Task List Ed1
2 pages
Jayesh-Devops Engineer
No ratings yet
Jayesh-Devops Engineer
3 pages
TCP Connection Establishment
No ratings yet
TCP Connection Establishment
10 pages
08-Jun-2021 - Iam and VPC
No ratings yet
08-Jun-2021 - Iam and VPC
3 pages
Static Routing Lab Report
No ratings yet
Static Routing Lab Report
2 pages
IT200 Computer Communication and Networking Session 2 - Introduction
No ratings yet
IT200 Computer Communication and Networking Session 2 - Introduction
10 pages
EN1000 Product Data Sheet: EN1111
No ratings yet
EN1000 Product Data Sheet: EN1111
2 pages
AZ-900 WeekEnd Exam Cram - Documentation Links
No ratings yet
AZ-900 WeekEnd Exam Cram - Documentation Links
10 pages
Network - Topology - Exercise B With Answers V1.0-1
No ratings yet
Network - Topology - Exercise B With Answers V1.0-1
9 pages
Registration Form Test Case
No ratings yet
Registration Form Test Case
14 pages
Consumer Acceptance of Smart Speakers: A Mixed Methods Approach
No ratings yet
Consumer Acceptance of Smart Speakers: A Mixed Methods Approach
14 pages
Proxy Server-Notes
No ratings yet
Proxy Server-Notes
2 pages
Cyber Brief September 2022
No ratings yet
Cyber Brief September 2022
13 pages
Untuk Setting GPRS
No ratings yet
Untuk Setting GPRS
5 pages
Web Evaluation Form: I. General Information
No ratings yet
Web Evaluation Form: I. General Information
4 pages
Assignment 1 - Linear Regression (PyTorch - Zero To GANs)
No ratings yet
Assignment 1 - Linear Regression (PyTorch - Zero To GANs)
4 pages
Cyber Love: A New Opportunity For Love?
No ratings yet
Cyber Love: A New Opportunity For Love?
2 pages
Configuration of a Simple Samba File Server, Quota and Schedule Backup
From Everand
Configuration of a Simple Samba File Server, Quota and Schedule Backup
Dr. Hedaya Alasooly
No ratings yet
Protecting Confidential Information: How to Securely Store Sensitive Data
From Everand
Protecting Confidential Information: How to Securely Store Sensitive Data
Slava Gomzin
No ratings yet
CISCO PACKET TRACER LABS: Best practice of configuring or troubleshooting Network
From Everand
CISCO PACKET TRACER LABS: Best practice of configuring or troubleshooting Network
Mulayam Singh
No ratings yet
VPS Server Setup
From Everand
VPS Server Setup
L Mohan Arun
5/5 (1)