CBS ORACLE DATABASE DC->DR SWITCHOVER

=====================================
CBS Oracle Database have 3 Container Databases RSCBCDB1DC, RSCBCDB3DC & RSCBCDB4DC at BSDC, Jaipur location.
All these three Container databases can be switched over to Jodhpur-DC, Jodhpur location as per requirement.
The document describes the steps for switchover of one Container database RSCBCDB4DC and in the same manner
other two RSCBCDB1DC and RSCBCDB3DC can be switched to Jodhpur-DC, Jodhpur location.

DATABASE for switchover- RSCBCDB4DC

-----------------------------------
RSCBCDB4DC - Current Primary Database LOCATION-BSDC
RSCBCDB4NDR - Current Reference Database (Standby database) LOCATION-BSDC
RSCBCDB4 - New Primary Database (Currently in standby mode) LOCATION-JODHPUR-DR
RSCBCDB4DR - New Reference Database (Currently in standby cascade mode) LOCATION-JODHPUR-DR
DBRPT4DR - Report server (Currently Syncing from RSCBCDB4DC) LOCATION-RSCB

============================ CHECKS BEFORE SWITCHOVER =========================

1. Check the Database roles of Primary and Standby Databases. Also check the SYNC status of all Standby
databases with primary database.

SQL> select name,db_unique_name,open_mode,database_role from v$database; >> run command on both Primary
and all Standby database

On Primary Database RSCBCDB4DC

NAME DB_UNIQUE_NAME OPEN_MODE DATABASE_ROLE

--------- ------------------------------ -------------------- ----------------
RSCBCDB4 rscbcdb4dc READ WRITE PRIMARY

On Standby Database RSCBCDB4

NAME DB_UNIQUE_NAME OPEN_MODE DATABASE_ROLE

--------- ------------------------------ -------------------- ----------------
RSCBCDB4 rscbcdb4 MOUNTED PHYSICAL STANDBY

2. On primary database RSCBCDB4DC both nodes run following command.

SQL> alter system switch logfile;

3. On primary database RSCBCDB4DC from one node run following commands.

SQL> select switchover_status from v$database;

SWITCHOVER_STATUS
--------------------
TO STANDBY

SQL> alter database switchover to rscbcdb4 verify;

================================ SWITCHOVER =====================================

4. Successful execution of above command shows current Primary database RSCBCDB4DC is ready for switchover TO
STANDBY, so now switch the same.

SQL > alter database switchover to rscbcdb4; >> Run from 1st node of RSCBCDB4DC

Now RSCBCDB4 became new Primary database in MOUNT mode and RSCBCDB4DC became Standby database that will
shutdown automatically.

============================ SWITCHOVER COMPLETED ===============================

================== CONFIGURE NEW PRIMARY DATABASE RSCBCDB4 ====================

5. After switchover new Primary database RSCBCDB4 will open in MOUNT mode with database role PRIMARY. Run the
following commands on RSCBCDB4 to open the CDB and all pluggable databases.

SQL> alter database open; >> Run on both nodes

SQL> alter pluggable database all open instances=all;
SQL> show pdbs; >> All the PDB's must be in READ-WRITE mode

6. Change the default startup option from MOUNT to OPEN for new primary database RSCBCDB4.

# srvctl modify database -d rscbcdb4

7. For NDR-SYNC (RSCBCDB4DR), on new primary database RSCBCDB4 change the parameter log_archive_dest_2. Check
SYNC after the change.

alter system set log_archive_dest_2='service=rscbcdb4dr async noaffirm reopen=15

valid_for=(STANDBY_LOGFILE,STANDBY_ROLE) db_unique_name=rscbcdb4dr';
To
alter system set log_archive_dest_2='service=rscbcdb4dr async noaffirm reopen=15
valid_for=(online_logfiles,primary_role) db_unique_name=rscbcdb4dr';

8. For DR-SYNC (RSCBCDB4DC), on new primary database RSCBCDB4 change the parameter log_archive_dest_3. Check
SYNC after the change.

SQL> alter system set log_archive_dest_3='service=rscbcdb4dc async noaffirm reopen=15

valid_for=(online_logfiles,primary_role) db_unique_name=rscbcdb4dc'
SQL> alter system set log_archive_dest_state_3=enable;

================== CONFIGURE NEW STANDBY DATABASE RSCBCDB4DC ======================

9. New Standby database RSCBCDB4DC after the switchover will be shutdown with database role PHYSICAL STANDBY.
Start new standby database RSCBCDB4DC in mount mode.

SQL> startup mount >> Run on both nodes

10. Check the RFS processes on new standby database RSCBCDB4DC and run the MRP process.

SQL> recover managed standby database disconnect; >> Run on any one node

11. Change the default startup option in srvctl from OPEN to MOUNT for new standby database RSCBCDB4DC.

# srvctl modify database -d rscbcdb4dc

12. For CASCADE-DR SYNC (RSCBCDB4NDR), on new standby database RSCBCDB4DC change the parameter
log_archive_dest_2. Check SYNC after the change.

alter system set log_archive_dest_2='service=rscbcdb4ndr async noaffirm reopen=15

valid_for=(online_logfiles,primary_role) db_unique_name=rscbcdb4ndr';
To
alter system set log_archive_dest_2='service=rscbcdb4ndr async noaffirm reopen=15
valid_for=(STANDBY_LOGFILE,STANDBY_ROLE) db_unique_name=rscbcdb4ndr';

13. alter system set log_archive_dest_state_3=DEFER;

============ CONFIGURE CHANGES FOR REPORT SERVER DBRPT4DR SYNC ==================

14. Make changes in parameters of dbrpt4dr, new primary database RSCBCDB4 and new standby database RSCBCDB4DC
so that it will start sync from new primary RSCBCDB4.

a) Remove SYNC from RSCBCDB4DC

alter system set log_archive_dest_state_4=DEFER;

b) Add SYNC at RSCBCDB4

alter system set log_archive_dest_state_4=ENABLE;

c) Update log_archive_config at DBRPT4DR

alter system set log_archive_config='dg_config=(rscbcdb4,dbrpt4dr)'

======================= Change ARCHIVE deletion policy ===========================

15. Change parameter on new primary database RSCBCDB4 from

CONFIGURE ARCHIVELOG DELETION POLICY TO APPLIED ON STANDBY;

To
CONFIGURE ARCHIVELOG DELETION POLICY TO SHIPPED TO ALL STANDBY;

16. Change parameter on new standby database RSCBCDB4DC from

CONFIGURE ARCHIVELOG DELETION POLICY TO SHIPPED TO ALL STANDBY;

To
CONFIGURE ARCHIVELOG DELETION POLICY TO APPLIED ON STANDBY;

====================== CHECK REDO APPLY ON ALL STANDBY DATABASES =================

17. Check REDO apply on all standby databases RSCBCDB4DR, RSCBCDB4DC, RSCBCDB4NDR & DBRPT4DR

====== ALL SWITCHOVER & POST-SWITCHOVER CONFIGURATION STEPS COMPLETED ============

**********************************************************************************
=================== CURRENT DATABASE PARAMETERS BEFORE SWITCHOVER ================
**********************************************************************************
------------------------------- RSCBCDB4DC ---------------------------------------
log_archive_dest_1 location=use_db_recovery_file_dest valid_for=(all_logfiles,all_roles)
db_unique_name=rscbcdb4dc
log_archive_dest_2 service=rscbcdb4ndr async noaffirm reopen=15
valid_for=(online_logfiles,primary_role) db_unique_name=rscbcdb4ndr
log_archive_dest_3 service=rscbcdb4 async noaffirm reopen=15
valid_for=(online_logfiles,primary_role) db_unique_name=rscbcdb4
log_archive_dest_4 service=dbrpt4dr async noaffirm reopen=15
valid_for=(online_logfiles,primary_role) db_unique_name=dbrpt4dr
log_archive_dest_state_1 enable
log_archive_dest_state_2 ENABLE
log_archive_dest_state_3 ENABLE
log_archive_dest_state_4 ENABLE
fal_client RSCBCDB4DC
fal_server RSCBCDB4NDR,RSCBCDB4,DBRPT4DR
log_archive_config dg_config=(rscbcdb4dc,rscbcdb4ndr,rscbcdb4,dbrpt4dr)
remote_listener pdc-scan3:1521
db_unique_name rscbcdb4dc

------------------------------- RSCBCDB4NDR ------------------------------------

log_archive_dest_1
log_archive_dest_2 service=rscbcdb4ndr async noaffirm reopen=15
valid_for=(online_logfiles,primary_role) db_unique_name=rscbcdb4ndr
log_archive_dest_state_1 enable
log_archive_dest_state_2 DEFER
fal_client RSCBCDB4NDR
fal_server RSCBCDB4DC
log_archive_config dg_config=(rscbcdb4dc, rscbcdb4ndr)
remote_listener pdc-scan4:1521
db_unique_name rscbcdb4ndr

----------------------------- RSCBCDB4 -----------------------------------------

log_archive_dest_1 location=use_db_recovery_file_dest valid_for=(all_logfiles,all_roles)
db_unique_name=rscbcdb4
log_archive_dest_2 service=rscbcdb4dr async noaffirm reopen=15
valid_for=(STANDBY_LOGFILE,STANDBY_ROLE) db_unique_name=rscbcdb4dr
log_archive_dest_3 service=rscbcdb4dc async noaffirm reopen=15
valid_for=(online_logfiles,primary_role) db_unique_name=rscbcdb4dc
log_archive_dest_4 service=dbrpt4dr async noaffirm reopen=15
valid_for=(online_logfiles,primary_role) db_unique_name=dbrpt4dr
log_archive_dest_state_1 DEFER
log_archive_dest_state_2 ENABLE
log_archive_dest_state_3 DEFER
log_archive_dest_state_4 DEFER
fal_client RSCBCDB4
fal_server RSCBCDB4DC,RSCBCDB4DR,DBRPT4DR
log_archive_config dg_config=(rscbcdb4dc,rscbcdb4,rscbcdb4dr)
remote_listener pdr-scan2:1521
db_unique_name rscbcdb4

---------------------------- RSCBCDB4DR ---------------------------------------

log_archive_dest_1 location=use_db_recovery_file_dest valid_for=(all_logfiles,all_roles)
db_unique_name=rscbcdb4dr
log_archive_dest_2 service=rscbcdb4dr async noaffirm reopen=15
valid_for=(online_logfiles,primary_role) db_unique_name=rscbcdb4dr
log_archive_dest_state_1 enable
log_archive_dest_state_2 DEFER
fal_client RSCBCDB4
fal_server RSCBCDB4DR
log_archive_config dg_config=(rscbcdb4, rscbcdb4dr)
remote_listener pdr-scan4:1521
db_unique_name rscbcdb4dr

----------------------------- DBRPT4DR ----------------------------------------

log_archive_dest_1
log_archive_dest_2 service=rscbcdb4dr async noaffirm reopen=15
valid_for=(online_logfiles,primary_role) db_unique_name=rscbcdb4dr
log_archive_dest_3 service=dbrpt4dr async noaffirm reopen=15
valid_for=(online_logfiles,primary_role) db_unique_name=dbrpt4dr
log_archive_dest_state_1 enable
log_archive_dest_state_2 ENABLE
log_archive_dest_state_3 DEFER
fal_client DBRPT4DR
fal_server RSCBCDB4DC
log_archive_config dg_config=(rscbcdb4dc,dbrpt4dr)
remote_listener 10.0.6.136:1521
db_unique_name dbrpt4dr
================================================================================

** Changes before Activity

----------------------------- RSCBCDB4 -----------------------------------------
log_archive_dest_1
log_archive_dest_2 service=rscbcdb4dr async noaffirm reopen=15
valid_for=(STANDBY_LOGFILE,STANDBY_ROLE) db_unique_name=rscbcdb4dr - 7
log_archive_dest_3
- 8
log_archive_dest_4 service=rscbcdb4dc async noaffirm reopen=15
valid_for=(online_logfiles,primary_role) db_unique_name=rscbcdb4dc
log_archive_dest_state_1 enable
log_archive_dest_state_2 ENABLE
log_archive_dest_state_3 DEFER
log_archive_dest_state_4 DEFER
fal_client RSCBCDB4
fal_server RSCBCDB4DC,RSCBCDB4DR,DBRPT4DR
log_archive_config dg_config=(rscbcdb4dc,rscbcdb4,rscbcdb4dr)
remote_listener pdr-scan2:1521
db_unique_name rscbcdb4

Change before activity

----------------------------
log_archive_dest_state_1 DEFER
log_archive_dest_1 location=use_db_recovery_file_dest valid_for=(all_logfiles,all_roles)
db_unique_name=rscbcdb4
log_archive_dest_3 service=rscbcdb4dc async noaffirm reopen=15
valid_for=(online_logfiles,primary_role) db_unique_name=rscbcdb4dc
log_archive_dest_4 service=dbrpt4dr async noaffirm reopen=15
valid_for=(online_logfiles,primary_role) db_unique_name=dbrpt4dr
log_archive_config dg_config=(rscbcdb4dc,rscbcdb4,rscbcdb4dr,dbrpt4dr)