Oracle Rac 19c On Sles15-Sp1
Oracle Rac 19c On Sles15-Sp1
4) on SUSE Linux
Enterprise Server 15 SP1 - x86_64
http://www.suse.com
1
Table of Contents
Introduction............................................................................................................................3
Hardware and Software Requirements.................................................................................3
Hardware Requirements....................................................................................................3
Software Requirements.....................................................................................................3
Cluster(4-node) Information...................................................................................................3
Prerequisites..........................................................................................................................4
Install SUSE Linux Enterprise Server 15 SP1 on each cluster node................................4
Cluster Network configuration...........................................................................................4
Oracle RAC Installation.........................................................................................................5
Installing Oracle Grid Infrastructure...................................................................................5
Installing Oracle Database..............................................................................................31
Additional Comments ..........................................................................................................63
2
Introduction
This documentation provides the details for install Oracle RAC 19c on SUSE Linux
Enterprise Server 15 SP1 OS. Here, x86_64 version of both Oracle Database 19c
Enterprise and SUSE Linux Enterprise Server is used. Similar steps applies to other
platforms(x86, ia64, etc.). If you encounter any problem or have general question, please
post your query to [email protected].
Hardware Requirements
Requirement Minimum
RAM 32 GB
Swap space Approx. twice the size of RAM
Disk space in /tmp 8 GB
Disk space for software files 8 GB
Disk space for database files 8 GB
Software Requirements
SuSE
• SUSE Linux Enterprise Server 15 SP1 (x86_64)
(http://download.suse.de/install)
Oracle
• Oracle Grid Infrastructure 19c (19.3) (x86_64)
• Oracle Database 19c (19.3) (x86_64)
(https://www.oracle.com/database/technologies/oracle-database-software-
downloads.html#19c)
Cluster(4-node) Information
HP DL360 Gen9 Server (Intel Xeon 2x12 core ~ 48 CPU), 96GB RAM
4 NIC per server (two bonded as active/passive) + Static IP Address
Local HDD (2x600 GB)
Shared SAN Partition ( 2TB)
SUSE Linux Enterprise Server 15 SP1(x86_64)
Kernel version: 4.12.14-197.21-default
3
Prerequisites
1. Install SUSE Linux Enterprise Server 15 SP1 on each cluster node.
# Public
137.65.135.90 c1n1 c1n1.provo.novell.com // Node1
137.65.135.91 c1n2 c1n2.provo.novell.com // Node2
137.65.135.92 c1n3 c1n3.provo.novell.com // Node3
137.65.135.93 c1n4 c1n4.provo.novell.com // Node4
# Private
10.1.1.11 c1n1-priv
10.1.1.12 c1n2-priv
10.1.1.13 c1n3-priv
10.1.1.14 c1n4-priv
# Virtual
137.65.135.94 c1n1-vip c1n1-vip.provo.novell.com
137.65.135.95 c1n2-vip c1n2-vip.provo.novell.com
137.65.135.96 c1n3-vip c1n3-vip.provo.novell.com
137.65.135.97 c1n4-vip c1n4-vip.provo.novell.com
# SCAN
c1c1-scan.provo.novell.com (137.65.135.89)
4
Oracle RAC Installation
1. Installing Oracle Grid Infrastructure.
1-1. Login to the SLES 15 SP1 64-bit OS as a non-admin user. Download the Oracle Database 19c
Grid Infrastructure (19.3) for Linux x86-64 from https://www.oracle.com/database/technologies/oracle-
database-software-downloads.html#19c.
1-2. Extract LINUX.X64_193000_grid_home.zip and run the installer './gridSetup.sh' from Gird
ShipHome.
Install Flow:
Choose option "Configure Oracle Grid Infrastructure for a New Cluster", then click Next to
continue.
5
2). Select Cluster Configuration.
Choose option "Configure an Oracle Standalone Cluster", then click Next to continue.
6
3). Grid Plug and Play Information.
In the Cluster Name and SCAN Name fields, enter the names for your cluster and cluster scan that are
unique throughout your entire enterprise network, then click Next to continue.
(More details for GNS configuration please see Oracle official document.)
7
4). The 'Cluster Node Information' screen appears.
In the Public Hostname column of the table of cluster nodes, you should see your local node. Click Add
to add another node to the cluster. Enter the second node's public name(node2), and virtual IP name
(node2-vip), then click OK. Make sure all nodes are selected, then click the SSH Connectivity button at
the bottom of the window. After a short period, another message window appears indicating that
passwordless SSH connectivity has been established between the cluster nodes. Click OK to continue.
When returned to the Cluster Node Information window, click Next to continue.
8
(Note: Passwordless SSH connectivity check will be failed as shown below, although you have
configured it correctly.
9
5). Specify Network Interface Usage.
Verify that each interface has the correct interface type associated with it. If you have network
interfaces that should not be used by Oracle Clusterware, then set the network interface type to Do Not
Use. For example, if you have only two network interfaces, then set the public interface to have a Use
For value of Public and set the private network interface to have a Use For value of ASM & Private,
then click Next to continue.
10
6). Storage Option Information.
Choose option "Use Oracle Flex ASM for storage", then click Next to continue.
11
7). Grid Infrastructure Management Repository Option.
Choose whether you want to store the Grid Infrastructure Management Repository in a separate Oracle
ASM disk group, then click Next to continue.
12
8). Create ASM Disk Group.
Depending on your needs to creat ASM Disk Group, then click Next to continue.
13
9). Specify ASM Password.
Choose the same password for the Oracle ASM SYS and ASMSNMP account, or specify different
passwords for each account, then click Next to continue.
14
10). Failure Isolation Support.
Select the option "Do not use Intelligent Platform Management Interface (IPMI)", then click Next to
continue.
15
11). Specify Management Options.
Selected/Deselected the option "Register with EM...", then click Next to continue.
16
12). Privileged Operating System Groups.
Accept the default operating system group names for Oracle ASM administration, then click Next to
continue.
17
13). Specify Installation Location.
Specify the directory to use for the Oracle base for the Oracle Grid Infrastructure installation, then click
Next to continue. The Oracle base directory must be different from the Oracle home directory.
18
14). Root script execution configuration.
Select the option to Automatically run configuration scripts. Enter the credentials for the root user or
a sudo account,then click Next to continue.
Alternatively, you can Run the scripts manually as the root user at the end of the installation process
when prompted by the installer.
19
15). Perform Prerequisite Checks.
Perform Pre-Check as shown above; Click Fix&Check Again to recheck the system.
20
Follow the prompts, manual run Fixup Script as "root" user on each node, then click OK.
21
Check each error and warning message, try to fix manually, then click Check Again.
22
(Note: There are still some warning messages, please refer to the details of Additional Comments in
the last section of the document.)
23
16). Summary.
24
17). Install Product.
25
Installer prompted you to run the orainstRoot.sh and root.sh scripts. Click Yes.
26
18). Finish.
Click Close to complete the installation process and exit the installer.
27
1-3. Oracle Database 19c(19.3) Grid Infrastructure Post-Install Checks.
28
3). Check status of designated resources.
29
1 ONLINE ONLINE c1n3 STABLE
ora.c1n4.vip
1 ONLINE ONLINE c1n4 STABLE
ora.cvu
1 ONLINE ONLINE c1n1 STABLE
ora.qosmserver
1 ONLINE ONLINE c1n1 STABLE
ora.scan1.vip
1 ONLINE ONLINE c1n2 STABLE
ora.scan2.vip
1 ONLINE ONLINE c1n3 STABLE
ora.scan3.vip
1 ONLINE ONLINE c1n4 STABLE
--------------------------------------------------------------------------------
oracle@c1n1:~> /home/oracle/grid_19c/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 4
Total space (kbytes) : 491684
Used space (kbytes) : 84292
Available space (kbytes) : 407392
ID : 133237046
Device/File Name : +SUSEDEMO
Device/File integrity check succeeded
30
2. Installing Oracle Database.
1-1. Login to the SLES 15 SP1 64-bit OS as a non-admin user. Download the Oracle Database 19c
(19.3) for Linux x86-64 from https://www.oracle.com/database/technologies/oracle-database-software-
downloads.html#19c.
1-2. Extract LINUX.X64_193000_db_home.zip and run the installer './runInstaller' from Database
ShipHome.
Install Flow:
31
2). Select Database Installation Option.
Choose option "Oracle Real Application Clusters database installation", then click Next to continue.
32
3). Select List of Nodes.
33
4). Select Database Edition.
34
5). Specify Installation Location.
Fill in Oracle base and Software location as shown above, then click Next to continue.
35
6). Privileged Operating System groups.
36
7). Root script execution configuration.
Select the option to Automatically run configuration scripts. Enter the credentials for the root user or
a sudo account,then click Next to continue. Alternatively, you can Run the scripts manually as the root
user at the end of the installation process when prompted by the installer.
37
8). Perform Prerequisite Checks.
Perform Pre-Check as shown above; Click Fix&Check Again to recheck the system.
38
Follow the prompts, manual run Fixup Script as "root" user on each node, then click OK.
39
(Note: There are still some unsatisfied items, please refer to the details of Additional Comments in the
last section of the document.)
40
9). Summary.
41
10). Install Product.
42
Installer prompted you to run the orainstRoot.sh and root.sh scripts. Click Yes.
43
11). Finish
The installation of Oracle Database is finished, click Close to dismiss the screen.
44
1-3. Using DBCA to create Oracle RAC DataBase.
45
2). Select Database Creation Mode.
Select option "Typical configuration" and fill in administrator password. Then, click Next to continue.
46
3). Perform Prerequisite Checks.
47
4). Summary.
Database Configuration Summary as shown above, review the information, then click Finish to
continue.
48
5). Progress Page.
Database creating progress as shown above, waiting until the creation is complete.
49
6). Finish.
Database creation complete, some details as shown above. Click Close to dismiss the screen.
50
1-4. Oracle Database 19c(19.3) Post-Install Checks.
51
oracle@c1n1:~> /home/oracle/grid_19c/bin/crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE c1n1 STABLE
ONLINE ONLINE c1n2 STABLE
ONLINE ONLINE c1n3 STABLE
ONLINE ONLINE c1n4 STABLE
ora.chad
ONLINE ONLINE c1n1 STABLE
ONLINE ONLINE c1n2 STABLE
ONLINE ONLINE c1n3 STABLE
ONLINE ONLINE c1n4 STABLE
ora.net1.network
ONLINE ONLINE c1n1 STABLE
ONLINE ONLINE c1n2 STABLE
ONLINE ONLINE c1n3 STABLE
ONLINE ONLINE c1n4 STABLE
ora.ons
ONLINE ONLINE c1n1 STABLE
ONLINE ONLINE c1n2 STABLE
ONLINE ONLINE c1n3 STABLE
ONLINE ONLINE c1n4 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE c1n1 STABLE
2 ONLINE ONLINE c1n2 STABLE
3 ONLINE ONLINE c1n3 STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE c1n2 STABLE
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE c1n3 STABLE
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE c1n1 STABLE
ora.SUSEDEMO.dg(ora.asmgroup)
1 ONLINE ONLINE c1n1 STABLE
2 ONLINE ONLINE c1n2 STABLE
3 ONLINE ONLINE c1n3 STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE c1n1 Started,STABLE
2 ONLINE ONLINE c1n2 Started,STABLE
3 ONLINE ONLINE c1n3 Started,STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE c1n1 STABLE
2 ONLINE ONLINE c1n2 STABLE
3 ONLINE ONLINE c1n3 STABLE
ora.c1n1.vip
1 ONLINE ONLINE c1n1 STABLE
ora.c1n2.vip
1 ONLINE ONLINE c1n2 STABLE
ora.c1n3.vip
1 ONLINE ONLINE c1n3 STABLE
ora.c1n4.vip
52
1 ONLINE ONLINE c1n4 STABLE
ora.cvu
1 ONLINE ONLINE c1n1 STABLE
ora.qosmserver
1 ONLINE ONLINE c1n1 STABLE
ora.scan1.vip
1 ONLINE ONLINE c1n2 STABLE
ora.scan2.vip
1 ONLINE ONLINE c1n3 STABLE
ora.scan3.vip
1 ONLINE ONLINE c1n1 STABLE
ora.susedb.db
1 ONLINE ONLINE c1n1 Open,HOME=/home/orac
le/db_19c,STABLE
2 ONLINE ONLINE c1n2 Open,HOME=/home/orac
le/db_19c,STABLE
3 ONLINE ONLINE c1n3 Open,HOME=/home/orac
le/db_19c,STABLE
4 ONLINE ONLINE c1n4 Open,HOME=/home/orac
le/db_19c,STABLE
--------------------------------------------------------------------------------
53
1-5. Installing Grid Infrastructure Release Update 19.4.0.0.190716 (Patch 29708769)
(Note: Patch 29708769 includes Database Release Update 19.4.0.0.190716 (Patch 29834717))
As root user, execute the following command on each node of the cluster:
***********************************************************************************
c1n1:/home/oracle/grid_19c/OPatch # ./opatchauto apply
/home/Oracle_SW/RAC_19c_SW/GI_Patch/29708769/
54
Preparing home /home/oracle/db_19c after database service restarted
No step execution required.........
OPatchAuto successful.
--------------------------------Summary--------------------------------
Host:c1n1
RAC Home:/home/oracle/db_19c
Version:19.0.0.0.0
Summary:
Patch: /home/Oracle_SW/RAC_19c_SW/GI_Patch/29708769/29851014
Reason: This patch is not applicable to this specified target type - "rac_database"
Patch: /home/Oracle_SW/RAC_19c_SW/GI_Patch/29708769/29401763
Reason: This patch is not applicable to this specified target type - "rac_database"
Patch: /home/Oracle_SW/RAC_19c_SW/GI_Patch/29708769/29834717
Log: /home/oracle/db_19c/cfgtoollogs/opatchauto/core/opatch/opatch2019-11-05_18-17-56PM_1.log
Patch: /home/Oracle_SW/RAC_19c_SW/GI_Patch/29708769/29850993
Log: /home/oracle/db_19c/cfgtoollogs/opatchauto/core/opatch/opatch2019-11-05_18-17-56PM_1.log
Host:c1n1
CRS Home:/home/oracle/grid_19c
Version:19.0.0.0.0
Summary:
Patch: /home/Oracle_SW/RAC_19c_SW/GI_Patch/29708769/29401763
Reason: This patch is already been applied, so not going to apply again.
Patch: /home/Oracle_SW/RAC_19c_SW/GI_Patch/29708769/29834717
Log: /home/oracle/grid_19c/cfgtoollogs/opatchauto/core/opatch/opatch2019-11-05_18-19-37PM_1.log
Patch: /home/Oracle_SW/RAC_19c_SW/GI_Patch/29708769/29850993
Log: /home/oracle/grid_19c/cfgtoollogs/opatchauto/core/opatch/opatch2019-11-05_18-19-37PM_1.log
Patch: /home/Oracle_SW/RAC_19c_SW/GI_Patch/29708769/29851014
Log: /home/oracle/grid_19c/cfgtoollogs/opatchauto/core/opatch/opatch2019-11-05_18-19-37PM_1.log
55
OPatchauto session completed at Tue Nov 5 18:44:04 2019
Time taken to complete the session 30 minutes, 58 seconds
***********************************************************************************
For details, please refer to the 'Read Me' file included in the patch package, make sure the installation
is successful.
56
1-6. Installing other patches.
57
1-7. Oracle RAC 19c(19.4) Post-Install Checks.
1). Restart all the services (database, ASM, listeners, nodeapps, and CRS daemons),then check
Oracle RAC status.
58
ONLINE ONLINE c1n4 STABLE
ora.chad
ONLINE ONLINE c1n1 STABLE
ONLINE ONLINE c1n2 STABLE
ONLINE ONLINE c1n3 STABLE
ONLINE ONLINE c1n4 STABLE
ora.net1.network
ONLINE ONLINE c1n1 STABLE
ONLINE ONLINE c1n2 STABLE
ONLINE ONLINE c1n3 STABLE
ONLINE ONLINE c1n4 STABLE
ora.ons
ONLINE ONLINE c1n1 STABLE
ONLINE ONLINE c1n2 STABLE
ONLINE ONLINE c1n3 STABLE
ONLINE ONLINE c1n4 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE c1n3 STABLE
2 ONLINE ONLINE c1n1 STABLE
3 ONLINE ONLINE c1n2 STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE c1n2 STABLE
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE c1n3 STABLE
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE c1n1 STABLE
ora.SUSEDEMO.dg(ora.asmgroup)
1 ONLINE ONLINE c1n3 STABLE
2 ONLINE ONLINE c1n1 STABLE
3 ONLINE ONLINE c1n2 STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE c1n3 Started,STABLE
2 ONLINE ONLINE c1n1 Started,STABLE
3 ONLINE ONLINE c1n2 Started,STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE c1n3 STABLE
2 ONLINE ONLINE c1n1 STABLE
3 ONLINE ONLINE c1n2 STABLE
ora.c1n1.vip
1 ONLINE ONLINE c1n1 STABLE
ora.c1n2.vip
1 ONLINE ONLINE c1n2 STABLE
ora.c1n3.vip
1 ONLINE ONLINE c1n3 STABLE
ora.c1n4.vip
1 ONLINE ONLINE c1n4 STABLE
ora.cvu
1 ONLINE ONLINE c1n1 STABLE
ora.qosmserver
1 ONLINE ONLINE c1n1 STABLE
ora.scan1.vip
1 ONLINE ONLINE c1n2 STABLE
ora.scan2.vip
1 ONLINE ONLINE c1n3 STABLE
ora.scan3.vip
59
1 ONLINE ONLINE c1n1 STABLE
ora.susedb.db
1 ONLINE ONLINE c1n1 Open,HOME=/home/orac
le/db_19c,STABLE
2 ONLINE ONLINE c1n2 Open,HOME=/home/orac
le/db_19c,STABLE
3 ONLINE ONLINE c1n3 Open,HOME=/home/orac
le/db_19c,STABLE
4 ONLINE ONLINE c1n4 Open,HOME=/home/orac
le/db_19c,STABLE
--------------------------------------------------------------------------------
60
2). Access to Oracle Enterprise Manager.
61
62
Additional Comments
This document provides some temporary solutions and brief instructions for Oracle Database 19c on
SLES 15 SP1.
• Oracle Prerequisite Checks Fixup Script is workaround for some CVU check failures.
• CVU Pre-installation Check Issue - "Verifying zeroconf check ...Warning". Please ignore this
error, a fix will be in the next distributed CVU.
• CVU Pre-installation Check Issue - Some packages are not applicable to sles15 SP1
63