pre-upgrade check for GI home

Pre-upgrade check tool

Syntax : runcluvfy.sh stage -pre crsinst -upgrade [-n ] [-rolling] -src_crshome -dest_crshome -dest_version [-fixup [-fixupdir]] [-verbose]

For example, to upgrade a 3-node Oracle Clusterware in /u01/app/11.1 to 11.2.0.3 in /u01/app/grid in
rolling fashion, execute the following:
$ runcluvfy.sh stage -pre crsinst -upgrade -n ,, - rolling -src_crshome /u01/app/11.1 -dest_crshome /u01/app/grid -dest_version 11.2.0.3.0 -fixup -fixupdir /tmp -verbose

Register listener manually on OCR

crs_stat -p ora.vm2.LISTENER_VM2.lsnr > /tmp/list

Modify relevent parameters on /tmp/list file after that register that profile on OCR

mv /tmp/list /tmp/ora.vm2.LISTENER_VM2_T.lsnr.cap
crs_register ora.vm2.LISTENER_VM2_T.lsnr -dir /tmp/
srvctl start listener -l LISTENER_VM2_T -n vm2

11gR2 RAC Tips

Configure User Equivalence :

Run below script from Grid Software location to configure user equivalance.

./sshUserSetup.sh -user grid -hosts "vm3 vm4" -advanced -noPromptPassphrase

Role Separation in 11gR2 RAC:

1.Creating groups and  Users for GI software.

$groupadd -g 1000 oinstall
$groupadd -g 1200 asmadmin
$groupadd -g 1201 asmdba
$groupadd -g 1202 asmoper

$useradd -m -u 1100 -g oinstall -G asmadmin,asmdba,asmoper -d /home/grid -S /bin/bash -c "GI Owner"  grid

Select below options while installing GI software.

ASM Database Administrator(OSDBA) group --> asmdba
ASM Instance Administration Operator (OSOPER) group --> asmoper
ASM Instance Administrator (OSASM) group --> asmadmin

2.Creating groups and  Users for Database software.
$groupadd -g 1300 dba
$groupadd -g 1301 oper

useradd -m -u 1101 -g oinstall -G dba,oper,asmdba -d /home/oracle -S /bin/bash -c "Database Owner"  oracle


select below options while installing oracle software

Database administrator (OSDBA)group --> dba
Database operator (OSOPER) group --> oper

Configure TAF

Configure  the server side failover parameters to the service:


srvctl add service -d car -s car-srv -r "car1,car2" -P BASIC --->10g

srvctl add service -d car -s car-srv -l PRIMARY -e SELECT -m BASIC -q TRUE -r car1,car2 -w 5 -z 180 -P BASIC --->11gR2

srvctl start service -d car -s car-srv

srvctl config service -d car

Configure Local_Listener and Remote_Listener parameters on db side.

Show parameter listener

Below statement only for 10g 

execute dbms_service.modify_service (service_name => 'car-srv' -
, aq_ha_notifications => true -
, failover_method => dbms_service.failover_method_basic -
, failover_type => dbms_service.failover_type_select -
, failover_retries => 180 -
, failover_delay => 5 -
, clb_goal => dbms_service.clb_goal_long);

Verify status:

select name, failover_method, failover_type, failover_retries,goal, clb_goal,aq_ha_notifications
from dba_services where service_id = 3

NAME METHOD TYPE RETRIES GOAL CLB_GOAL AQNOT
------ ----------- ---------- -------- ---------- -------- -----
car-srv BASIC SELECT 180 NONE LONG YES

Check Listener services:

lsnrctl services


Client side connect time failover :

This is done by tnsentry.Don't need update on db level.

CAR=
 (DESCRIPTION =
    (ADDRESS_LIST =
      (ADDRESS = (PROTOCOL = TCP)(HOST = vm1-vip.domain.com)(PORT = 1521))
      (ADDRESS = (PROTOCOL = TCP)(HOST = vm2.vip.domain.com)(PORT = 1521))
     )
    (LOAD_BALANCE=YES)
    (CONNECT_DATA =
      (SERVICE_NAME = car-srv)
      (FAILOVER_MODE =
       (TYPE=SELECT)
       (METHOD=BASIC)
      )
    )
  )

Virtual IP:

VIP address is public ip because it's attached with public ip interface. VIP is managd by oracle clusterware.
We should use vip instead of public ip .Because vip is doing Fast Failover.Private IP  won't visible from outside of server and it should not be used.

For ex: If we will public ip address and one of the rac node will be crased then the client will make a request to the node on the public IP and will wait for a TCP timeout (usually 60 seconds) before moving to the next host in the connection list.

If we will user vip ,the client does not have to wait for a TCP timeout to move to the next node in the connection list



Failover Method:

BASIC               :session will not reconnect to a surviving node until the failover occurs.
PRECONNECT :shadow process will be  created on a backup instance to reduce failover time.

Failover Type:

SELECT : session will be authenticated on a surviving node but as well as SELECT statements will be re-executed
Session    :  In a SESSION failover, only the users session will be  re-authenticated.

11gR2 TAF Example:

TAF is a client side features that allows clients to reconnect on surviving node in the event of failure on instance.Reconnect happens automatically from with in OCI library.
*Any uncommited transactions will be rolled back.
*Server side program variables and session properties will be lost
*The select statements automatically re-executed on the new connection with the cursor positioned on the row on which it was positioned prior to the failover.

srvctl add service -d ten -s tenpp -q TRUE -P BASIC -j LONG -e SELECT -m BASIC -z 5 -w 5 -r ten1,ten2

Options:
-d  db_unique name
-s  Service name
-r  preferred instances
-a available instances.specify available instances if preferred instances are not specified
-g Serverpool name
-c uniform,singleton
-p failover method (None,Basic,Preconnect)
-e fileover type(Session,Select,None)
-y specify service startup (Manaul,Automatic)
-j connection load balancing goal(Short,Long)
-B enable or disable load balancing advisory(none,service_time,throughput)
-m Failover method optin(none,basic)
-z specify number of times to attempt to connect after a failover (default 5 attempts)
-w Specify the amount of time in seconds to wait between connect attempts (default 1 sec)



[oracle@vm12 ~]$ srvctl config service -d ten -s tenpp
Service name: tenpp
Service is enabled
Server pool: ten_tenpp
Cardinality: 2
Disconnect: false
Service role: PRIMARY
Management policy: AUTOMATIC
DTP transaction: false
AQ HA notifications: true
Failover type: SELECT
Failover method: BASIC
TAF failover retries: 5
TAF failover delay: 5
Connection Load Balancing Goal: LONG
Runtime Load Balancing Goal: NONE
TAF policy specification: BASIC
Edition:
Preferred instances: ten1,ten2
Available instances:




 

PSU auto patch on 10g CRS_HOME

1.Opatch version should be earlier version (>11)
2.Configuare ocm.rsp file
     cd /u03/crs/OPatch/ocm/bin
   
      ls -lrt
     total 16
     -rwxr-----  1 oracrs oinstall 8486 Dec  7  2010 emocmrsp

    execute emocmrsp 

     ./emocmrsp

 [oracle@vm1 bin]$ ls -lrt

total 16

-rwxr-----  1 oracrs oinstall 8486 Dec  7  2010 emocmrsp

-rwxrwxr-x  1 oracrs oinstall  623 Nov 13 09:35 ocm.rsp

[oracle@vm1 bin]$

[root@vm1 9952245]# opatch auto /home/oracrs/psu/9952245 -oh /u03/crs

auto_patch.pl: log file is /home/oracrs/psu/9952245/opatchauto_2012-11-13_10:33:35.log

Discovering environment to patch

Checking if Clusterware is up

Looking for configured cluster nodes

vm1 vm2

Getting Local node name

Looking for configured databases on node vm1

Databases configured on node vm1 are: CAR

Determining ORACLE_HOME paths for configured databases

Retrieving configured services for Database CAR

There are 1 services configured for Database CAR

asm home is /u02/app/oracle/product/10.2.0/db_1

Oracle Home /u02/app/oracle/product/10.2.0/db_1 is configured with Database(s)-> CAR

opatch version is 11.2.0.1.4

/u03/crs/OPatch/opatch is bundled with OCM, Enter the absolute OCM response file path:

/u03/crs/OPatch/ocm/bin/ocm.rsp

Oracle CRS user is oracrs

Cluster nodes are vm1 vm2

Node to patch is vm1

Using /u03/crs/OPatch/opatch for opatch

The patch is applicable for this CRS Home /u03/crs

Patch node vm1? (y/n/abort/N/N1-N2/help):

y

Applying patch 9952245 on node vm1

 stopping instance on vm1 with /u02/app/oracle/product/10.2.0/db_1/bin/srvctl stop instance -d CAR -i CAR1

 stopping ASM on vm1 with /u03/crs/bin/srvctl stop asm -n vm1

 stopping listener on vm1 with /u03/crs/bin/srvctl stop listener -n vm1

 stopping nodeapps on vm1 with /u03/crs/bin/srvctl stop nodeapps -n vm1

 shutting  down CRS stack on vm1 with /u03/crs/bin/crsctl stop crs

Sleeping 15 second(s)

Failure 1 contacting CSS daemon

Cannot communicate with EVM

Cannot communicate with CRS

 Executing /home/oracrs/psu/9952245/custom/scripts/prerootpatch.sh -crshome /u03/crs -crsuser oracrs as root on vm1

 Executing /home/oracrs/psu/9952245/custom/scripts/prepatch.sh -crshome /u03/crs as oracrs on vm1

 Executing /u03/crs/OPatch/opatch napply -local -silent -ocmrf /u03/crs/OPatch/ocm/bin/ocm.rsp -oh /u03/crs -id 9952245 as oracrs on vm1

 Executing /home/oracrs/psu/9952245/custom/scripts/postpatch.sh -crshome /u03/crs as oracrs on vm1

 Executing /home/oracrs/psu/9952245/custom/scripts/postrootpatch.sh -crshome /u03/crs as root on vm1

 Starting services for CAR on vm1

List of patched nodes:  vm1

auto_patch.pl finished

Errors & Workarounds:

Error 1:

Using /u03/crs/OPatch/opatch for opatch

Failed to load the patch object.  Possible causes are:

  The specified path is not an interim Patch shiphome

  Meta-data files are missing from the patch area

  Patch location = /home/oracrs/psu

  Details = Input metadata files are missing.

.....

 Executing /home/oracrs/psu/custom/scripts/prerootpatch.sh -crshome /u03/crs -crsuser oracrs as root on vm1

verify failure: exit code 32512 for prerootpatch_crs

Action failed, do you want to retry it? (y/n/abort/N/N1-N2/help):

Solution:

         Unzipped patch location should be vaild location

 

Invalid Path: /home/oracrs/psu

 

Valid Path : /home/oracrs/psu/9952245

 

Error 2:

 Executing /u03/crs/OPatch/opatch napply -local -silent -ocmrf /u03/crs/OPatch/ocm/bin/ocm.rsp -oh /u03/crs -id 9952245 as oracrs on vm1

verify failure: exit code 18688 for patch_crs

Action failed, do you want to retry it? (y/n/abort/N/N1-N2/help):

Solution :

          Required amount of space(557321672) is not available.

         CRS_HOME free space should be >600mb

 

Failure at final check of Oracle CRS stack.10

Issue:

root.sh is failed with below on node2

Failure at final check of Oracle CRS stack.10

Workaround:

Please verify network configuration on /etc/hosts

/u03/app/crs/jdk/jre//bin/java: error while loading shared libraries: libpthread.so.0: cannot open shared object file: No such file or directory

Issue :
root.sh failed with below errors

Running vipca(silent) for configuring nodeapps
/u03/app/crs/jdk/jre//bin/java: error while loading shared libraries: libpthread.so.0: cannot open shared object file: No such file or directory
[root@vm12 crs]# ls

Workaround :

Modify vipca file:

vi /u03/app/crs/vipca

if [ "$arch" = "i686" -o "$arch" = "ia64" ]
then
      LD_ASSUME_KERNEL=2.4.19
      export LD_ASSUME_KERNEL
fi
unset LD_ASSUME_KERNEL
#End workaround

Modify srvctl:

vi /u03/app/crs/srvctl


./vipca
Error 0(Native: listNetInterfaces:[3])
  [Error 0(Native: listNetInterfaces:[3])]

 Workaround :

./oifcfg getif
./oifcfg setif -global eth0/192.168.0.0:public
./oifcfg setif -global eth1/192.168.1.0:cluster_interconnect
[root@vm12 bin]# ./oifcfg getif
eth0  192.168.0.0  global  public
eth1  192.168.1.0  global  cluster_interconnect

How to apply psu patch on GI HOME using auto option?

[root@vm14 psu]# export PATH=/u01/app/11.2.0/grid/OPatch/:$PATH
[root@vm14 psu]# export GRID_HOME=/u01/app/11.2.0/grid
[root@vm14 psu]# opatch version

OPatch Version: 11.2.0.1.9

OPatch succeeded.
[root@vm14 oracle]# opatch auto /home/oracle/psu -oh /u01/app/11.2.0/grid

Executing /usr/bin/perl /u01/app/11.2.0/grid/OPatch/crs/patch112.pl -patchdir /home/oracle -patchn psu -oh /u01/app/11.2.0/grid -paramfile /u01/app/11.2.0/grid/crs/install/crsconfig_params
opatch auto log file location is /u01/app/11.2.0/grid/OPatch/crs/../../cfgtoollogs/opatchauto2012-02-29_09-38-06.log
Detected Oracle Clusterware install
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
OPatch is bundled with OCM, Enter the absolute OCM response file path:
/u01/app/11.2.0/grid/OPatch/ocm/bin/ocm.rsp
Successfully unlock /u01/app/11.2.0/grid

patch /home/oracle/psu/13653086 apply successful for home /u01/app/11.2.0/grid
patch /home/oracle/psu/13343424 apply successful for home /u01/app/11.2.0/grid
ACFS-9300: ADVM/ACFS distribution files found.
ACFS-9312: Existing ADVM/ACFS installation detected.
ACFS-9314: Removing previous ADVM/ACFS installation.
ACFS-9315: Previous ADVM/ACFS components successfully removed.
ACFS-9307: Installing requested ADVM/ACFS software.
ACFS-9308: Loading installed ADVM/ACFS drivers.
ACFS-9321: Creating udev for ADVM/ACFS.
ACFS-9323: Creating module dependencies - this may take some time.
ACFS-9327: Verifying ADVM/ACFS devices.
ACFS-9309: ADVM/ACFS installation correctness verified.
CRS-4123: Oracle High Availability Services has been started.

Install ASM lib on Linux 5

[root@vm14 ~]# rpm -Uvh oracleasm-support-2.1.7-1.el5.i386.rpm
warning: oracleasm-support-2.1.7-1.el5.i386.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159
Preparing... ########################################### [100%]
1:oracleasm-support ########################################### [100%]
[root@vm14 ~]# rpm -Uvh oracleasm-2.6.18-8.el5xen-2.0.4-1.el5.i686
error: open of oracleasm-2.6.18-8.el5xen-2.0.4-1.el5.i686 failed: No such file or directory
[root@vm14 ~]# rpm -Uvh oracleasm-2.6.18-8.el5xen-2.0.4-1.el5.i686*
Preparing... ########################################### [100%]
1:oracleasm-2.6.18-8.el5x########################################### [100%]
[root@vm14 ~]# rpm -Uvh oracleasmlib-2.0.4-1.el5.i386.rpm
warning: oracleasmlib-2.0.4-1.el5.i386.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159
Preparing... ########################################### [100%]
1:oracleasmlib ########################################### [100%]
[root@vm14 ~]#

11gR2 RAC Commands

[oracle@vm14 ~]$ crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online


[oracle@vm14 ~]$ oifcfg getif
eth1 192.168.1.0 global cluster_interconnect
eth0 192.168.0.0 global public
[oracle@vm14 ~]$ oifcfg delif -global eth1
[oracle@vm14 ~]$ oifcfg setif -global eth1/192.168.1.0:cluster_interconnect
[oracle@vm14 ~]$ oifcfg getif
eth0 192.168.0.0 global public
eth1 192.168.1.0 global cluster_interconnect



[oracle@vm14 admin]$ crsctl check cluster
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
[oracle@vm14 admin]$ crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online


[oracle@vm14 admin]$ crsctl check cluster -all
**************************************************************
vm14:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************


[oracle@vm14 admin]$ crsctl check ctss
CRS-4701: The Cluster Time Synchronization Service is in Active mode.
CRS-4702: Offset (in msec): 0

[root@vm14 bin]# ./crsctl config crs
CRS-4622: Oracle High Availability Services autostart is enabled.
[root@vm14 bin]#


[oracle@vm14 ~]$ crsctl get css
Usage:
crsctl get css
Displays the value of a Cluster Synchronization Services parameter

clusterguid
diagwait
disktimeout
misscount
reboottime
priority
logfilesize

crsctl get css ipmiaddr
Displays the IP address of the local IPMI device as set in the Oracle registry.
[oracle@vm14 ~]$ crsctl get css clusterguid
33ff95a9853c4f4afff46ad27062d6b6

[oracle@vm14 ~]$ crsctl get nodename
vm14
[oracle@vm14 ~]$


[oracle@vm14 ~]$ crsctl query crs administrator
CRS Administrator List: *
[oracle@vm14 ~]$ crsctl query crs activeversion
Oracle Clusterware active version on the cluster is [11.2.0.1.0]
[oracle@vm14 ~]$ crsctl query crs releaseversion
Oracle High Availability Services release version on the local node is [11.2.0.1.0]
[oracle@vm14 ~]$ crsctl query crs softwareversion
Oracle Clusterware version on node [vm14] is [11.2.0.1.0]
[oracle@vm14 ~]$ crsctl query css votedisk
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE 02b2f2c970c74f4ebfe416312bb22451 (ORCL:DISK1) [DATA_OCRVOTE]
Located 1 voting disk(s).
[oracle@vm14 ~]$ crsctl query css ipmidevice
CRS-4218: IPMI device not found

[oracle@vm14 ~]$ crsctl status server
NAME=vm14
STATE=ONLINE

[oracle@vm14 ~]$ crsctl status serverpool
NAME=Free
ACTIVE_SERVERS=vm14

NAME=Generic
ACTIVE_SERVERS=



srvctl add service -d RAC -s rac_srv -P BASIC -e SELECT -r "RAC1" -a "RAC2"

How to install CRS in silent option?

[oracle@vm1 Disk1]$ ./runInstaller -silent \
> -responseFile /home/oracle/Disk1/response/patchset.rsp \
> ORACLE_HOME="/u02/crs/oracle/product/10.2.0/crs" \
> ORACLE_HOME_NAME="OraCrs10g_home"
Starting Oracle Universal Installer...

Checking installer requirements...

Checking operating system version: must be redhat-3, SuSE-9, SuSE-10, redhat-4, redhat-5, redhat-6, UnitedLinux-1.0, asianux-1, asianux-2, asianux-3, enterprise-4, enterprise-5 or SuSE-11
Passed


All installer requirements met.

Preparing to launch Oracle Universal Installer from /tmp/OraInstall2011-10-11_01-43-39PM. Please wait ...[oracle@vm1 Disk1]$ Oracle Universal Installer, Version 10.2.0.5.0 Production
Copyright (C) 1999, 2010, Oracle. All rights reserved.

You can find a log of this install session at:
/u02/app/oracle/oraInventory/logs/installActions2011-10-11_01-43-39PM.log
.................................................................................................... 100% Done.


Loading Product Information
................................................................................................................. 100% Done.


Performing tests to see whether nodes vm2 are available
............................................................... 100% Done.


Starting execution of Prerequisites...
Total No of checks: 9

Performing check for Detect10.2CRS
Checking Oracle Clusterware version ...
Check complete. The overall result of this check is: Passed


Check complete: Passed
=======================================================================
Performing check for CertifiedVersions
Checking operating system requirements ...
Expected result: One of redhat-6,redhat-5,redhat-4,redhat-3,SuSE-11,SuSE-10,SuSE-9,asianux-3,asianux-2,asianux-1
Actual Result: redhat-4
Check complete. The overall result of this check is: Passed


Check complete: Passed
=======================================================================
Performing check for Packages
Checking operating system package requirements ...
Checking for make-3.79; found make-1:3.80-5. Passed
Checking for binutils-2.14; found binutils-2.15.92.0.2-10.EL4. Passed
Checking for gcc-3.2; found gcc-3.4.3-9.EL4. Passed
Checking for libaio-0.3.96; found libaio-0.3.102-1. Passed
Checking for libstdc++-3.2.3; found libstdc++-3.4.3-9.EL4. Passed
Check complete. The overall result of this check is: Passed


Check complete: Passed
=======================================================================
Performing check for Kernel
Checking kernel parameters
Checking for semmsl=250; found semmsl=250. Passed
Checking for semmns=32000; found semmns=32000. Passed
Checking for semopm=100; found semopm=100. Passed
Checking for semmni=128; found semmni=128. Passed
Checking for shmmax=536870912; found shmmax=2147483648. Passed
Checking for shmmni=4096; found shmmni=4096. Passed
Checking for shmall=2097152; found shmall=2097152. Passed
Checking for file-max=65536; found file-max=65536. Passed
Checking for VERSION=2.6.9; found VERSION=2.6.9-5.EL. Passed
Checking for ip_local_port_range=1024 - 65000; found ip_local_port_range=1024 - 65000. Passed
Checking for rmem_default=262144; found rmem_default=524288. Passed
Checking for rmem_max=262144; found rmem_max=16777216. Passed
Checking for wmem_default=262144; found wmem_default=524288. Passed
Checking for wmem_max=262144; found wmem_max=16777216. Passed
Check complete. The overall result of this check is: Passed


Check complete: Passed
=======================================================================
Performing check for GLIBC
Checking Recommended glibc version
Expected result: ATLEAST=2.3.2-95.27 NOT_EQUALS=2.3.4-2.39
Actual Result: 2.3.4-2
Check complete. The overall result of this check is: Passed


Check complete: Passed
=======================================================================
Performing check for TotalMemory
Checking physical memory requirements ...
Expected result: 922MB
Actual Result: 484MB
Check complete. The overall result of this check is: Failed <<<<


Check complete: Failed <<<<
Problem: The system does not have sufficient physical memory to perform the install.
Recommendation: Increase the amount of physical memory available to your system before continuing with the installation.

=======================================================================
Performing check for SwapSpace
Checking available swap space requirements ...
Expected result: 968MB
Actual Result: 1076MB
Check complete. The overall result of this check is: Passed


Check complete: Passed
=======================================================================
Performing check for checkToInstallCCR
Checking the Components installed in Oracle Home
Check complete. The overall result of this check is: Passed


Check complete: Passed
=======================================================================
Performing check for CompatibilityChecks
Checking for Oracle Home incompatibilities ...
Check complete. The overall result of this check is: Passed


Check complete: Passed
=======================================================================
PrereqChecks complete


Analyzing dependencies
...................................................................................................... 100% Done.


-----------------------------------------------------------------------------
Summary
Global Settings
Source: /home/oracle/Disk1/stage/products.xml
Oracle Home: /u02/crs/oracle/product/10.2.0/crs (OraCrs10g_home)
Node Name: vm1
Node Name: vm2
Product Languages
English
Space Requirements
/ Required 62MB (includes 29MB temporary) : Available 3.96GB
Remote Nodes
vm2
/: Required 32MB : Available 12.37GB
New Installations (4 products)
Enterprise Manager Minimal Integration 10.2.0.5.0
Parser Generator Required Support Files 10.2.0.5.0
Buildtools Common Files 10.2.0.5.0
Bali Share 1.1.19.0.0
Upgrades (23 products)
Oracle Notification Service Patch 10.2.0.5.0
Oracle Clusterware Patch 10.2.0.5.0
HAS Common Files Patch 10.2.0.5.0
Cluster Ready Services Files Patch 10.2.0.5.0
Oracle Clusterware RDBMS Files Patch 10.2.0.5.0
Oracle Net Required Support Files Patch 10.2.0.5.0
XDK Required Support Files Patch 10.2.0.5.0
Agent Required Support Files Patch 10.2.0.5.0
DBJAVA Required Support Files Patch 10.2.0.5.0
LDAP Required Support Files Patch 10.2.0.5.0
Precompiler Required Support Files Patch 10.2.0.5.0
Oracle RAC Required Support Files-HAS Patch 10.2.0.5.0
RDBMS Required Support Files for Instant Client Patch 10.2.0.5.0
RDBMS Required Support Files Patch 10.2.0.5.0
SQL*Plus Required Support Files Patch 10.2.0.5.0
SSL Required Support Files for InstantClient Patch 10.2.0.5.0
Oracle Globalization Support Patch 10.2.0.5.0
Oracle Core Required Support Files Patch 10.2.0.5.0
Platform Required Support Files 10.2.0.5.0
Oracle Universal Installer 10.2.0.5.0
Oracle One-Off Patch Installer 10.2.0.4.2
Installer SDK Component 10.2.0.5.0
Sun JDK 1.4.2.14.05
Already Installed (24 products)
Oracle Notification Service 10.1.0.3.0
Oracle Clusterware 10.2.0.1.0
HAS Common Files 10.2.0.1.0
Cluster Ready Services Files 10.2.0.1.0
Oracle Clusterware RDBMS Files 10.2.0.1.0
Oracle Net Required Support Files 10.2.0.1.0
XDK Required Support Files 10.2.0.1.0
Agent Required Support Files 10.2.0.1.0
DBJAVA Required Support Files 10.2.0.1.0
LDAP Required Support Files 10.2.0.1.0
Precompiler Required Support Files 10.2.0.1.0
Oracle RAC Required Support Files-HAS 10.2.0.1.0
RDBMS Required Support Files for Instant Client 10.2.0.1.0
RDBMS Required Support Files 10.2.0.1.0
SQL*Plus Required Support Files 10.2.0.1.0
SSL Required Support Files for InstantClient 10.2.0.1.0
Oracle Globalization Support 10.2.0.1.0
Oracle Core Required Support Files 10.2.0.1.0
Platform Required Support Files 10.2.0.1.0
Enterprise Manager Minimal Integration 10.2.0.1.0
Parser Generator Required Support Files 10.2.0.1.0
Buildtools Common Files 10.2.0.1.0
Bali Share 1.1.18.0.0
Java Runtime Environment 1.4.2.14.0
-----------------------------------------------------------------------------


Deinstall in progress (Tuesday, October 11, 2011 1:44:15 PM IST)
............................................................... 0% Done.
............................................................... 25% Done.
............................................................... 50% Done.
.............................................................. 100% Done.

Deinstall successful

Installation in progress (Tuesday, October 11, 2011 1:44:16 PM IST)
............................................................... 25% Done.
................................................. 44% Done.
Install successful

Linking in progress (Tuesday, October 11, 2011 1:45:37 PM IST)
.. 45% Done.
Link successful

Setup in progress (Tuesday, October 11, 2011 1:45:37 PM IST)
. 45% Done.
Setup successful

Remote operations in progress (Tuesday, October 11, 2011 1:45:42 PM IST)
............................................................... 70% Done.
.................. 100% Done.
Remote operations complete

End of install phases.(Tuesday, October 11, 2011 1:47:25 PM IST)
The installation of Oracle Database 10g Release 2 Patch Set 4 was successful.
Please check '/u02/app/oracle/oraInventory/logs/silentInstall2011-10-11_01-43-39PM.log' for more details.

[oracle@vm1 Disk1]$

How to upgrade CRS from 10g to 11gR1?

Step 1:

[root@vm1 upgrade]# ./preupdate.sh -crshome /u02/crs/oracle/product/10.2.0/crs -crsuser oracle
Shutting down Oracle Cluster Ready Services (CRS):
Jan 19 03:22:00.079 | INF | daemon shutting down
Stopping resources. This could take several minutes.
Successfully stopped CRS resources.
Stopping CSSD.
Shutting down CSS daemon.
Shutdown request successfully issued.
Shutdown has begun. The daemons should exit soon.
Checking to see if Oracle CRS stack is down...
Oracle CRS stack is down now.


[root@vm2 oracle]# ./preupdate.sh -crshome /u02/crs/oracle/product/10.2.0/crs -crsuser oracle
Shutting down Oracle Cluster Ready Services (CRS):
Jan 22 20:47:48.862 | INF | daemon shutting down
Stopping resources. This could take several minutes.
Successfully stopped CRS resources.
Stopping CSSD.
Shutting down CSS daemon.
Shutdown request successfully issued.
Shutdown has begun. The daemons should exit soon.
Checking to see if Oracle CRS stack is down...
Oracle CRS stack is down now.
[root@vm2 oracle]#

Step 3:

Execute runinstaller command from CRS software.

Step 4:

end of installation execute rootupgrade script

[root@vm1 logs]# /u02/crs/oracle/product/10.2.0/crs/install/rootupgrade
Checking to see if Oracle CRS stack is already up...

copying ONS config file to 11.1 CRS home
/bin/cp: `/u02/crs/oracle/product/10.2.0/crs/opmn/conf/ons.config' and `/u02/crs/oracle/product/10.2.0/crs/opmn/conf/ons.config' are the same file
/u02/crs/oracle/product/10.2.0/crs/opmn/conf/ons.config was copied successfully to /u02/crs/oracle/product/10.2.0/crs/opmn/conf/ons.config
WARNING: directory '/u02/crs/oracle/product/10.2.0' is not owned by root
WARNING: directory '/u02/crs/oracle/product' is not owned by root
WARNING: directory '/u02/crs/oracle' is not owned by root
WARNING: directory '/u02/crs' is not owned by root
WARNING: directory '/u02' is not owned by root
Oracle Cluster Registry configuration upgraded successfully
Adding daemons to inittab
Attempting to start Oracle Clusterware stack
Waiting for Cluster Synchronization Services daemon to start
Waiting for Cluster Synchronization Services daemon to start
Waiting for Cluster Synchronization Services daemon to start
Waiting for Cluster Synchronization Services daemon to start
Cluster Synchronization Services daemon has started
Waiting for Event Manager daemon to start
Event Manager daemon has started
Waiting for Cluster Ready Services daemon to start
Cluster Ready Services daemon has started
Oracle CRS stack is running under init(1M)
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10G Release 2.
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node :
node 1: vm1 vm1-priv vm1
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
clscfg -upgrade completed successfully
CRS stack on this node, is successfully upgraded to 11.1.0.6.0
Checking the existence of nodeapps on this node
Creating '/u02/crs/oracle/product/10.2.0/crs/install/paramfile.crs' with data used for CRS configuration
Setting CRS configuration values in /u02/crs/oracle/product/10.2.0/crs/install/paramfile.crs




[root@vm2 oracle]# /u02/crs/oracle/product/10.2.0/crs/install/rootupgrade
Checking to see if Oracle CRS stack is already up...

copying ONS config file to 11.1 CRS home
/bin/cp: `/u02/crs/oracle/product/10.2.0/crs/opmn/conf/ons.config' and `/u02/crs/oracle/product/10.2.0/crs/opmn/conf/ons.config' are the same file
/u02/crs/oracle/product/10.2.0/crs/opmn/conf/ons.config was copied successfully to /u02/crs/oracle/product/10.2.0/crs/opmn/conf/ons.config
WARNING: directory '/u02/crs/oracle/product/10.2.0' is not owned by root
WARNING: directory '/u02/crs/oracle/product' is not owned by root
WARNING: directory '/u02/crs/oracle' is not owned by root
WARNING: directory '/u02/crs' is not owned by root
WARNING: directory '/u02' is not owned by root
Oracle Cluster Registry configuration upgraded successfully
Adding daemons to inittab
Attempting to start Oracle Clusterware stack
Waiting for Cluster Synchronization Services daemon to start
Waiting for Cluster Synchronization Services daemon to start
Waiting for Cluster Synchronization Services daemon to start
Waiting for Cluster Synchronization Services daemon to start
Cluster Synchronization Services daemon has started
Waiting for Event Manager daemon to start
Event Manager daemon has started
Cluster Ready Services daemon has started
Oracle CRS stack is running under init(1M)
clscfg: EXISTING configuration version 4 detected.
clscfg: version 4 is 11 Release 1.
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node :
node 2: vm2 vm2-priv vm2
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
clscfg -upgrade completed successfully
CRS stack on this node, is successfully upgraded to 11.1.0.6.0
Checking the existence of nodeapps on this node
Creating '/u02/crs/oracle/product/10.2.0/crs/install/paramfile.crs' with data used for CRS configuration
Setting CRS configuration values in /u02/crs/oracle/product/10.2.0/crs/install/paramfile.crs
[root@vm2 oracle]#

How to change Virtual IP address on Oracle RAC..

[root@vm12 ~]# cd /u02/app/oracle/product/10.2.0/crs/bin/

[root@vm12 bin]# srvctl modify nodeapps -n vm11 -A 192.168.0.151/255.255.255.0/eth0

[root@vm12 bin]# ./srvctl stop nodeapps -n vm12
CRS-0210: Could not find resource 'ora.vm12.LISTENER_VM12.lsnr'.

[root@vm12 bin]# ./srvctl config nodeapps -n vm12 -a
VIP exists.: /vm12-priv.domain.com/192.168.1.52/255.255.255.0/eth0:eth1

[root@vm12 bin]# ./srvctl modify nodeapps -n vm12 -A 192.168.0.152/255.255.255.0/eth0

[root@vm12 bin]# ./srvctl config nodeapps -n vm12 -a
VIP exists.: /vm12-vip.domain.com/192.168.0.152/255.255.255.0/eth0

[root@vm12 bin]# ./crsctl start crs
Attempting to start CRS stack
The CRS stack will be started shortly

Applying 10.2.0.4 CRS Patchset to a 10.2.0.1

Applying 10.2.0.4 CRS Patchset to a 10.2.0.1:

First Check clusterware verion.
[root@vm2 bin]# ./crsctl query crs activeversion
CRS active version on the cluster is [10.2.0.1.0]

Then Stop all database resources
Shutdown database instances, ASM instances, Listener etc..

Download 10.2.0.4 patchset from Metalink.

./runInstaller

Select CRS_HOME path






To complete the installation of this patchset, you must perform the following tasks on each node:

1. Log in as the root user.
2. As the root user, perform the following tasks:

a. Shutdown the CRS daemons by issuing the following command:
/u04/crs/oracle/product/10.2.0/crs/bin/crsctl stop crs
b. Run the shell script located at:
/u04/crs/oracle/product/10.2.0/crs/install/root102.sh
This script will automatically start the CRS daemons on the
patched node upon completion.

3. After completing this procedure, proceed to the next node and repeat.



Node1:

[root@vm1 bin]# ./crsctl stop crs
Stopping resources.
Successfully stopped CRS resources
Stopping CSSD.
Shutting down CSS daemon.
Shutdown request successfully issued.
[root@vm1 bin]# cd ..
[root@vm1 crs]# cd install
[root@vm1 install]# ./root102.sh
Creating pre-patch directory for saving pre-patch clusterware files
Completed patching clusterware files to /u04/crs/oracle/product/10.2.0/crs
Relinking some shared libraries.
Relinking of patched files is complete.
WARNING: directory '/u04/crs/oracle/product/10.2.0' is not owned by root
WARNING: directory '/u04/crs/oracle/product' is not owned by root
WARNING: directory '/u04/crs/oracle' is not owned by root
WARNING: directory '/u04/crs' is not owned by root
WARNING: directory '/u04' is not owned by root
Preparing to recopy patched init and RC scripts.
Recopying init and RC scripts.
Startup will be queued to init within 30 seconds.
Starting up the CRS daemons.
Waiting for the patched CRS daemons to start.
This may take a while on some systems.
.
10204 patch successfully applied.
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10G Release 2.
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node :
node 1: vm1 vm1-priv vm1
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
clscfg -upgrade completed successfully
[root@vm1 install]# cd ../bin
You have new mail in /var/spool/mail/root
[root@vm1 bin]# ./crsctl query crs activeversion
CRS active version on the cluster is [10.2.0.4.0]

Node2:

[root@vm2 bin]# ./crsctl stop crs
Stopping resources.
Successfully stopped CRS resources
Stopping CSSD.
Shutting down CSS daemon.
Shutdown request successfully issued.
[root@vm2 bin]# cd ..
[root@vm2 crs]# cd install
[root@vm2 install]# ./root102.sh
Creating pre-patch directory for saving pre-patch clusterware files
Completed patching clusterware files to /u04/crs/oracle/product/10.2.0/crs
Relinking some shared libraries.
Relinking of patched files is complete.
WARNING: directory '/u04/crs/oracle/product/10.2.0' is not owned by root
WARNING: directory '/u04/crs/oracle/product' is not owned by root
WARNING: directory '/u04/crs/oracle' is not owned by root
WARNING: directory '/u04/crs' is not owned by root
WARNING: directory '/u04' is not owned by root
Preparing to recopy patched init and RC scripts.
Recopying init and RC scripts.
Startup will be queued to init within 30 seconds.
Starting up the CRS daemons.
Waiting for the patched CRS daemons to start.
This may take a while on some systems.
.
10204 patch successfully applied.
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10G Release 2.
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node :
node 2: vm2 vm2-priv vm2
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
clscfg -upgrade completed successfully

[root@vm2 bin]# ./crsctl query crs activeversion
CRS active version on the cluster is [10.2.0.4.0]
[root@vm2 bin]#