Grid Upgrade& PSU Patch Steps - 21-08-14

6:36 AM 8/21/2014
Steps to Aplly PSU patch :
https://nadeemmohammed.wordpress.com/2012/03/13/list-of-oracle-database-patch-set-
updates-psu/
http://www.pythian.com/blog/rdbms-online-patching/
Pre checks :
1. to Apply patch the base version should be 11.2.0.3.6
if the Grid home and oracle home is under the version means we need to update the
patch version first.
2.take the backup of Optach fole
1.$GRID_HOME/OPatch/ocm/bin/emocmrsp
2./u01/app/oracle/product/11.2.0.4/grid/OPatch/opatch auto
/u01/app/oracle/software/11204-psu -oh /u01/app/oracle/product/11.2.0.4/db1
-ocmrf /u01/app/oracle/product/11.2.0.4/grid/OPatch/ocm.rsp
<<Grid Home>> <<PSU Location>>

<<Grid Home>> <<Grid Home>>
3./u01/app/oracle/product/11.2.0.4/grid/OPatch/opatch auto
/u01/app/oracle/software/11204-psu -oh /u01/app/oracle/product/11.2.0.4/grid -ocmrf
/u01/app/oracle/product/11.2.0.4/grid/OPatch/ocm.rsp
4.Start the DB and run catbundle.sql script
[oracle] :/home/oracle PENTDEV> cd /u01/app/oracle/product/11.2.0.4/db/rdbms/admin/

[oracle] :/u01/app/oracle/product/11.2.0.4/db/rdbms/admin PENTDEV> sqlplus
SQL*Plus: Release 11.2.0.4.0 Production on Thu Aug 21 10:12:14 2014
Copyright (c) 1982, 2013, Oracle. All rights reserved.
Enter user-name: / as sysdba

Connected to an idle instance.
SQL> startup
ORACLE instance started.
Total System Global Area 3340451840 bytes

Fixed Size 2257840 bytes
Variable Size 1828719696 bytes
Database Buffers 1493172224 bytes
Redo Buffers 16302080 bytes
Database mounted.
Database opened.
SQL> @catbundle.sql psu apply
PL/SQL procedure successfully completed.
Generating apply and rollback scripts...

Check the following file for errors:
/
u01/app/oracle/cfgtoollogs/catbundle/catbundle_PSU_PENTDEV_GENERATE_2014Aug21_10_13
_06.log
Apply script:
/u01/app/oracle/product/11.2.0.4/db/rdbms/admin/catbundle_PSU_PENTDEV_APPLY.sql
Rollback script:
/u01/app/oracle/product/11.2.0.4/db/rdbms/admin/catbundle_PSU_PENTDEV_ROLLBACK.sql
Executing script file...
SQL> COLUMN spool_file NEW_VALUE spool_file NOPRINT

SQL> SELECT '/u01/app/oracle/cfgtoollogs/catbundle/' || 'catbundle_PSU_' || name ||
'_APPLY_' || TO_CHAR(SYSDATE, 'YYYYMonDD_hh24_mi_ss',
'NLS_DATE_LANGUAGE=''AMERICAN''') || '.log' AS spool_file FROM v$database;
SQL> SPOOL &spool_file

SQL> exec dbms_registry.set_session_namespace('SERVER')
SQL> PROMPT Skipping Spatial because it is not installed or versions mismatch...

Skipping Spatial because it is not installed or versions mismatch...
SQL> ALTER SESSION SET current_schema = SYS;
Session altered.
SQL> PROMPT Updating registry...

Updating registry...
SQL> INSERT INTO registry$history
2 (action_time, action,
3 namespace, version, id,
4 bundle_series, comments)
5 VALUES
6 (SYSTIMESTAMP, 'APPLY',
7 SYS_CONTEXT('REGISTRY$CTX','NAMESPACE'),
8 '11.2.0.4',
9 1,
10 'PSU',
11 'PSU 11.2.0.4.1');
1 row created.
SQL> COMMIT;
Commit complete.
SQL> SPOOL off

SQL> SET echo off
Check the following log file for errors:
/
u01/app/oracle/cfgtoollogs/catbundle/catbundle_PSU_PENTDEV_APPLY_2014Aug21_10_13_07
.log
/u01/app/11.2.0.4/grid/OPatch/ocm/bin/emocmrsp
/u01/app/oracle/product/11.2.0.4/db_1/OPatch/opatch auto /u01/app/oracle/11204-psu

-oh /u01/app/oracle/product/11.2.0.4/db_1 -ocmrf
/u01/app/11.2.0.4/grid/OPatch/ocm.rsp
-------------------------------------
Clufy check :
./runcluvfy.sh stage -pre crsinst -upgrade -n ndwetldb-wc-a1p,ndwetldb-wc-a2p

-rolling -src_crshome /u01/app/grid -dest_crshome /u01/app/grid/11.2.0.4
-dest_version 11.2.0.4.0 -verbose
Apply patch :
/u01/app/oracle/product/11.2.0.4/db2/OPatch/opatch apply -oh

/u01/app/oracle/product/11.2.0.4/db2 -local
Online patch :
cramdb-dt-04d:(icrmdt3)/u01/app/oracle/product/11.2.0.3/OPatch > export

PATH=$PATH:/u01/app/oracle/product/11.2.0.3/OPatch/
cramdb-dt-04d:(icrmdt3)/u01/app/oracle/product/11.2.0.3/OPatch > echo $PATH
/
u01/app/oracle/product/11.2.0.3/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:
/u01/app/oracle/product/11.2.0.3/OPatch/
cramdb-dt-04d:(icrmdt3)/u01/app/oracle/product/11.2.0.3/OPatch > cd
/home/oracle/13903578
cramdb-dt-04d:(icrmdt3)/home/oracle/13903578 >
OPatch failed with error code 36

cramdb-dt-04d:(icrmdt3)/home/oracle/13903578 > opatch apply online -connectString
icrmdt3:sys:c0mcast!
Oracle Interim Patch Installer version 11.2.0.3.4
Copyright (c) 2012, Oracle Corporation. All rights reserved.
Oracle Home : /u01/app/oracle/product/11.2.0.3

Central Inventory : /u01/app/oraInventory
from : /u01/app/oracle/product/11.2.0.3/oraInst.loc
OPatch version : 11.2.0.3.4
OUI version : 11.2.0.3.0
Log file location :
/u01/app/oracle/product/11.2.0.3/cfgtoollogs/opatch/13903578_Nov_18_2014_08_15_45/a
pply2014-11-18_08-15-45AM_1.log
The patch should be applied/rolled back in '-all_nodes' mode only.

Converting the RAC mode to '-all_nodes' mode.
Applying interim patch '13903578' to OH '/u01/app/oracle/product/11.2.0.3'
Verifying environment and performing prerequisite checks...
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Y
Backing up files...
Patching component oracle.rdbms, 11.2.0.3.0...

Installing and enabling the online patch 'bug13903578.pch', on database 'icrmdt3'.
Verifying the update...

Patch 13903578 successfully applied
Log file location:
/u01/app/oracle/product/11.2.0.3/cfgtoollogs/opatch/13903578_Nov_18_2014_08_15_45/a
pply2014-11-18_08-15-45AM_1.log
OPatch succeeded.
Syntax :
Install the patch by running the following command:

- For Non-RAC Environments (Standalone Databases):
$ opatch apply online -connectString <SID>:<USERNAME>:<PASSWORD>:
- For RAC Environments:
$ opatch apply online -connectString
<SID_Node1>:<Username_Node1>:<Password_Node1>:<Node1_Name>,<SID_Node2>:<Username_No
de2>:<Password_Node2>:<Node2_Name>,<SID_NodeN>:<Username_NodeN>:<Password_NodeN>:<N
odeN_Name>
Host :
cramdb-dt-04d.ula.comcast.net
Patch path: /home/oracle/13903578
opatch apply online -connectString ttsstg1:sys:sys:ttsxd01-dt-

db01,ttsstg2:sys:sys:ttsxd01-dt-db02
===================================================================================
==============================================================================
Rollback :
[oracle@ttsxd02-po-db01 14034426]$ opatch rollback -id 14034426 -connectString

ttslprd1:sys:sys:ttsxd02-po-db01,ttslprd2:sys:sys:ttsxd02-po-
db02,ttslprd3:sys:sys:ttsxd02-po-db03,ttslprd4:sys:sys:ttsxd02-po-db04
Oracle Home : /u01/app/oracle/product/11.2.0.3/dbhome_1

from : /u01/app/oracle/product/11.2.0.3/dbhome_1/oraInst.loc
Log file location :
/u01/app/oracle/product/11.2.0.3/dbhome_1/cfgtoollogs/opatch/14034426_Dec_16_2014_0
3_45_31/rollback2014-12-16_03-45-31AM_1.log
RollbackSession rolling back interim patch '14034426' from OH

'/u01/app/oracle/product/11.2.0.3/dbhome_1'


The patch will be removed from database instances.
Disabling and removing online patch 'bug14034426.pch', on database 'ttslprd1'
RollbackSession removing interim patch '14034426' from inventory
Patching in all-node mode.
Updating nodes 'ttsxd02-po-db02' 'ttsxd02-po-db03' 'ttsxd02-po-db04'

Rollback-related files are:
FR =
"/u01/app/oracle/product/11.2.0.3/dbhome_1/.patch_storage/14034426_Jul_2_2014_18_51
_17/rac/remove_files.txt"
DR =
_17/rac/remove_dirs.txt"
FP =
_17/rac/copy_files.txt"
MP =
_17/rac/make_cmds.txt"
RC =
_17/rac/remote_cmds.txt"
Disabling and removing online patch 'bug14034426.pch', on database 'ttslprd2' on

node 'ttsxd02-po-db02'.


Instantiating the file

_17/rac/remove_files.txt.instantiated" by replacing $ORACLE_HOME in
_17/rac/remove_files.txt" with actual path.
Removing files on remote nodes...
_17/rac/remove_dirs.txt.instantiated" by replacing $ORACLE_HOME in
_17/rac/remove_dirs.txt" with actual path.
Removing directories on remote nodes...
_17/rac/copy_files.txt.instantiated" by replacing $ORACLE_HOME in
_17/rac/copy_files.txt" with actual path.
Propagating files to remote nodes...
_17/rac/copy_dirs.txt.instantiated" by replacing $ORACLE_HOME in
_17/rac/copy_dirs.txt" with actual path.
Propagating directories to remote nodes...
Log file location:
3_45_31/rollback2014-12-16_03-45-31AM_1.log
OPatch succeeded.
[oracle@ttsxd02-po-db01 14034426]$
Apply :
[oracle@ttsxd02-po-db01 14034426]$ opatch apply online -connectString

ttslprd1:sys:sys:ttsxd02-po-db01,ttslprd2:sys:sys:ttsxd02-po-
db02,ttslprd3:sys:sys:ttsxd02-po-db03,ttslprd4:sys:sys:ttsxd02-po-
db04,ttsprd1:sys:sys:ttsxd02-po-db01,ttsprd2:sys:sys:ttsxd02-po-
db02,ttsprd3:sys:sys:ttsxd02-po-db03,ttsprd4:sys:sys:ttsxd02-po-
db04,ttsrprd1:sys:sys:ttsxd02-po-db01,ttsrprd2:sys:sys:ttsxd02-po-
db02,ttsrprd3:sys:sys:ttsxd02-po-db03,ttsrprd4:sys:sys:ttsxd02-po-db04
Oracle Home : /u01/app/oracle/product/11.2.0.3/dbhome_1
from : /u01/app/oracle/product/11.2.0.3/dbhome_1/oraInst.loc
Log file location :
3_48_54/apply2014-12-16_03-48-54AM_1.log

Applying interim patch '14034426' to OH '/u01/app/oracle/product/11.2.0.3/dbhome_1'
All checks passed.
Backing up files...

Installing and enabling the online patch 'bug14034426.pch', on database 'ttslprd1'.
Installing and enabling the online patch 'bug14034426.pch', on database 'ttsprd1'.
Installing and enabling the online patch 'bug14034426.pch', on database 'ttsrprd1'.
Updating nodes 'ttsxd02-po-db02' 'ttsxd02-po-db03' 'ttsxd02-po-db04'

Apply-related files are:
FP =
_17/rac/copy_files.txt"
DP =
_17/rac/copy_dirs.txt"
MP =
_17/rac/make_cmds.txt"
RC =
_17/rac/remote_cmds.txt"

_17/rac/copy_files.txt.instantiated" by replacing $ORACLE_HOME in
_17/rac/copy_files.txt" with actual path.
_17/rac/copy_dirs.txt.instantiated" by replacing $ORACLE_HOME in
_17/rac/copy_dirs.txt" with actual path.
Installing and enabling the online patch 'bug14034426.pch', on database
'ttslprd2 ,ttsprd2 ,ttsrprd2' on node 'ttsxd02-po-db02'.



Log file location:
3_48_54/apply2014-12-16_03-48-54AM_1.log
OPatch succeeded.
[oracle@ttsxd02-po-db01 14034426]$
3rd node :
[oracle@ttsxd01-wc-db01 14034426]$ opatch apply online -connectString

ttsprd1:sys:sys:ttsxd01-wc-db01,ttsprd2:sys:sys:ttsxd01-wc-
db02,ttsprd3:sys:sys:ttsxd01-wc-db03,ttsprd4:sys:sys:ttsxd01-wc-
db04,ttsrprd1:sys:sys:ttsxd01-wc-db01,ttsrprd2:sys:sys:ttsxd01-wc-
db02,ttsrprd3:sys:sys:ttsxd01-wc-db03,ttsrprd4:sys:sys:ttsxd01-wc-
db04,ttslprd1:sys:sys:ttsxd01-wc-db01,ttslprd2:sys:sys:ttsxd01-wc-
db02,ttslprd3:sys:sys:ttsxd01-wc-db03,ttslprd4:sys:sys:ttsxd01-wc-db04
Oracle Home : /u01/app/oracle/product/11.2.0/dbhome_1

from : /u01/app/oracle/product/11.2.0/dbhome_1/oraInst.loc
Log file location :
/u01/app/oracle/product/11.2.0/dbhome_1/cfgtoollogs/opatch/14034426_Dec_16_2014_03_
55_24/apply2014-12-16_03-55-24AM_1.log

Applying interim patch '14034426' to OH '/u01/app/oracle/product/11.2.0/dbhome_1'
All checks passed.
Backing up files...

Installing and enabling the online patch 'bug14034426.pch', on database 'ttsprd1'.
Installing and enabling the online patch 'bug14034426.pch', on database 'ttsrprd1'.
Installing and enabling the online patch 'bug14034426.pch', on database 'ttslprd1'.

Updating nodes 'ttsxd01-wc-db02' 'ttsxd01-wc-db03' 'ttsxd01-wc-db04'
Apply-related files are:
FP =
"/u01/app/oracle/product/11.2.0/dbhome_1/.patch_storage/14034426_Jul_2_2014_18_51_1
7/rac/copy_files.txt"
DP =
7/rac/copy_dirs.txt"
MP =
7/rac/make_cmds.txt"
RC =
7/rac/remote_cmds.txt"

7/rac/copy_files.txt.instantiated" by replacing $ORACLE_HOME in
7/rac/copy_files.txt" with actual path.
7/rac/copy_dirs.txt.instantiated" by replacing $ORACLE_HOME in
7/rac/copy_dirs.txt" with actual path.
Installing and enabling the online patch 'bug14034426.pch', on database 'ttsprd2
,ttsrprd2 ,ttslprd2' on node 'ttsxd01-wc-db02'.



Log file location:
/u01/app/oracle/product/11.2.0/dbhome_1/cfgtoollogs/opatch/14034426_Dec_16_2014_03_
55_24/apply2014-12-16_03-55-24AM_1.log
OPatch succeeded.
[oracle@ttsxd01-wc-db01 14034426]$
===================================================================================
================================================================================
7:13 PM 3/2/2015
GI Upgrade Stpes : 11.2.0.3 to 11.2.0.4
Prerequiste step :
cramdb-dt-06s:(+ASM)/backup/software/GRID-11204 > ./runcluvfy.sh stage -pre crsinst

-upgrade -n cramdb-dt-06s -src_crshome /backup/software/GRID-11204 -dest_crshome
/u01/app/oracle/product/11.2.0.4/grid -dest_version 11.2.0.4.0 -fixup -fixupdir
/home/oracle/fixup -verbose
Cluster Home :
/oracle/patch/grid/runcluvfy.sh stage -pre crsinst -upgrade -n bedc-odb01,bedc-

odb02 -rolling -src_crshome /oracle/grid -dest_crshome /oracle/11.2.0.4/grid/
-dest_version 11.2.0.4.0 -fixup -fixupdir /home/oracle/fixup -verbose
1.Stop all databases running on the GI home.
2.create directory /u01/app/oracle/product/11.2.0.4/grid and give permissions
3.Invoke run installer
4.login as root and run rootupgrade.sh
[root@cramdb-dt-06s grid]# ./rootupgrade.sh

Performing root user operation for Oracle 11g
The following environment variables are set as:

ORACLE_OWNER= oracle
ORACLE_HOME= /u01/app/oracle/product/11.2.0.4/grid
Enter the full pathname of the local bin directory: [/usr/local/bin]:

The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file:
/u01/app/oracle/product/11.2.0.4/grid/crs/install/crsconfig_params
Creating trace directory
ASM Configuration upgraded successfully.
Creating OCR keys for user 'oracle', privgrp 'dba'..

Operation successful.
LOCAL ONLY MODE
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
CRS-4664: Node cramdb-dt-06s successfully pinned.
Replacing Clusterware entries in inittab
cramdb-dt-06s 2015/03/02 21:15:16

/u01/app/oracle/product/11.2.0.4/grid/cdata/cramdb-dt-
06s/backup_20150302_211516.olr
cramdb-dt-06s 2014/10/31 14:46:26

/u01/app/oracle/product/11.2.0.3/grid/cdata/cramdb-dt-
06s/backup_20141031_144626.olr
Successfully configured Oracle Grid Infrastructure for a Standalone Server
[root@cramdb-dt-06s grid]#
Steps to apply PSU patch :
Note : to Apply patch the base version should be 11.2.0.3.6
Login as root and fire the below commands.
1. Go to GI_HOME location and move the Opatch folder
[root@cramdb-dt-06s grid]# mv OPatch OPatch_old
2.Copy the patch zip file to /u01/app/oracle/product/11.2.0.4/grid folder .it will

created the Opatch folder and chnage the permissions
[root@cramdb-dt-06s db1]# unzip p6880880_112000_Linux-x86-64.zip
[root@cramdb-dt-06s db1]# chown -R oracle:dba OPatch

[root@cramdb-dt-06s db1]#
3.create the response file usingh below command
[root@cramdb-dt-06s OPatch]#
/u01/app/oracle/product/11.2.0.4/grid/OPatch/ocm/bin/emocmrsp
OCM Installation Response Generator 10.3.4.0.0 - Production
Copyright (c) 2005, 2010, Oracle and/or its affiliates. All rights reserved.
Provide your email address to be informed of security issues, install and

initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: y
The OCM configuration response file (ocm.rsp) was successfully created.
4.Apply the patch usning below syntax (It will automatically restarts the CRS)
/u01/app/oracle/product/11.2.0.4/grid/OPatch/opatch auto
/u01/app/oracle/software/11204-psu -oh /u01/app/oracle/product/11.2.0.4/db1
-ocmrf /u01/app/oracle/product/11.2.0.4/grid/OPatch/ocm.rsp
<<Grid Home>> <<PSU Location>>
<<Grid Home>> <<Grid Home>>
[root@cramdb-dt-06s OPatch]# ./opatch auto /backup/software/11204-psu -oh

/u01/app/oracle/product/11.2.0.4/grid -ocmrf
/u01/app/oracle/product/11.2.0.4/grid/OPatch/ocm.rsp
Executing /u01/app/oracle/product/11.2.0.4/grid/perl/bin/perl ./crs/patch11203.pl
-patchdir /backup/software -patchn 11204-psu -oh
/u01/app/oracle/product/11.2.0.4/grid -ocmrf
/u01/app/oracle/product/11.2.0.4/grid/OPatch/ocm.rsp -paramfile
This is the main log file:

/u01/app/oracle/product/11.2.0.4/grid/cfgtoollogs/opatchauto2015-03-02_22-20-12.log
This file will show your detected configuration and all the steps that opatchauto
attempted to do on your system:
/u01/app/oracle/product/11.2.0.4/grid/cfgtoollogs/opatchauto2015-03-02_22-20-
12.report.log
2015-03-02 22:20:12: Starting Oracle Restart Patch Setup

Using configuration parameter file:
Enter 'yes' if you have unzipped this patch to an empty directory to proceed
(yes/no):yes
Enter 'yes' if you have unzipped this patch to an empty directory to proceed
(yes/no):yes
Stopping CRS...
Stopped CRS successfully
patch /backup/software/11204-psu/17478514 apply successful for home

/u01/app/oracle/product/11.2.0.4/grid
Starting CRS...
CRS-4123: Oracle High Availability Services has been started.
opatch auto succeeded.

[root@cramdb-dt-06s OPatch]#
5.Check the versions
cramdb-dt-06s:(ACRMDT5)/u01/app/oracle/product/11.2.0.4/grid/OPatch > ./opatch

lsinventory
Oracle Home : /u01/app/oracle/product/11.2.0.4/db1

from : /u01/app/oracle/product/11.2.0.4/db1/oraInst.loc
Log file location :
/u01/app/oracle/product/11.2.0.4/db1/cfgtoollogs/opatch/opatch2015-03-03_00-04-
03AM_1.log
Lsinventory Output file location :

/u01/app/oracle/product/11.2.0.4/db1/cfgtoollogs/opatch/lsinv/lsinventory2015-03-
03_00-04-03AM.txt
--------------------------------------------------------------------------------
Installed Top-level Products (1):
Oracle Database 11g 11.2.0.4.0

There are 1 product(s) installed in this Oracle Home.
Interim patches (1) :
Patch 17478514 : applied on Mon Mar 02 23:50:38 UTC 2015

Unique Patch ID: 16969975
Patch description: "Database Patch Set Update : 11.2.0.4.1 (17478514)"
Created on 6 Dec 2013, 04:22:19 hrs PST8PDT
Bugs fixed:
16850630, 17551709, 13944971, 17811447, 13866822, 17811429, 16069901
16721594, 17443671, 17478514, 17612828, 17610798, 17239687, 17501491
17446237, 16450169, 17811438, 17288409, 17811456, 12905058, 17088068
16285691, 17332800
--------------------------------------------------------------------------------
OPatch succeeded.
cramdb-dt-06s:(ACRMDT5)/u01/app/oracle/product/11.2.0.4/grid/bin > crsctl query has

releaseversion
Oracle High Availability Services release version on the local node is [11.2.0.4.0]
cramdb-dt-06s:(ACRMDT5)/u01/app/oracle/product/11.2.0.4/grid/bin > crsctl query has
softwareversion
Oracle High Availability Services version on the local node is [11.2.0.4.0]
cramdb-dt-06s:(ACRMDT5)/u01/app/oracle/product/11.2.0.4/grid/bin >
Apply PSU patch Normal method :
1.Go to 11.2.0.4 RDBMS home and Move the Optach folder
2.Copy the patch zip file to /u01/app/oracle/product/11.2.0.4/grid location and

unzip the file .it will created the Opatch folder and change the permissions
[root@cramdb-dt-06s db1]# unzip p6880880_112000_Linux-x86-64.zip
[root@cramdb-dt-06s db1]# chown -R oracle:dba OPatch

[root@cramdb-dt-06s db1]#
3.export PATH and Home
cramdb-dt-06s:(ACRMDT5)/u01/app/oracle/product/11.2.0.4/db1/OPatch > export

PATH=$PATH:/u01/app/oracle/product/11.2.0.4/db1/OPatch
cramdb-dt-06s:(ACRMDT5)/home/oracle > export
ORACLE_HOME=/u01/app/oracle/product/11.2.0.4/db1
cramdb-dt-06s:(ACRMDT5)/home/oracle > export PATH=$ORACLE_HOME/bin:$PATH
cramdb-dt-06s:(ACRMDT5)/home/oracle > export LD_LIBRARY_PATH=$ORACLE_HOME/lib:
$LD_LIBRARY_PATH
Errors for below :

wtowerdb-dt-b2s.cable.comcast.com:
(PWTDEV2)/u01/app/oracle/product/11.2.0.4/db_1/OPatch > export
ORACLE_HOME=/u01/app/oracle/product/11.2.0.4/db_1
(PWTDEV2)/u01/app/oracle/product/11.2.0.4/db_1/OPatch > export
PATH=$ORACLE_HOME/bin:$PATH
(PWTDEV2)/u01/app/oracle/product/11.2.0.4/db_1/OPatch > which opatch
4. Go to Patch location
cramdb-dt-06s:(ACRMDT5)/backup/software/11204-psu/17478514 > pwd

/backup/software/11204-psu/17478514
cramdb-dt-06s:(ACRMDT5)/backup/software/11204-psu/17478514 > opatch apply
===================================================================================
==============
Errors :
INS-40406 The installer detects no existing Oracle Grid Infrastructure software on

the system
[oracle@server03 grid]$ cd /opt/oracle/app/11.2.0/grid/oui/

[oracle@server03 oui]$ cd bin
[oracle@server03 bin]$ ./runInstaller -updateNodeList
ORACLE_HOME="/opt/oracle/app/11.2.0/grid" CRS=true
Starting Oracle Universal Installer...
Post GI Upgrade steps :
cramdb-dt-01d.cable.comcast.com:(+ASM1)/home/oracle > srvctl status database -d

icrmdt0
PRCD-1027 : Failed to retrieve database icrmdt0
PRCD-1229 : An attempt to access configuration of database icrmdt0 was rejected
because its version 11.2.0.3.0 differs from the program version 11.2.0.4.0. Instead
run the program from /u01/app/oracle/product/11.2.0.3/db1.
cramdb-dt-01d.cable.comcast.com:(+ASM1)/home/oracle > srvctl upgrade database -d
icrmdt0 -o /u01/app/oracle/product/11.2.0.3/db1
icrmdt0
Instance icrmdt01 is running on node cramdb-dt-01d
cramdb-dt-01d.cable.comcast.com:(+ASM1)/home/oracle > ps -ef|grep pmon
oracle 21195 14787 0 12:29 pts/0 00:00:00 grep pmon
oracle 30069 1 0 12:06 ? 00:00:00 asm_pmon_+ASM1
oracle 30873 1 0 12:07 ? 00:00:00 ora_pmon_icrmdt11
cramdb-dt-01d.cable.comcast.com:(+ASM1)/home/oracle >
icrmdt0
icrmdt0 -v
Instance icrmdt01 is running on node cramdb-dt-01d with online services icrmdt01.
Instance status: Open.
Instance icrmdt02 is running on node cramdb-dt-02d with online services icrmdt02.
Instance status: Open.
cramdb-dt-01d.cable.comcast.com:(+ASM1)/home/oracle > srvctl status service -d
icrmdt0 -v
Service icrmdt01 is running on instance(s) icrmdt01
Service icrmdt02 is running on instance(s) icrmdt02
icrmdt1
wtowerdb-dt-b1s.cable.comcast.com:(PWTWPRF1)/home/oracle > srvctl remove database

-d WTWPRF
Remove the database WTWPRF? (y/[n]) y
wtowerdb-dt-b1s.cable.comcast.com:(PWTWPRF1)/home/oracle >
wtowerdb-dt-b1s.cable.comcast.com:(PWTWPRF1)/home/oracle >
wtowerdb-dt-b1s.cable.comcast.com:(PWTWPRF1)/home/oracle > srvctl add database -d
WTWPRF -o /u01/app/oracle/product/11.2.0.4/db_1 -c RAC -p
'+PWTWPRFDATA/wtwprf/spfilepwtwprf.ora'
wtowerdb-dt-b1s.cable.comcast.com:(PWTWPRF1)/home/oracle > srvctl add instance -i
PWTWPRF1 -d WTWPRF -n wtowerdb-dt-b1s
wtowerdb-dt-b1s.cable.comcast.com:(PWTWPRF1)/home/oracle > srvctl add instance -i
PWTWPRF2 -d WTWPRF -n wtowerdb-dt-b2s
wtowerdb-dt-b1s.cable.comcast.com:(PWTWPRF1)/home/oracle > srvctl add service -s

WT_PERF -d WTWPRF -r PWTWPRF1 -a PWTWPRF2
wtowerdb-dt-b1s.cable.comcast.com:(PWTWPRF1)/home/oracle > srvctl config service -s
WT_PERF -d WTWPRF
DB Upgrade :
Pre check :
SQL> @/tmp/utlu112i.sql;
Oracle Database 11.2 Pre-Upgrade Information Tool 05-17-2015 17:36:44
Script Version: 11.2.0.4.0 Build: 007
.
**********************************************************************
Database:
**********************************************************************
--> name: WTDEV
--> version: 11.2.0.3.0
--> compatible: 11.2.0.0.0
--> blocksize: 8192
--> platform: Linux x86 64-bit
--> timezone file: V14
.
**********************************************************************
Tablespaces: [make adjustments in the current environment]
**********************************************************************
--> SYSTEM tablespace is adequate for the upgrade.
.... minimum required size: 1371 MB
--> SYSAUX tablespace is adequate for the upgrade.
--> UNDOTBS1 tablespace is adequate for the upgrade.
--> TEMP tablespace is adequate for the upgrade.
.
**********************************************************************
Flashback: OFF
**********************************************************************
**********************************************************************
Update Parameters: [Update Oracle Database 11.2 init.ora or spfile]
Note: Pre-upgrade tool was run on a lower version 64-bit database.
**********************************************************************
--> If Target Oracle is 32-Bit, refer here for Update Parameters:
-- No update parameter changes are required.
.
--> If Target Oracle is 64-Bit, refer here for Update Parameters:

-- No update parameter changes are required.
.
**********************************************************************
Renamed Parameters: [Update Oracle Database 11.2 init.ora or spfile]
**********************************************************************
-- No renamed parameters found. No changes are required.
.
**********************************************************************
Obsolete/Deprecated Parameters: [Update Oracle Database 11.2 init.ora or spfile]
**********************************************************************
-- No obsolete parameters found. No changes are required
.
**********************************************************************
Components: [The following database components will be upgraded or installed]
**********************************************************************
--> Oracle Catalog Views [upgrade] VALID
--> Oracle Packages and Types [upgrade] VALID
--> JServer JAVA Virtual Machine [upgrade] VALID
--> Oracle XDK for Java [upgrade] VALID
--> Real Application Clusters [upgrade] VALID
--> Oracle Workspace Manager [upgrade] VALID
--> Oracle XML Database [upgrade] VALID
--> Oracle Java Packages [upgrade] VALID
--> Oracle interMedia [upgrade] VALID
--> Spatial [upgrade] VALID
--> Expression Filter [upgrade] VALID
--> Rule Manager [upgrade] VALID
.
**********************************************************************
Miscellaneous Warnings
**********************************************************************
WARNING: --> The "cluster_database" parameter is currently "TRUE"
.... and must be set to "FALSE" prior to running a manual upgrade.
WARNING: --> Database contains INVALID objects prior to upgrade.
.... The list of invalid SYS/SYSTEM objects was written to
.... registry$sys_inv_objs.
.... The list of non-SYS/SYSTEM objects was written to
.... registry$nonsys_inv_objs.
.... Use utluiobj.sql after the upgrade to identify any new invalid
.... objects due to the upgrade.
.... USER WT has 55 INVALID objects.
.... USER ORALMS has 1 INVALID objects.
WARNING: --> Your recycle bin contains 105860 object(s).
.... It is REQUIRED that the recycle bin is empty prior to upgrading
.... your database. The command:
PURGE DBA_RECYCLEBIN
.... must be executed immediately prior to executing your upgrade.
WARNING: --> JOB_QUEUE_PROCESS value must be updated
.... Your current setting of "10" is too low.
.... Starting with Oracle Database 11g Release 2 (11.2), setting

.... JOB_QUEUE_PROCESSES to 0 causes both DBMS_SCHEDULER and
.... DBMS_JOB jobs to not run. Previously, setting JOB_QUEUE_PROCESSES
.... to 0 caused DBMS_JOB jobs to not run, but DBMS_SCHEDULER jobs were
.... unaffected and would still run. This parameter must be updated to
.... a value greater than 32 (default value is 1000) prior to upgrade.
.... Not doing so will affect the running of utlrp.sql after the upgrade
.
**********************************************************************
Recommendations
**********************************************************************
Oracle recommends gathering dictionary statistics prior to
upgrading the database.
To gather dictionary statistics execute the following command
while connected as SYSDBA:
EXECUTE dbms_stats.gather_dictionary_stats;
**********************************************************************
SQL> exit
cd $ORACLE_HOME/rdbms/admin
sqlplus /nolog
SQL> CONNECT / AS SYSDBA
SQL> STARTUP
SQL> @catbundle.sql psu apply
SQL> QUIT
cd $ORACLE_HOME/rdbms/admin
sqlplus /nolog
SQL> CONNECT / AS SYSDBA
SQL> @utlrp.sql
cmdbdb-dt-a1q.downingtown.pa.ula.comcast.net:(SET_ME)/u01/app/oracle/software/GRID-
11204 > runcluvfy.sh stage -pre crsinst -upgrade -n cmdbdb-dt-a1q,cmdbdb-dt-a2q
-rolling -src_crshome /u01/app/grid -dest_crshome /u01/app/11.2.0.4/grid
-dest_version 11.2.0.4.0
Performing pre-checks for cluster services setup
Checking node reachability...

Node reachability check passed from node "cmdbdb-dt-a1q"
Checking user equivalence...

User equivalence check passed for user "oracle"
Checking CRS user consistency

CRS user consistency check successful
Checking node connectivity...
Checking hosts config file...
Verification of the hosts config file successful
Check: Node connectivity for interface "bond0"

Node connectivity passed for interface "bond0"
TCP connectivity check passed for subnet "10.253.92.0"
Check: Node connectivity for interface "bond1"

Node connectivity passed for interface "bond1"
TCP connectivity check passed for subnet "192.168.1.0"
Checking subnet mask consistency...

Subnet mask consistency check passed for subnet "10.253.92.0".
Subnet mask consistency check passed for subnet "192.168.1.0".
Subnet mask consistency check passed.
Node connectivity check passed
Checking multicast communication...
Checking subnet "10.253.92.0" for multicast communication with multicast group

"230.0.1.0"...
Check of subnet "10.253.92.0" for multicast communication with multicast group
"230.0.1.0" passed.
Checking subnet "192.168.1.0" for multicast communication with multicast group

"230.0.1.0"...
Check of subnet "192.168.1.0" for multicast communication with multicast group
"230.0.1.0" passed.
Check of multicast communication passed.
Checking OCR integrity...
OCR integrity check passed
Checking ASMLib configuration.

Check for ASMLib configuration passed.
Total memory check passed
Available memory check passed
Swap space check failed
Check failed on nodes:
cmdbdb-dt-a1q,cmdbdb-dt-a2q
Free disk space check failed for "cmdbdb-dt-a1q:/u01/app/11.2.0.4/grid"
cmdbdb-dt-a1q
Free disk space check passed for "cmdbdb-dt-a2q:/u01/app/11.2.0.4/grid"
Free disk space check passed for "cmdbdb-dt-a1q:/tmp"
Free disk space check passed for "cmdbdb-dt-a2q:/tmp"
Check for multiple users with UID value 503 passed
User existence check passed for "oracle"
Group existence check passed for "dba"
Membership check for user "oracle" in group "dba" [as Primary] passed
Run level check passed
Hard limits check passed for "maximum open file descriptors"
Soft limits check passed for "maximum open file descriptors"
Hard limits check passed for "maximum user processes"
Soft limits check passed for "maximum user processes"
Check for Oracle patch "9413827 or 9706490" in home "/u01/app/grid" failed
cmdbdb-dt-a1q,cmdbdb-dt-a2q
There are no oracle patches required for home "/u01/app/11.2.0.4/grid".
System architecture check passed
Kernel version check passed
Kernel parameter check passed for "semmsl"
Kernel parameter check passed for "semmns"
Kernel parameter check passed for "semopm"
Kernel parameter check passed for "semmni"
Kernel parameter check passed for "shmmax"
Kernel parameter check passed for "shmmni"
Kernel parameter check passed for "shmall"
Kernel parameter check passed for "file-max"
Kernel parameter check passed for "ip_local_port_range"
Kernel parameter check passed for "rmem_default"
Kernel parameter check passed for "rmem_max"
Kernel parameter check passed for "wmem_default"
Kernel parameter check passed for "wmem_max"
Kernel parameter check passed for "aio-max-nr"
Package existence check passed for "make"
Package existence check passed for "binutils"
Package existence check passed for "gcc(x86_64)"
Package existence check passed for "libaio(x86_64)"
Package existence check passed for "glibc(x86_64)"
Package existence check passed for "compat-libstdc++-33(x86_64)"
Package existence check passed for "elfutils-libelf(x86_64)"
Package existence check passed for "elfutils-libelf-devel"
Package existence check passed for "glibc-common"
Package existence check passed for "glibc-devel(x86_64)"
Package existence check passed for "glibc-headers"
Package existence check passed for "gcc-c++(x86_64)"
Package existence check passed for "libaio-devel(x86_64)"
Package existence check passed for "libgcc(x86_64)"
Package existence check passed for "libstdc++(x86_64)"
Package existence check passed for "libstdc++-devel(x86_64)"
Package existence check passed for "sysstat"
Package existence check passed for "ksh"
Check for multiple users with UID value 0 passed
Current group ID check passed
Starting check for consistency of primary group of root user

Check for consistency of root user's primary group passed
Starting Clock synchronization checks using Network Time Protocol(NTP)...
NTP Configuration file check started...

NTP Configuration file check passed
Checking daemon liveness...

Liveness check passed for "ntpd"
Check for NTP daemon or service alive passed on all nodes
NTP daemon slewing option check passed
NTP daemon's boot time configuration check for slewing option passed
NTP common Time Server Check started...

Check of common NTP Time Server passed
Clock time offset check from NTP Time Server started...

Clock time offset check passed
Clock synchronization check using Network Time Protocol(NTP) passed
Core file name pattern consistency check passed.
User "oracle" is not part of "root" group. Check passed

Default user file creation mask check passed
Checking consistency of file "/etc/resolv.conf" across nodes
File "/etc/resolv.conf" does not have both domain and search entries defined
domain entry in file "/etc/resolv.conf" is consistent across nodes
search entry in file "/etc/resolv.conf" is consistent across nodes
All nodes have one search entry defined in file "/etc/resolv.conf"
The DNS response time for an unreachable node is within acceptable limit on all
nodes
File "/etc/resolv.conf" is consistent across nodes
UDev attributes check for OCR locations started...

UDev attributes check passed for OCR locations
UDev attributes check for Voting Disk locations started...

UDev attributes check passed for Voting Disk locations
Time zone consistency check passed

Checking VIP configuration.
Checking VIP Subnet configuration.
Check for VIP Subnet configuration passed.
Checking VIP reachability
Check for VIP reachability passed.
Checking Oracle Cluster Voting Disk configuration...
ASM Running check passed. ASM is running on all specified nodes
Oracle Cluster Voting Disk configuration check passed

Clusterware version consistency passed
Pre-check for cluster services setup was unsuccessful on all the nodes.
cmdbdb-dt-a1q.downingtown.pa.ula.comcast.net:(cmdbqa1)/opt/home/oracle > !sq

sqlplus
SQL*Plus: Release 11.2.0.1.0 Production on Sat May 23 13:40:11 2015
Copyright (c) 1982, 2009, Oracle. All rights reserved.
Enter user-name: / as sysdba

Connected to an idle instance.
cmdbqa1 SYS> startup nomount

ORA-00845: MEMORY_TARGET not supported on this system
cmdbqa1 SYS> exit
Disconnected
cmdbdb-dt-a1q.downingtown.pa.ula.comcast.net:(cmdbqa1)/opt/home/oracle > free -g
total used free shared buffers cached
Mem: 31 4 26 0 0 1
-/+ buffers/cache: 3 28

clscfg: EXISTING configuration version 5 detected.
clscfg: version 5 is 11g Release 2.
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Failed to perform J2EE (OC4J) Container Resource stop/disabled at
/u01/app/11.2.0.4/grid/crs/install/crsconfig_lib.pm line 9274.
/u01/app/11.2.0.4/grid/perl/bin/perl -I/u01/app/11.2.0.4/grid/perl/lib
-I/u01/app/11.2.0.4/grid/crs/install /u01/app/11.2.0.4/grid/crs/install/rootcrs.pl
execution failed
https://nadeemmohammed.wordpress.com/2012/03/13/list-of-oracle-database-patch-set-
updates-psu/

Grid Upgrade& PSU Patch Steps - 21-08-14

Uploaded by

Copyright:

Available Formats

You might also like

Grid Upgrade& PSU Patch Steps - 21-08-14

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Grid Upgrade& PSU Patch Steps - 21-08-14

Uploaded by

Copyright:

Available Formats

6:36 AM 8/21/2014

Steps to Aplly PSU patch :

1. to Apply patch the base version should be 11.2.0.3.6

2.take the backup of Optach fole

<<Grid Home>> <<PSU Location>>

4.Start the DB and run catbundle.sql script

[oracle] :/home/oracle PENTDEV> cd /u01/app/oracle/product/11.2.0.4/db/rdbms/admin/

SQL*Plus: Release 11.2.0.4.0 Production on Thu Aug 21 10:12:14 2014

Copyright (c) 1982, 2013, Oracle. All rights reserved.

Enter user-name: / as sysdba

Total System Global Area 3340451840 bytes

PL/SQL procedure successfully completed.

PL/SQL procedure successfully completed.

Generating apply and rollback scripts...

PL/SQL procedure successfully completed.

Executing script file...

SQL> COLUMN spool_file NEW_VALUE spool_file NOPRINT

SQL> SPOOL &spool_file

PL/SQL procedure successfully completed.

SQL> PROMPT Skipping Spatial because it is not installed or versions mismatch...

SQL> PROMPT Updating registry...

SQL> SPOOL off

/u01/app/oracle/product/11.2.0.4/db_1/OPatch/opatch auto /u01/app/oracle/11204-psu

./runcluvfy.sh stage -pre crsinst -upgrade -n ndwetldb-wc-a1p,ndwetldb-wc-a2p

/u01/app/oracle/product/11.2.0.4/db2/OPatch/opatch apply -oh

cramdb-dt-04d:(icrmdt3)/u01/app/oracle/product/11.2.0.3/OPatch > export

OPatch failed with error code 36

Oracle Home : /u01/app/oracle/product/11.2.0.3

The patch should be applied/rolled back in '-all_nodes' mode only.

Patching component oracle.rdbms, 11.2.0.3.0...

Verifying the update...

Install the patch by running the following command:

opatch apply online -connectString ttsstg1:sys:sys:ttsxd01-dt-

[oracle@ttsxd02-po-db01 14034426]$ opatch rollback -id 14034426 -connectString

Oracle Home : /u01/app/oracle/product/11.2.0.3/dbhome_1

RollbackSession rolling back interim patch '14034426' from OH

The patch should be applied/rolled back in '-all_nodes' mode only.

Patching component oracle.rdbms, 11.2.0.3.0...

RollbackSession removing interim patch '14034426' from inventory

Patching in all-node mode.

Updating nodes 'ttsxd02-po-db02' 'ttsxd02-po-db03' 'ttsxd02-po-db04'

Disabling and removing online patch 'bug14034426.pch', on database 'ttslprd2' on

Disabling and removing online patch 'bug14034426.pch', on database 'ttslprd3' on

Disabling and removing online patch 'bug14034426.pch', on database 'ttslprd4' on

Instantiating the file

[oracle@ttsxd02-po-db01 14034426]$ opatch apply online -connectString

The patch should be applied/rolled back in '-all_nodes' mode only.

Patching component oracle.rdbms, 11.2.0.3.0...

Installing and enabling the online patch 'bug14034426.pch', on database 'ttsprd1'.

Installing and enabling the online patch 'bug14034426.pch', on database 'ttsrprd1'.

Verifying the update...

Patching in all-node mode.

Updating nodes 'ttsxd02-po-db02' 'ttsxd02-po-db03' 'ttsxd02-po-db04'

Instantiating the file

Installing and enabling the online patch 'bug14034426.pch', on database

Installing and enabling the online patch 'bug14034426.pch', on database

Patch 14034426 successfully applied

[oracle@ttsxd01-wc-db01 14034426]$ opatch apply online -connectString