Professional Documents
Culture Documents
Oracle DB High Availability On Ibm Power Systems
Oracle DB High Availability On Ibm Power Systems
Frédéric Dubois
IT Specialist
Fred.dubois@fr.ibm.com
Agenda
Power 770
Consistency
Binary compatibility
Mainframe-inspired reliability
Support for virtualization
Power 750 AIX, Linux and IBM i OS
Power 740 2S/4U Corporate Enterprise Downtime
Power 720 1S/4U (Hours per Year)
IBM AIX POWER
Sun Solaris / SPARC
HP UX 11/ PA RISC Power Systems
Apple MAC
Power 730 2S/2U HP UX 11/ HP Integrity with AIX deliver
PS Blades Power 710 1S/2U Red Hat Enterprise
Windows Server 2008 99.997% uptime
Windows Server 2003
Open Source Linux
3
DOAG Conference 2011 (November 15th-17th) © 2011 IBM Corporation
IBM’s Ten-Year March to UNIX Leadership
The largest shift of customer spending in UNIX history
POWER4
Dynamic LPARs
25%
POWER6
Shared Processor Pools
20%
HP Sun/Oracle IBM
15%
Q 0
Q 0
Q 1
Q 1
Q 1
Q 1
Q 2
Q 2
Q 2
Q 2
Q 3
Q 3
Q 3
Q 3
Q 4
Q 4
Q 4
Q 4
Q 5
Q 5
Q 5
Q 5
Q 6
Q 6
Q 6
Q 6
Q 7
Q 7
Q 7
Q 7
Q 8
Q 8
Q 8
Q 8
Q 9
Q 9
Q 9
Q 9
Q 0
Q 0
Q 0
0
30
40
10
20
30
40
10
20
30
40
10
20
30
40
10
20
30
40
10
20
30
40
10
20
30
40
10
20
30
40
10
20
30
40
10
20
30
40
11
21
31
41
Q
A Collaborative Continuous Process between Oracle and IBM to ensure the Oracle
Certification of IBM SWG and STG products at its most Current Releases with Oracle
Product Releases *
Applications Unlimited (PSFT, JDE, Siebel CRM, E-Business Suite)
Fusion Applications
Business Intelligence and EPM (BI Apps, OBI EE, Hyperion EPM)
Retail GBU (Retek, 360Commerce, ProfitLogic)
Communications GBU (Portal Software, MetaSolv)
Insurance GBU (AdminServer, Skywire)
Edge Applications: G-Log OTM, Agile PLM, Demantra
Oracle Technology (DB and RAC, Fusion Middleware, Enterprise Mgr)
For 23+ years, IBM has delivered the best infrastructure components available in the market to support
customers who have selected Oracle as their SW provider
•HUGE NEWS: Fusion Apps is available on AIX 6.1 concurrent with Oracle’s
Base Development Platform!!!
Micro-partitionning
Development environment could be
Oracle 12 consolidated into the production
Middleware infrastructure, workloads can be
isolated and resources can be shared
6
Oracle
Database – CPU resources for Dvt can be
0 given a lower priority than
production as needed by business
Dev & Test
• Shared Processor Pool
• Memory dynamic LPAR
• Different VIO Server to isolate
Storage I/Os for Dvt environment
Virtual Ethernet
Partitions can be interconnected with Virtual
Ethernet network.
Oracle
Virtual Ethernet is easy, flexible, performance and
Applications it’s integrated at the low level of the system
(microcode)
VLANs
Host Ethernet Adapter (also called IVE)
Oracle
HEA switch can be configured and logical ports can
Database be assigned to partitions for network interconnection
HEA (also called IVE) is a hardware switch adapter
connected to the internal Bus of the processor(s)
Dev & Test (GX bus) and can connect to the external network
VIO Server infrastructure
Oracle supports both Virtual Ethernet and Host
Ethernet Adapter technologies
Enterprise
Storage Network
Virtual SCSI
Dev & Test Physical Storage is assigned to the VIO
VIO Server
Server, and virtual mapping of the disks is
done at the VIO Server level.
VIOS provides Storage management
techniques. (Multipathing, Logical Volume
Storage Manager)
Oracle supports both NPIV and Virtual
SCSI protocols
Micro-partitionning
• Optimizes CPU usage, using Shared Processor Pool Middleware
6 Shared CPU
Test & Dev
0
– SMT – LPM
– MVSPP – AMS Power System
– Dedicated Shared Processor – AME
– NPIV Storage Network
– CuOD
– Test and Development partitions will be capped and will not pick up CPU cycles from the
Shared Processor Pool
Minimize license cost on core usage and define a Virtual Shared Processor Pool with a CPU
capacity Entitlement.
– Host DB partitions in a Virtual Shared Processor Pool
– Core licensing is based on the VSPP Capacity
SAN
LAN
15
15 DOAG Conference 2011 (November 15th-17th) © 2011 IBM Corporation
11/3/2011
Agenda
• Flood • Cpu
• Electrical problem • Memory
• Air-conditioning • Disk
Live Partition • …. • Electrical outage
Mobility improves it •…
Live Partition
Mobility improves it
• Backup
• Upgrade
• diagnostic
•…
Database Database
• Cold Failover with downtime
Micro-partitionning
15
Oracle Real Application Cluster (RAC) is
Oracle
flexible architecture
10
Applications – Workload balancing across the
nodes (partitions) of the servers
Micro-partitionning
Micro-partitionning
Oracle 5
– Easy maintenance as 1 node can be
Middleware
stopped without Application
0
Oracle disruption
Automated workload balancing
Real Application Cluster Combine RAC and PowerVM
Virtualization features
Test Dev – Define RAC nodes with Micro
partitioning and uncapped mode and
high priority
VIO Server VIO Server
– Define Test and Development with
15 15
Micro partitioning and low priority or
Server A 10
Server B 10 capped mode
5 5
More resources per application
0 0
increase average usage
7,5 7,5
7,5
0 CPU% 0
0
30
15 15
22,5
15
7,5 7,5
7,5
0
0 0
SAN
SAN LAN
LAN LAN
LAN SAN
SAN
Storage services
(i.e. Flash copy/PPRC/MetroMirror)
Provide :
Micro-partitionning
Micro-partitionning
Micro-partitionning
(Cluster Implementation) Applications Applications • Workload
Live
Oracle Middleware Oracle Oracle migration
(Cluster Implementation) Middleware Middleware • High
Availability
Oracle Real Application Cluster Database Database
• Scalability
Oracle Grid Infrastructure
Physical
Resources
Micro-partitionning
Micro-partitionning
Micro-partitionning
Micro-partitionning
Oracle Single Access Name (my.cluster.com)
Add/Remove server
ressources on the fly …
Oracle ASM IBM GPFS
Add/Remove server(s) on
Virtual Virtual Virtual Virtual Virtual the fly …
Disk Disk Disk Disk Disk
Micro-partitionning
Oracle Oracle
Middleware Middleware Examples of LPM operations:
– Database partition runs a batch
Oracle
and Server A is overloaded, CPU
Database
is 100% busy, while Server B has
free CPU capacity
Test & Dev Test & Dev
• Migrate Test & Dev partition to
server B and free
VIO Server VIO Server corresponding resource for
Database partition on server A
24 24
Server A
18 18
Server B – You need to maintain Server A,
12 12
Migrate Oracle database partition
6 6 to Server B without disruption
0 0
LPAR-1 LPAR-2 LPAR-3 LPAR-4 VIOS VIOS LPAR-1 LPAR-2 LPAR-3 LPAR-4
Migration Migration
Controller Controller
Oracle Def 1
Oracle
P P P P Def 2 P P PP PP
P P P P P P P P P P P Def 3 P P P P PP PP PP P P P
Def 4
AIX Kernel AIX Kernel AIX Kernel AIX Kernel AIX Kernel AIX Kernel AIX Kernel AIX Kernel
Hypervisor Hypervisor
Ethernet
Partition Mobility Requires: SAN Partition Mobility Steps
• POWER6 Validation
• AIX 5.3 / 6.1 or Linux Copy memory pages
Boot
• All resources must be “Virtualized” Host to target systems
•No real resources Transfer
• SAN storage environment Data Turn off Host resources
•SAN Boot, temp space, same network Activate Target resources
The number of Oracle cores needed does not change before and after the migration
Power6 Power7
Application Server (swingbench) simulates
Other Another
users and generates workload to the Oracle
Apps 1 DB DB
Swingbench
The Oracle DB is run as a Real Application
Any other
Cluster (RAC) with 3 nodes in the Power6
Apps
DNS server.
DB Instance Web server You need to:
Clusterware perform a maintenance on the left
Other server/location
Node A
Apps 1 or run additional workload on the Power6
server
Node B
or migrate the production to a new Power7
LPM server
Node C
VIOS1 VIOS2 VIOS1 VIOS2 This is just a few (11) clicks on the HMC
HMC 15
7,5
7,5
SAN
SAN LAN
LAN LPM the RAC node and make it fly !!
Just try to migrate one RAC node without stopping the cluster on it.
In case of any disruption of the node during the migration:
the node will get out of the cluster and will reboot ;-(
the workload will run on the remaining node(s). This is regular behavior of the RAC cluster
This scenario is not yet supported, and certification tests are under progress, so you must
not use it for production purpose. (only for test). This demo process without cluster stop
on the migrated RAC node is a non official disclosure
The infrastructure is based on PowerVM virtualization using VIO Servers on both source
and target servers.
The RAC interconnect network is trunked with other networks to the physical network
infrastructure through a single physical adapter of the VIOS.
15
7,5
7,5
SAN
SAN LAN
LAN http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP101965