A Conversion from Oracle to Netezza From

the Perspective of the Company’s SAS Users

June 19, 2015
Andrew T. Kuligowski
Manager – CRM
Infrastructure & Reporting
Introduction
 Introduction

• Introduction

• What needs to be changed?

– How many / which routines are affected
– How many / which file(s) are queried in each routine?
– Ad hocs vs. production routines / regularly executed vs. on demand

• Implement the changes

– Macro vs. Hard-coding
– Tracking progress

• Process improvements
– Comparing run times – Oracle vs. Netezza
 Introduction

• Process improvements (continued)

– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.

• Conclusion
• What needs to be changed?
 What needs to be changed?

• What needs to be changed?

– How many / which routines are affected
– How many / which file(s) are queried in each routine?
– Ad hocs vs. production routines / regularly executed vs. on demand
 What needs to be changed?

• What needs to be changed?

– How many / which routines are affected
– How many / which file(s) are queried in each routine?
– Ad hocs vs. production routines / regularly executed vs. on demand
 What needs to be changed?

• What needs to be changed?

– How many / which routines are affected
– How many / which file(s) are queried in each routine?
– Ad hocs vs. production routines / regularly executed vs. on demand
 What needs to be changed?

• What needs to be changed?

– How many / which routines are affected
– How many / which file(s) are queried in each routine?
– Ad hocs vs. production routines / regularly executed vs. on demand

120+ Production Routines

80 in regular use
NOTE: DO NOT WORRY ABOUT THE OTHERS
NOTE: IN FACT, KILL THE ONES YOU CAN GET AWAY WITH KILLING!!
64 perform one or more database queries. NOTE: We can ignore the others.
39 use “the main query” – further analysis needed.
Implement the changes
 Implement the changes

• Implement the changes

– Macro vs. Hard-coding
– Tracking progress
 Implement the changes

• Implement the changes

– Macro vs. Hard-coding
– Tracking progress
 Implement the changes

• Implement the changes

– Macro vs. Hard-coding
– Tracking progress
 Implement the changes

• Implement the changes

– Macro vs. Hard-coding
– Tracking progress
 Implement the changes

• Implement the changes

– Macro vs. Hard-coding
– Tracking progress
 Implement the changes

• Implement the changes

– Macro vs. Hard-coding
– Tracking progress
 Implement the changes

• Implement the changes

– Macro vs. Hard-coding
– Tracking progress
 Implement the changes

• Implement the changes

– Macro vs. Hard-coding
– Tracking progress
 Implement the changes

• Implement the changes

– Macro vs. Hard-coding
– Tracking progress
 Implement the changes

• Implement the changes

– Macro vs. Hard-coding
– Tracking progress
Process improvements
 Process improvements

• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
 Process improvements

• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
 Process improvements

• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
– Comparing run times – Oracle vs. Netezza
 Process improvements

• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
–

• Now what???
– Report to my manager. And his manager. AND …
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– Uh … NOW that the status updates are done, let’s figure out what’s actually
going on and try to resolve it!!
 Process improvements

• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
–

• Now what???
– Report to my manager. And his manager. AND …
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– Uh … NOW that the status updates are done, let’s figure out what’s actually
going on and try to resolve it!!
 Process improvements

• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
–

• Now what???
– Report to my manager. And his manager. AND …
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– Uh … NOW that the status updates are done, let’s figure out what’s actually
going on and try to resolve it!!
 Process improvements

• Process improvements
– Comparing run times – Oracle vs. Netezza
– HOLY <expletive> !!
– Figure out what’s going on … and fix it.
–

• Now what???
– Report to my manager. And his manager. AND …
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– Uh … NOW that the status updates are done, let’s figure out what’s actually
going on and try to resolve it!!
 Process improvements

• Useful
ProcessOptions
improvements
– BL_USE_PIPE=run times – Oracle vs. Netezza
Comparing
– YES
HOLY(default for Netezza)
<expletive> !! or NO (default for Oracle)
– Use a named
Figure pipegoing
out what’s to transfer
on … data between
and fix it. Netezza and SAS/Access
–
–BULKUNLOAD=
YES or NO (default)
• NowCalls
what???
the Netezza Remote External Table Interface
– Report
[There istoamy manager.
parallel And his
BULKLOAD manager. AND …
option.]
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– WHY
SO Uh …DIDN’T
NOW that theWORK
THEY status updates
– AND, are done, MADE
IN FACT, let’s figure out what’s
THINGS MUCH actually
WORSE??
going on and try to resolve it!!
 Process improvements

• Useful
ProcessOptions
improvements
– BL_USE_PIPE=run times – Oracle vs. Netezza
Comparing
– YES
HOLY(default for Netezza)
<expletive> !! or NO (default for Oracle)
– Use a named
Figure pipegoing
out what’s to transfer
on … data between
and fix it. Netezza and SAS/Access
–
–BULKUNLOAD=
YES or NO (default)
• NowCalls
what???
the Netezza Remote External Table Interface
– Report
[There istoamy manager.
parallel And his
BULKLOAD manager. AND …
option.]
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– WHY
SO Uh …DIDN’T
NOW that theWORK
THEY status updates
– AND, are done, MADE
IN FACT, let’s figure out what’s
THINGS MUCH actually
WORSE??
going on and try to resolve it!!
 Process improvements

• Useful
ProcessOptions
improvements
– BL_USE_PIPE=run times – Oracle vs. Netezza
Comparing
– YES
HOLY(default for Netezza)
<expletive> !! or NO (default for Oracle)
– Use a named
Figure pipegoing
out what’s to transfer
on … data between
and fix it. Netezza and SAS/Access
–
–BULKUNLOAD=
YES or NO (default)
• NowCalls
what???
the Netezza Remote External Table Interface
– Report
[There istoamy manager.
parallel And his
BULKLOAD manager. AND …
option.]
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– WHY
SO Uh …DIDN’T
NOW that theWORK
THEY status updates
– AND, are done, MADE
IN FACT, let’s figure out what’s
THINGS MUCH actually
WORSE??
going on and try to resolve it!!

Netezza SAS
 Process improvements

• Process temp
libname improvements
netezza database=&Ntzdb.
– Comparinguser=&user.
run times – Oracle vs.password=&password.
Netezza
server=&server.
– HOLY <expletive> !! direct_sql=yes BULKUNLOAD=YES
connection=global
– Figure out what’s going on … and fix dbcommit=0
it. dbmstemp=yes;
–

• Now what???
– Report to my manager. And his manager. AND …
– Report to IT. And my IT contact’s manager. AND …
– Report to SAS. Tech Support. AND Sales Rep. AND Loyalty Rep.
– Uh … NOW that the status updates are done, let’s figure out what’s actually
going on and try to resolve it!!

Netezza SAS
Conclusion
 Conclusion

• Have a plan … Follow your plan … be prepared … yada, yada, yada …

• “Transparent to the user” usually translates to “BOHICA”

• Improvements still Work in Progress