Oracle GoldenGate Overview Stone Lee Oracle Taiwan Inc.
Oracle GoldenGate The Solution for Enterprise-wide Real Time Data Needs
Database and applications, Mixed sources, distributed systems, legacy,
Real-time information
,
Mission Critical Applications & Data, Business Intelligence, Reporting for Customers, Partners & Employees
Real-t l-time ime Acce ccess ss Rea
Oracle GoldenGate delivers real-time access of real-time information, enabling companies to dramatically improve the availability, availability, reliability, reliability, and performance of critical data across enterprise systems.
3
3
Key GoldenGate Customers… Banking and Finance
Healthcare
Telecommunications and Service Operators
Retail and e-Business
Manufacturing & Supply Chain
Travel & Hospitality Government & Public Sector
4
Oracle GoldenGate Use Cases Enterprise-wide Solution for Real Time Data Needs
Disaster Recovery, Data Protection Standby
(Open & Active)
Zero Downtime Migration and Upgrades Log Based, RealTime Change Data
OGG
• Standardize on Single Technology for Multiple Needs • Deploy for Continuous Availability Avail ability and Real-time Data Access for Reporting Reporting / BI
Operational Reporting
Database
ETL ODS ETL
Heterogeneous Source Systems
EDW
• Highly Flexible EDW
Real-time BI Query Offloading
Deployments ments • Fast Deploy • Lower TCO & Improved ROI
Data Distribution
5
Key Plays for Oracle GoldenGate
Query Offloading • Resource Utilization Use physical standby for reads Move reads to lower cost systems
Continuous Availability • Zero Downtime
Real Time Data Integration • Operational
Migration & Upgrade
Reporting
Migrate database, hardware or applications with minimal downtime
Quickly report on transaction system data with no source impact
• Disaster Recovery &
• Real Time Business
Data Protection Create live standby for failover, avoid and repair block corruptions
Intelligence Understand current metrics in historical context
• Data Distribution Synchronize hub & spoke or distributed systems
Find a solution that can transfer our data in real-time, keeping up with data volumes and meet future business needs. In actuality, GoldenGate was the only solution that handled all three requirements with ease.” – J Seelan, DBA Manager, Manager, 1-800-Flowers.com
• Create a real-time replica of existing expensive operational system (e.g. legacy or big iron) on Oracle with RAC on Linux. • Sync replica in real-time and route all read-only traffic
Benefits
OGG
• Reduce/Eliminate query load on transactional system Non-Oracle or Legacy Platform
Oracle Platform
• oracle rec y re uce cos o egacy, ma n rame, non-
What products to position? • Oracle GoldenGate supports heterogene heterogeneous ous database, hardware hardware and OS platforms
Qualifier: “Do you want to move query processing to standard, lower cost DB & Hardware infrastructure with no disruption to critical transaction processing systems & satisfy business end-users as data volumes and users grow?”
8
Query Offloading Case Study Query Offloading Saves Millions $ COMPANY OVERVIEW
GoldenGate PROVIDES
A world leader leader in the travel marketplace, marketplace,
• Supports 1.6TB of data movement per day
Sabre Holdingsand merchandises and retailsand travel products provides distribution technology solutions for the travel industry
to read-only servers Source– Oracle Oracle 10g | Targe Targett – MySQL MySQL • Source– • Current plans to migrate to Oracle 11g on both source and target.
CHALLENGES / OPPORTUNITIES
RESULTS
• Optimize OLTP system performance – offload all query activity • Reduce TCO via platform changes and segment “lookers” from “bookers” • Handle growing data volumes and support heterogeneous heterogeneous systems over lifecycle of Air Travel Shopping Engine (ATSE) • Maintain data integrity across all systems
• 80% TCO TCO Reduction Reduction – Millions Millions $$ saved
“Bookers vs Lookers”
Solution – Continuous Availability • Disaster Recovery / Data Protection • • Data Distribution / Synchronization
“We believe this is the on only ly product on the market that ca can n meet our demands for 99.95% database availability, performance and scalability.” Chris Uriarte, CTO, Retail Decisions
Continuous Availability
Continuous Availability
Zero Down-time Migration and Upgrade Solution
Previous Version
New Version
Benefit
OGG Old DB Version
• Migrate from any heterogeneo heterogeneous us database to Oracle11g with minimal downtime • Migrate hardware or OS platforms with no downtime • Upgrade Siebel CRM with no downtime • Allow active users to move to new system gradually gradually while both systems are live
New DB Version
• • Zero down-time for mission critical applications • Safely migrate users from one system to the next, while keeping both systems running. • Lower risk by enabling failback
What products to position? •• Oracle GoldenGate Get in the door with Zero Dowtime Migration/Upgrade Migration/Upgrade • Upsell ongoing ZDT Operations for a higher value deal
Qualifier? “Do you need to migrate your database or upgrade critical applications but can’t afford to take any down time and impact critical business processes?” 12
Continuous Data Availability
Continuous Availability
Data Distribution / Synchronization Solution Oracle 9i
Oracle 11g
• Replicate data for distributed applications to drive global operations and improve operational efficiency • Distribute data in real-time across Oracle and Non-Oracle environments • Active-Active configuration keeps multiple data centers in sync
OGG
Benefit Oracle 10g
SQL Server
• High Availability for mission critical data • Ability to scale, handle large large & growing growing data volumes data across geographically • Access to consistent data dispersed data centers
What product to position? • Oracle GoldenGate
Qualifer: “How does your data keep up with the demands of your 24x7 global business. Can all business units access the same, up-to-data information at any time, continuously?”
13
Complementary and Used Together
Continuous Availability
Active Data Guard and GoldenGate Central Hub
Active Data Guard Physical Standby
GoldenGate Targets o en &a e Source Target
GoldenGate Source &
GoldenGate
Target
Target
Example of a how a global hub & spoke manufacturing operation may be de lo ed usin both Active Data Guard Guard and GoldenGate
14
Zero Downtime Migration & Upgrade Zero Downtime OS and DB Migrations Business Challenges: • RIM BlackBerry has a very small monthly window to take downtime for upgrades, migrations, and planned maintenance
Zero-Downtime OS and Database Upgrade with Application Maintenance
• Strict SLA limits with the major Telcos! GoldenGate Solution: • Zero-Downtime Upgrade and OS change for business-critical Oracle databases • GoldenGate Veridata™ to ensure that all
Application Maintenance
Provisioning a a ase m gr g ra o n with failback
data from source is in-synch with target and that migration has been successful GoldenGate Benefits: • Fail-back capability to reduce business risk and downtime
• No manual intervention to reduce
Provisioning
Oracle 10.2.0.3 HP-UX Waterloo
Oracle 10.2.0.4 HP-UX Slough, U.K.
possibility of errors • Assurance of database consistency with Veridata.
15
High Availability: Live Standby Software as a Service to Financial Institutions, Institutions, No Interruption Live Standby for High Availability and Disaster Tolerance
Business Challenges: • En Ensu sure re no iint nter erru rupt ptio ion n to on ongo goin ing g bus busin iness ess operations for banking and financial institution customers • Ena Enable ble cont continu inuous ous ava availa ilabil bility ity of crit critica icall applications—account opening, funds transfer • Imp Implem lement ent a rreli eliabl able, e, inin-hou house se liv live e st stand andby by solution
Live Standby Oracle 10g RAC Clusters Oracle 10g RAC Clusters
GoldenGate Solution: • Gol Golden denGat Gate e Sof Softwa tware re Liv Live e Stan Standby dby for Hig High h Availability Availabilit y / Disaster T Tolerance olerance replicates data from multiple Oracle RAC clusters to an exact replica of the production environment • In case of out outage age or failur failure, e, web app applic licati ations ons are unaffected and “business as usual” is maintained for global financial services clients • Liv Live e Stan Standby dby inc increa reases ses ROI by allowi allowing ng for data integration into data warehouse to run
Custom ETL Script
Oracle Data Warehouse
GoldenGate has opened our eyes to other areas throughout our business where near realtime data can deliver added value to the business and a better return on investment.” - Burak Y Yenier enier,, Sr. Dir Dir.. of Operations, CashEdge “
reports via Oracle BI Enterprise Edition 16
Solution – Real-time Data Integration • Operational Reporting • Real-time Business Intelligence
“Accessing the data in real time using GoldenGate we can immediately see if we’re profitable and if our business processes are working.” - Sam Peterson, SVP Technology, echnology, Overstock.com
Real-Time Data Integration
Real Time Data Integration
Operational Reporting Solution • Report on live data in transactional systems • No additional load on source system – offload reporting reporting to a database instance that is synchronized in real time
Benefit • Enables tactical reports quickly for decision making and business transparenc transparency y • Removes impact from source systems • transactionall systems transactiona
OGG
Transactional Applications
Operational Data Store
What products to position? • Oracle GoldenGate offload to replica. BI Publisher for operational reporting
Qualifier? “Do you have adequate transparency into the data in your most sensitive transactional systems?”
18
Real-Time Data Integration
Real Time Data Integration
Enables Real-time BI Solution Real-time Integration + Bulk Data Transformation
ODI
ODS
• Populate an operational data store for operational BI with real-time data • Run ELT from the ODS to load data warehouse with transformed data
Benefit
OGG Database, Oracle Oracle Exadata Data Mart
• Improves business insight • Combines intelligence on current business status with historical context • Eliminates load on source systems • Reduces latencies and batch windows
What products to position? • Oracle GoldenGate and Data Integrator
Qualifer? “Do you need better business insight with the most current data and no impact to your critical systems?”
19
Operational BI Real-time Data Integration to Support Reporting Demands ADP Reporting” = Consolidate Product Line Data to Off-load Real-Time Reporting “
Business Challenges: Common real-time reporting functionality across ADP product suites Ability to do cross-product reporting Incremental revenue opportunity and improved customer service Reporting gets moved off from “production” databases
40+ Source Systems in ASP Environment: HR, Payroll, Benefits Products
Oracle
Oracle
Oracle
SQL Server
GoldenGate Solution: Live Reporting for real-time data consolidation from 40+ source systems into a centralized target Minimal footprint and data latency
Oracle Data Mart
Maintains data integrity Ability to support support data data transformations transformations and data security
Reporting: Business Objects, Crystal
With GoldenGa GoldenGate te it was boom, boom boom,, boom — full speed ahead.” - Amit Mukher Mukherjee, jee, Senior Directo Directorr of Reporting Services Services,, ADP “
20
Oracle GoldenGate
21
How It Works: Modular Architecture Capture: Committed changes are captured (and can be filtered) as they occur by reading the transaction logs. Trail files: Stages and queues data for routing. Pump: Distribute data for routing to multiple targets. Route: Data is compressed, encrypted encrypted for routing to targets. Delivery: Applies data with transaction integrity, transforming the data as required.
• A high-speed, low impact data comparison solution • identifies and reports data discrepancies between two databases • without interrupting those systems or the business processes they support
• Benefits: • • • • •
Reduce financial/legal risk exposure Speed and simplify IT work in comparing data sources No disruption to business systems Improved failover to backup systems Confident decision-making and reporting
Key Messages for GoldenGate Oracle GoldenGate delivers real-time access to real-time information, enabling companies to dramatically improve the availability, availability, reliability, reliability, and performance of critical data across enterprise systems.
Delivers continuous operations for mission critical applications to eliminate unplanned outages and reduce the duration and frequency of planned outages. Lowers IT costs through heterogeneous support for multiple platforms to leverage modern databases / platforms for query offloading and . Improves efficiencies through improved performance, scalability of realtime feeds, and data distribution. Reduces risk by ensuring data data integrity integrity and reliability reliability between between source and target systems. Improves business insight through real-time BI Data Warehousing and report offloading.
Oracle Products for Data Movement Comparing How They Work
Retrieve Data
Y C N E T A L G N I S A E R C E D
28
N O I T A M R O F S N A R T G N I S A E R C N I
Load Data
Disaster Recovery Recovery & Data Protection Redo in Memory Buffer S U O E N E G O R E T
Active Guard Data
Direct Memory Access
Direct Write to Logs
Real Time Data Integration & High Availability Availability
Read On-Disk Logs
GoldenGate Fast SQL
Data Integration for Data Warehouse & SOA
E H
SQL Query
Data Integrator
Set-based, Complex SQL
Oracle Products for Data Movement Comparing Tradeoffs and Benefits Driven by Different Architectures
• Not invasive invasive on source source or target Active Data Guard
• Fastest Fastest read read and write write • Oracle Oracle Datab Database ase only • No transfo transformat rmation ion • Not Invas Invasive ive on on source source
GoldenGate
Data Integrator
• ery as as re rea an wr e • Hetero Heterogen geneou eous s • Basic Basic transfo transformat rmation ion only • Supports Supports active-activ active-active e replicatio replication n • Optimized Optimized Set-based Set-based transformation transformation • Highest latency for real-time real-time feeds • Supports Supports highly complex transformation transformation • Hetero Heterogen geneou eous s
29
Complementary and Used Together Active Data Guard and GoldenGate
Disa Di sast ster er Re Reco cove verr & Data Protection • • • •
Fast failover failover to physical physical standby standby database database Fastest Fastest solu solutio tion n for Oracle Oracle Oracle Oracle Databas Database eo only nly Allows Allows standby standby to be open for reads reads to leverage customer investment • Transparent Transparent data protectio protection n to repair repair corrupted blocks on primary or standby
Oracle Active Data Guard
Oracle DB Standby
• • • • • • •
Enterprise-wi Enterprise-wide de heterogeneous heterogeneous replica replication tion Zero downt downtime ime operat operations ions Non-invasive Non-invasive by reading reading database database logs logs Supports Supports a active ctive-activ -active e scenarios scenarios Ensures transactional transactional consistency consistency High High volume; volume; low low latency latency Guaranteed Guaranteed delivery delivery across across wide wide area networks
Oracle GoldenGate
30
Comparing GoldenGate & Streams GoldenGate is Oracle’s strategic Streams continues to be a replication solution supported Oracle Database feature
Oracle GoldenGate
• u -o -o - e- ox so u ons • Bro Broad ad hete heterog rogen eneou eous s sup suppor portt • Ex Excel cellen lentt refer referen ence ce base base
Oracle Streams
• g y cus om za e an ex e • Opt Optimi imized zed for Oracl Oracle e Da Datab tabase ase • Fe Few w larg large e refe refere renc nces es
Question: I already have Streams for free? free? Why buy GoldenGate?
• Better ROI overall : GoldenGate is lower cost to implement implement and maintain solution: GoldenGate easily expands expands to new use cases • Enterprise-wide solution: • Support for Streams continues: continues: Continue to use Streams where it’s de deployed ployed
Lead with GoldenGate 31
Summary : Oracle Data Movement & Transformation Products per Solution Golden Gate C o n t i n u o u s A v a i l a b i l i t y
Disaster Recovery Recovery / Data Protection
Oracle
Zero Downtime Migrations / Upgrades Query Offloading
Heterogeneous
Grid & Scalability
(Oracle RAC)
Operational Reporting Real Time BI Typical Data Warehouse Data Integration for SOA Migrating Migra ting Between Between Differen Differentt Apps
32
NonOracle
Data Integrator EE
Data Distributio Distribution n / Synchron Synchronizatio ization n