Oracle and Net App Mike Mc Guiggan Consulting

Скачать презентацию Oracle and Net App Mike Mc Guiggan Consulting

2989486d46480862bb40e233a3d45153.ppt

Количество слайдов: 51

Oracle and Net. App Mike Mc. Guiggan Consulting Systems Engineer Northeast Region

Oracle and Network Appliance® 12 years of innovation driving down infrastructure costs AND increasing enterprise IT productivity 2005 Net. App deployment at Oracle: - over 3200 TB - 14, 000 Servers ONTAP 7 G Flex. Vol & Flex. Clone deployed 2001 Net. App runs its core business on Oracle E-Business Suite 1999 Net. App helps establish 1995 Oracle Storage First filer Compatibility for Oracle Program (OSCP) DB sold Net. App and Oracle Blueprints from Oracle Consulting 2003 Net. App runs Oracle ERP, 3000+ Oracle on CRM and HR Net. App customers Snap. Validator announced in production Linux competency EM Grid Control Integration 1997 Oracle certifies Net. App Oracle B 2 B Exchange selects Net. App is Certified Solution Partner 2004 Net. App deployment at Oracle: 500 TB Oracle Net. App Joint Escalation Team ONJET Joint Center of Excellence (Co. E) and professional services © 2008 Net. App. All rights reserved. Net. App deployment at Oracle: - over 6900 TB - 20, 000+ servers Oracle Enterprise Linux 4 Support Snap. Lock Integration center 2002 2000 2007 Net. App deployment at Oracle: - over 2000 TB - 9, 500 Servers at Oracle Austin Data Center Enterprise Grid Alliance Oracle builds next Apps on Net. App storage 2006 Net. App deployment at Oracle: - over 5500 TB - 20, 000 servers OCS Snap. Lock Integration Snap. Manager for Oracle Launched 5000+ joint customers 2

Safra Catz, President and CFO of Oracle OOW quote: “I would like to introduce my good friend Tom Mendoza…………Net. App is a very, very close partner of Oracle…. . we have worked together for a very long time in advancing technology, grid computing, and data center consolidation……. . for any of you that has visited our Austin Data Center, it is a commercial for Net. App. We voted for them with our money. ” © 2008 Net. App. All rights reserved. 3

Oracle Austin Data Center. Over 20, 000 servers. Over 6900+ TB of Net. App Storage. Austin Data Center Stats • More than 20, 000+ servers • Largest Dell/Linux installation on earth • 6, 900+ terabytes of Net. App storage • Largest Net. App single installation on earth • Scaling at over 60 TBs of storage each month • Over 500 mission-critical customers' apps hosted on the premises • Primary data center for 50, 000+ Oracle employees • 2 acres of data center raised floor space Results • Experiencing 30% higher utilization and faster application deployment • Storage management overhead reduced 50% • Global IT has 88% faster response time on Net. App FC SAN © 2008 Net. App. All rights reserved. 4

Oracle as a Customer - Highlights ¡ 99% of Oracle application development is on Net. App (2400 TB) ¡ 99% of Oracle On. Demand “Production Applications and DB” (2100 TB) ¡ 100% Oracle University (120 TB) ¡ 100% Oracle Demos DB & Applications (500 TB) ¡ 50% Database Development (300 TB) ¡ 65% of Oracle internal production (2420 TB) “Net. App has reduced the overhead necessary to perform storage-related management activities by 50%. ” © 2008 Net. App. All rights reserved. 6

Net. App Supports Them All! Fabric Attached Storage Topology i. SCSI SAN Enterprise NAS Dedicated Ethernet Fibre Channel Departmental NAS Corporat e LAN NAS (File) SAN (Block) Net. App® FAS © 2008 Net. App. All rights reserved. 7

Net. App’s Value to the DBA ¡ Performance and Utilization ¡ Backup and Recovery ¡ Data Protection ¡ Disaster Recovery and Business Continuance ¡ Test / Development ¡ ASM ¡ Snap. Manager for Oracle © 2008 Net. App. All rights reserved. 9

Database Performance Tuning and Capacity Planning Challenges ¡ Storage can be a performance bottleneck ¡ Duplicate database copies are needed to maintain availability and SLAs ¡ Performance of each volume is limited to the number of spindles within ¡ “Hot” volumes can’t be “helped” by disks in other volumes ¡ Capacity planning, forecasting and management are imprecise tasks ¡ Availability, scalability and capacity must be maintained or increased while driving down costs… © 2008 Net. App. All rights reserved. 10

Provision – Demand … with LESS Software Flex. Vol™ - Flexible, Virtualized Volumes & LUNs Conventional Volumes & LUNs vol 0 vol 1 vol 2 vol 3 data P HM DIR’s P SQL “HOT” P P Test Oracle/Caché Data ONTAP 7 G™ – Flex. Vols™ add disks on-the-fly WAFL® Provisions-on-Demand P Manual, inefficient Unused space not available to others Flex. Vol™s share disk Aggregate Grow & shrink non-disruptively P n Raid Groups = AGGREGATE = Physical Storage Pool Flex. Vol™ = Logical Data Container (1 MB – 16 TB) More shared spindles mean NO “HOT” vols / LUNs © 2008 Net. App. All rights reserved. free Full provisioning tied to physical disks Higher Storage Utilization Improved Performance Thin Provision 11

WAFL®, Snapshot™, and Flex. Clone™: The Foundation Inodes, block maps Active Filesys or LUN Snapshot A B C Flex. Clone D D’ Y Disk blocks © 2008 Net. App. All rights reserved. Net. App’s Unique DNA ¡ WAFL – Write Anywhere File Layout – Core block and file storage services – Resiliency features (RAID-DP™) ¡ Snapshot – Near-instantaneous, point-in-time “copy” of file system (vol) or LUN – Read-only ¡ Snap. Restore® – Near-instantaneous “rollback” of vol or LUN to prior Snapshot copy ¡ Flex. Clone – Near-instantaneous, WRITABLE “copy” of vol or LUN – Same space-sharing 12

Database Performance Tuning Example Test OLTP Database 2 Test OLTP Database 1 8 -Disk Aggregate 24 -Disk Aggregate Transaction Log Archive Log Flashback © 2008 Net. App. All rights reserved. Data Files 32 -Disk Aggregate All Files 15

Database Performance Tuning Example Test OLTP Database - 2 Test OLTP Database 1 8 -Disk Aggregate 24 -Disk Aggregate Transaction Log Archive Log Flashback © 2008 Net. App. All rights reserved. Data Files 32 Disk Aggregate All files 16

Database Backup and Recovery Challenges ¡ RMAN backups consume significant physical resources ¡ Cold backups lead to lower SLAs ¡ Separate backups on each platform ¡ Time-to-recover from tape becomes prohibitive ¡ DBA’s time spent on non-valueadd backup/restore tasks ¡ Backups performed with less frequency © 2008 Net. App. All rights reserved. 18

Backup and Recovery with Snapshot and Snap. Restore ¡ Significant time savings ¡ Stay online ¡ Reduce system and storage overhead ¡ Consolidated backups ¡ Backup more often 300 GB Database Primary Backup Secondary Backup Snap. Vault Time to Backup Snapshot Active Filesys or LUN Flex. Clone To Tape (60 GB/Hr Best Case) A B Snapshot™ Time to Recover C D D’ Y From Tape Redo Logs Snap. Restore® Redo Logs 0 1 2 © 2008 Net. App. All rights reserved. 3 4 Time in Hours 5 6 7 8 19

RAID-DP Reliability RAID ¡ 2, 000 to 4, 000 times more secure than regular RAID Protects against single disk failure P ¡ More reliable than mirroring for double-disk failure RAID DP Protects against any P two-disk failure DP ¡ 14% Parity Overhead vs. 50% Overhead w/Mirror(*) ¡ 72% more usable capacity than competitive offerings(*) Comparing 2 P+12 D vs. 7+7 Mirror © 2008 Net. App. All rights reserved. 21

RAID-DP vs Other RAID Methods RAID Level Failure Protection # of Disks (Cost Hit) Performance Impact Multiple disks, except mirror pairs 2 N 2 x writes; none to add or (N or 100%) reconstruct 1 failed disk or uncorrectable disk (hard) errors XOR calculation on writes, and N+1; N 7 when disks added or data (1/N or 14%) reconstructed Net. App RAID 4 1 failed disk or uncorrectable disk (hard) errors XOR calculation on writes and N+1; N 7 when data reconstructed; (1/N or 14%) none when adding disks Net. App RAID-DP 2 failed disks or 1 failed disk and hard disk errors XOR calculation on writes and N+2; N 14 when data reconstructed; (2/N or 14%) none when adding disks RAID 1 (Mirroring) RAID 5 (“RAID”) RAID-DP provides RAID 1 protection… …with RAID 4 cost, performance and simplicity © 2008 Net. App. All rights reserved. 22

Protect Oracle Data with Snap. Lock Tablespaces Datafiles Fabric Attached Storage (FAS) (partitions) Q 1 Q 2 High Performance High Perf. (Snap. Lock) Oracle Database Snap. Lock software helps ensure the permanence, accuracy, integrity, and security of data by enabling business records and Oracle data files to be both unalterable and rapidly accessible online for long periods of time. 2005 2004 Low Cost ATA Drives Online Archive (Snap. Lock) 2003 © 2008 Net. App. All rights reserved. 2002 2001 /oradata/2001 a. dbf Unified Storage Architecture /oradata/2001 b. dbf 23

Migrate Data Across Storage Tiers ¡ Periodically move data between storage tiers as access patterns change High Performance Storage Tier Low Cost Storage Tier ¡ Partition Rules – e. g. MOVE PARTITION holding Q 2 Orders from high performance storage tier to low cost storage tier Move important data on demand – UPDATE of partition key will cause row to move to a new partition ¡ e. g. product warranty expires Use Cases: Content Mgmt. , ILM, Compliance, Litigation, Etc. © 2008 Net. App. All rights reserved. ¡ Write protect data with Snap. Lock on any storage tier – e. g. MOVE PARTITION to Snap. Lock volume and mark as “read only” and set the retention date. 24

Protect Against Oracle Block Corruption Oracle® Database Prevention is better than recovery… e. Bay suffers three outages in three days Database Block Write “… the larger outage was caused by a corruption of data files. The corrupted files began to replicate and quickly spread across the system, …” April 11, 2002 Volume Manager I/O Driver SAN / NAS Cloud Operating System Host Bus Adapter Hardware and/or firmware failures, misconfiguration, etc. Data passes through many layers before reaching the storage subsystem. Corruption can occur at any point in the data path. © 2008 Net. App. All rights reserved. 25

Snap. Validator: Prevents Oracle block corruption ¡ Snap. Validator™ is Net. App’s implementation of Oracle’s HARD initiative – HARD stands for Hardware Assisted Resilient Data ¡ Validates writes to volumes that contain Oracle data – Oracle checksum verification ¡ Feature of Data ONTAP ¡ Supported with Oracle Database 9 i and 10 g (NFS, i. SCSI, FCP) ¡ Net. App is the only HARD partner to support this initiative across its entire product line. ¡ Net. App is the only HARD partner to support filesystems. © 2008 Net. App. All rights reserved. 26

Disaster Recovery Planning Primary Data Center Secondary Data Center Database Server Dedicated Lines and Switches RAID 0 + 1 Mirror Copy © 2008 Net. App. All rights reserved. Challenges ¡ 4 x actual storage requirement ¡ Expensive transport infrastructure ¡ Cumbersome to install and manage ¡ Difficult to keep backup copies synchronized 28

Disaster Recovery with Snap. Mirror® Production Site Remote Disaster Recovery Site Snap. Mirror © 2008 Net. App. All rights reserved. ¡ Fast data replication and failover ¡ Significant reduction in storage required ¡ Sync or async replication ¡ More efficient network utilization ¡ Access to mirrored data ¡ Volume or qtree replication ¡ Secondary can become primary in case of disaster at primary site ¡ Easy to install and manage over existing IP infrastructure (WAN) 29

Unified and Tiered Disaster Recovery with Replicator. X® SAN / i. SAN Current Instance Or any Legacy Storage HA/BC site FAS Storage Flex. Clone Point-in-Time Clones ¡ Data replication and recovery over any distance in a heterogeneous environment ¡ 100% data consistency across any number of servers, storage devices, and fabric-based devices ¡ Guarantees block write order © 2008 Net. App. All rights reserved. 30

Net. App’s Value to the DBA ¡ Performance ¡ Backup and Recovery ¡ Data Protection ¡ Disaster Recovery and Business Continuance ¡ Test / Development ¡ ASM ¡ Snap. Manager for Oracle © 2008 Net. App. All rights reserved. 31

Database Cloning and the Application Development Process ¡ Full or partial database copies required for: PROD DEV MAINT SECONDARY (DR) TEST/QA RPT/ETL © 2008 Net. App. All rights reserved. – App and DB Development – Maintenance (OS, DB upgrade) – Test and QA – Training and Demos – Reporting and DW ETL ¡ Ability to do this quickly, correctly, and efficiently directly impacts Application Development and Deployment 32

Application Development and Testing Example: Traditional Approach Production Mirrored Copy Dev 1 Test 1 Dev 2 Test 2 © 2008 Net. App. All rights reserved. Production database Mirror copy Development copies Testing copies Total: Dev 3 100 GB 300 GB 800 GB ¡ 8 x actual storage requirement ¡ Time consuming ¡ Resource overhead Test 3 33

Application Development and Testing Example: Net. Approach Production Mirrored Copy Dev 1 Test 1 Dev 2 Test 2 Production database Mirror copy Development copies Testing copies Total: 100 GB 30 GB 260 GB Dev 3 Test 3 ¡ Over 67% reduction in storage required ¡ Near instantaneous copies ¡ Negligible overhead ¡ Ability to have many more test and dev copies more clones = higher productivity Assumption: up to 10% change in data in the test and dev environments © 2008 Net. App. All rights reserved. 34

Database Maintenance with Flex. Clones Production Mirrored Copy Benefits ¡ Instantaneous copies ¡ Low resource overhead Dev 1 Production DB Clones Test 1 Snapshot Dev 2 Test 2 Active Filesys or LUN A B Dev N Test N Flex. Clone C D D’ Y © 2008 Net. App. All rights reserved. ¡ Inexpensive ¡ Easy and relatively inexpensive way to make copies of a production database without impacting the database ¡ Use database clones to test migrations, apply bug fixes, upgrades, and patches ¡ Easily reallocate storage for a database and its transaction log files 35

Cloning for Production Support Applications EMC to Net. App example using Replicator. X Production Environment Production Support Environment Replicator. X Continuous Replication • Development and Test • Reporting • Analytics / Data Warehouse SAN / i. SAN Current Instance Or any Legacy Storage Instantaneous Clone FAS Storage Flex. Clone Point-in-Time Clones ¡ Continuous replication with no disruption to production ¡ Avoid duplicating expensive storage for production support ¡ Local or remote environments ¡ Integrated, instantaneous cloning of current production data ¡ Manage up to 255 clones with minimal storage capacity © 2008 Net. App. All rights reserved. 36

New Database Development Methodology ¡ Mirror PROD for initial copy (DR) PROD Secondary (DR) Clones – If non Net. App PROD, use Replicator. X for SAN-to-SAN ¡ Clone database replicas as needed ¡ Create Snapshot™ copies of replicas for instant Snap. Restore® of working databases ¡ Exploit multiple mirrors to increase fan-out and support multiple sites Develop ● Test ● Deploy © 2008 Net. App. All rights reserved. 37

Net. App Adds Value to Oracle ASM Net. App Oracle ASM + Net. App Protect against Single Disk Failure Yes Yes Protect against Double Disk failure No Yes Passive Block corruption detection Yes Yes Active Block corruption detection Yes Yes Lost disk write detection No Yes Stripe data across ASM Disks Yes No Yes Balance I/O across ASM Disks Yes No Yes Stripe data across Physical Disks No Yes Balance I/O across Physical Disks No Yes I/O prioritization No Yes Free space management across physical disks No Yes Thin provisioning of ASM Disks No Yes Space efficient Cloning No Yes Storage Snapshot based Backups No Yes Storage Snapshot based Restores No Yes Data Resilience Performance Storage Utilization Data Protection © 2008 Net. App. All rights reserved. 39

Snap. Manager® for Oracle® Snap. Manager (GUI) Oracle Databases Snap. Drive™ NFS, FCP, or i. SCSI Net. Appliance Net. App Storage Appliance © 2008 Net. App. All rights reserved. ¡ Automated, fast, and efficient ¡ Uptime AND performance ¡ Simplify backup, restore, and cloning ¡ Tight Oracle Database 10 g integration – Automated Storage Manager (ASM) – RMAN 41

Other Cool Stuff… ¡ NFS, v 4 – Support with Data ONTAP 7. 3 ¡ Planned – Feature implementation with DNFS for 11 g. R 2 ¡ Workload prioritization ¡ Smart redirection ¡ RAC Failover Management with Net. App – Integrate Manage ONTAP API’s into CRS… ¡ If Storage not accessible, is it failing over? (planned or unplanned) ¡ Alternative: node eviction + “suicide” + application/user must reconnect… ¡ Oracle Enterprise Manager Grid Control – Enhanced plugin (to include blocks) – Connector (to Operations Manager) ¡ SMB/E Solution with DNFS+SE-RAC on Windows… © 2008 Net. App. All rights reserved. 43

Flex. Share Key Features ¡ Relative priority of different volumes ¡ Application (user) Vs. Data ONTAP background (system) prioritization Without Flex. Share™ High Priority Volumes Medium Priority Volumes Low Priority Volumes 0 20 30 40 50 60 Latency (msec) 70 80 10 20 30 40 50 60 Latency (msec) 70 80 With Flex. Share High Priority Volumes Medium Priority Volumes Low Priority Volumes 0 ¡ Per-volume cache policies Prioritize Client over System Prioritize System over Client System Load (IOPS) ¡ Dynamic configuration updates 10 System Client Time © 2008 Net. App. All rights reserved. 44

Flex. Share High Benefit Use Cases ¡ Consolidated Environments – Production, Test, and Development on the same system ¡ Backup/Disaster Recovery Throttling ¡ Manage “like” data with consistent performance – Structured and unstructured ¡ Match Net. App cache management with Oracle cache management © 2008 Net. App. All rights reserved. 45

Oracle Enterprise Manager Grid Control Plugin for Net. App Monitor Trends and Threshold Alerts Monitor Key Statistics Monitor Utilization Etc. • Ships with Oracle Enterprise Manager • Developed, maintained and licensed separately by Oracle © 2008 Net. App. All rights reserved. 46

Introducing Database NFS - DNFS ¡ What is DNFS? – An Oracle developed and supported NFS client for all platforms. (Including Windows) ¡ What are the benefits of DNFS? – Simpler management with enhanced performance and scalability. – No certification required immediate customer availability ¡ Fully tested during development rather than after deployment – Supports RAC, ASM, and HARD across all operating environments © 2008 Net. App. All rights reserved. 47

Performance ¡ Automatic Link Aggregation – Users can specify multiple ethernet connections between the Oracle database and the NFS server – DNFS will distribute the load over all active links in a balanced fashion ¡ Improved I/O Concurrency – Supports fully concurrent, asynchronous I/O on all platforms ¡ Summary – Any Oracle application can easily take advantage of the performance available on multiple parallel wires – No other NFS client can do this… High performance and high throughput, regardless of operating environment and without the need for expert tuning © 2008 Net. App. All rights reserved. 48

Simplicity ¡ Runs outside of the OS kernel – No integration with operating system’s virtual memory or buffer cache ¡ DNFS has a shorter code path faster than other NFS clients with fewer bugs ¡ No mount options – Already tuned for database operations – Simple to set up fewer operational errors – Fewer support calls © 2008 Net. App. All rights reserved. 49

Database Backup with A-SIS Deduplication (Advanced Single Instance Storage) No perceivable performance impact –Write Overhead ~1% –Read Overhead 0% Remote Office Fortune 500 Manufacturer Data Center Backup Server • Backing up Oracle Databases to Near. Store A-SIS deduplication Net. App Storage 50: 1 Space Savings Backup Data • Reported 50: 1 space savings with A-SIS deduplication vs tape backups • Backups are quickly recovered from disk • Initial database backup is deduplicated and reduced in size Heterogeneous Storage Near. Store Database Servers © 2008 Net. App. All rights reserved. • Each subsequent backup provides space savings through deduplication 50