Скачать презентацию New approach to the design and deployment of Скачать презентацию New approach to the design and deployment of

7169d41e5b0d7f42f136c8f6ec4cd677.ppt

  • Количество слайдов: 40

New approach to the design and deployment of storage Piotr Biskupski – IBM STG New approach to the design and deployment of storage Piotr Biskupski – IBM STG Poland IBM Forum 2012 – Estonia Tallinn, October 9, 2012

To realize the promise of a Smarter Planet, enterprises must address the IT challenges To realize the promise of a Smarter Planet, enterprises must address the IT challenges that have emerged. 31. 9 million servers worldwide Internet connected devices— 22 B in 2020 (24. 9% CAGR) Last 10 years servers up 2 X and virtual machines up 42% CAGR Since 2000 security vulnerabilities grew eightfold The volume of digital content, up 48% from 2011, is expected to reach 2. 7 ZB (1 ZB = 1 billion terabytes) in 2012 and 8 ZB by 2015. Data centers have doubled energy use in past 5 years And respond to demands for new services… Real-time analytics workloads growing 13% CAGR with related server spend growing 3 x average 2 Collaborative software workloads growing 10% CAGR …while dealing with constraints like a flat budget.

IBM Storage is key to Smarter Computing Smarter Computin g Designed for Storage Efficiency IBM Storage is key to Smarter Computing Smarter Computin g Designed for Storage Efficiency is data essential to outpace data growth Storage Virtualization enables a robust cloud deployment Storage must adapt to changing information patterns

Introducing IBM Smarter Storage for Smarter Computing Efficient by Design Manage cost and capacity Introducing IBM Smarter Storage for Smarter Computing Efficient by Design Manage cost and capacity growth Self-optimizing Improve performance and productivity Cloud Agile Increase information access and improve ROI

Efficient by Design Manage Cost and Capacity Growth Decreases Space Requirements • Store more Efficient by Design Manage Cost and Capacity Growth Decreases Space Requirements • Store more information in less space • Supports non-IBM storage, savings throughout the data center Reduce Capital Expenses Simplifies Administration • Reduce complexity Reduce Operating Expenses • Automate tasks Efficiency for Active Workloads • Efficiency for transaction processing, big data, clouds • Not just for inactive data Benefits • Reduce space requirements for active data up to 80% • Save up to 47% in administrator time • Reduce complexity by up to 30%

Self-optimizing Improve Performance and Productivity Analyzes and adapts • Analyzes access patterns and adapts Self-optimizing Improve Performance and Productivity Analyzes and adapts • Analyzes access patterns and adapts automatically • Flash optimization makes high performance affordable Automates performance tuning • Saves time, reduces errors and eliminates user disruption • Easy to match critical workloads with performance features Analyze Big Data Fast • Tuning and tiering are faster and more accurate • Optimization is a continuous automated process Benefits • Increase performance 3 X with only 3% SSDs • Reduce storage costs by 50% Optimize performance and cost Increase administrator productivity

Cloud Agile Increase Information Access and Improve ROI Adaptive • Storage adapts easily to Cloud Agile Increase Information Access and Improve ROI Adaptive • Storage adapts easily to unpredictable workloads • Data is automatically synchronized between facilities Increase Agility Automated • Self-service provisioning • Simpler and faster administration Increase productivity Deploy Clouds Faster • Administrators manage far more capacity • Leverage existing storage systems Benefits • Reduce disk space needs by up to 50% • Speed storage deployment up to 26% • Improve application availability by 29%

Tying IBM Smarter Storage to New Capabilities and Vision: June Cross-IBM Announcements and So. Tying IBM Smarter Storage to New Capabilities and Vision: June Cross-IBM Announcements and So. Ds Efficient by Design Real-time Compression integrated into Storwize V 7000, SVC TPC improved GUI, enhanced reporting, tiering optimization, cloud support SONAS TPC support TPC now supports XIV/Storwize V 7000 GUI Protec. TIER file protocol support Storwize V 7000 U real-time compression for file workloads (So. D) Cloud Agile Self-optimizing DS 8000 Easy Tier extended to server based storage (So. D) DS 8000 new high-density flash storage option (So. D) DS 8000 Easy Tier support for application API (So. D) IBM Smart. Cloud Virtual Storage Center will introduce analytics-based storage tier recommendations and automation to migrate data to the right tier (So. D) SONAS and Storwize V 7000 file storage virtualization (So. D) SONAS and Storwize V 7000 ACE enables global file collaboration with multi-writer support (So. D) Information SONAS and Storwize V 7000 Unified, cloud Governance storage self-service portal (So. D) Storwize V 7000 support for Active Cloud Engine (So. D) XIV clustering (So. D) XIV Gen 3 GTS Implementation Services

IBM Smarter Storage Virtualization Thin Provisioning Compression RACE Easy Tier • option: TPC for IBM Smarter Storage Virtualization Thin Provisioning Compression RACE Easy Tier • option: TPC for Disk Midrange Edition Flash. Copy • option: Flash. Copy Manager Advanced copy services - Metro and/or Global Mirror • option: TPC for Replication Active Cloud Engine

Storage virtualization 25% capacity 50% 55% capacity SAN 0 00 7 SV 95% capacity Storage virtualization 25% capacity 50% 55% capacity SAN 0 00 7 SV 95% capacity C /V

Storage virtualization with HA …no walls Virtual strorage Virtualized. DC… VMmachine Storage virtualization with HA …no walls Virtual strorage Virtualized. DC… VMmachine

Thin-provisioning Traditional (“fully allocated”) virtual disks use physical disk capacity for the entire capacity Thin-provisioning Traditional (“fully allocated”) virtual disks use physical disk capacity for the entire capacity of a virtual disk even if it is not used With thin-provisioning, Storwize V 70000 allocates and uses physical disk capacity when data is written Dynamic growth Without thin provisioning, preallocated space is reserved whether the application uses it or not With thin provisioning, applications can grow dynamically, but only consume space they are actually using Available at no additional charge with base virtualization license Support all hosts supported with traditional volumes and all advanced features (Easy. Tier, Flash. Copy, etc. ) Reclaiming Unused Disk Space – When using Volume Mirroring to copy from a fully-allocated volume to a thin-provisioned volume, Storwize V 7000 will not copy blocks that are all zeroes – When processing a write request, Storwize V 7000 detects if all zeroes are being written and does not allocate disk space for such requests in the thin-provisioned volumes ● Helps avoid space utilization concerns when formatting Volumes Done at Grain Level (32/64/128/256 Ki. B) grain contains all zeros don’t write If

Real-Time Compression • A compressed Volume is a third type of volume – Regular Real-Time Compression • A compressed Volume is a third type of volume – Regular (fully allocated) – Thin Provisioned (Space Efficient) – Compressed • A compressed volume is “a kind of” Thin Provisioning Storwize V 7000 – Compression supports all Thin Provisioning features (e. g. autoexpand) – Only uses physical storage to store the compressed version of the volume – Can be on back-end virtualized storage R W W – Supported with CLI and GUI • GUI also has a preset for compressed volumes • Performance monitoring tab support for Compression CPU resource usage • Compression operates at a volume copy level – Maximum of 200 compressed Volume copies per IO group Copy 0 • Specified at creation of the volume copy – No conversion in place, but a volume can be converted via Volume Mirroring 1 • Compressed volumes can be source and target of Remote Copy relationship or Flash. Copy mapping – Data between copies is uncompressed 13 Copy 1

Real-Time Compression Ratio 100% 80% 2. 0 x Backup lic. 60% 2. 5 x Real-Time Compression Ratio 100% 80% 2. 0 x Backup lic. 60% 2. 5 x data 3. 3 x replication 40% 20% do 60% 3. 5 x RTOs 6. 6 x backup 50. 0% 72. 0% 85. 0% 0% 14 Dane użytkowników Bazy danych CAD/CAM Engineering Serwery wirtualne Oil & Gas

 Orion (Oracle I/O Calibration Tool) is a standalone tool for calibrating the I/O Orion (Oracle I/O Calibration Tool) is a standalone tool for calibrating the I/O performance for storage systems that are intended to be used for Oracle databases. The calibration results are useful for understanding the performance capabilities of a storage system, either to uncover issues that would impact the performance of an Oracle database or to size a new database installation

IBM Easy. Tier Hot-spots Transparent reorganization Optimized performance and throughput What is Easy Tier? IBM Easy. Tier Hot-spots Transparent reorganization Optimized performance and throughput What is Easy Tier? – A function that dynamically re- distributes active data across multiple tiers of storage class based on workload characteristics – The goal being to reduce response time – Users have automatic and semi-automatic extent based placement and migration management SSDs HDDs Automatic Relocation Hot-spots Optimized performance and throughput Why it matters? – Solid State Storage has orders of magnitude better throughput and response time with random reads – Full volume allocation to SSD only benefits a small number of volumes or portions of volumes, and use cases – Allowing dynamic movement of the hottest extents to be transferred to the highest performance storage enables a small number of SSD to benefit the entire infrastructure – Works with Thin-provisioned Volumes

IBM Easy. Tier PRELIMINARY 240% from Original Brokerage transaction Application Transaction Throughput Easy Tier IBM Easy. Tier PRELIMINARY 240% from Original Brokerage transaction Application Transaction Throughput Easy Tier In Action Easy Tier Learning 12 hours (Elapsed Time) 18

Snapshots, backup etc. Backup, Recovery, Tests, Flash. Copy • Full • Snapshot Target Backup Snapshots, backup etc. Backup, Recovery, Tests, Flash. Copy • Full • Snapshot Target Backup Cascaded copy – copy from copy Reverse Flash. Copy Vol 1 Flash. Copy target of Vol 0 Source Target Map 1 Vol 2 Flash. Copy target of Vol 1 Source OR Map 2 2. Reverse Flash. Copy ap M 256 copies 3 Source Map 4 Vol 3 Flash. Copy target of Vol 1 Vol 4 Flash. Copy target of Vol 3

Advanced Copy Services Volume Mirroring Flash. Copy Metro Mirror Global Mirror Volume Mirroring Point-in-Time Advanced Copy Services Volume Mirroring Flash. Copy Metro Mirror Global Mirror Volume Mirroring Point-in-Time Copy Synchronous Mirror Consistent Asynchronous Mirror “outside the box” 2 close sites (<10 Km) Warning, there is no consistency group Warning, this is not real time replication – Write IO response time doubled + distance latency – No data loss 2 close sites (<300 Km) Warning, production performance impact if inter-site links are unavailable, during microcode upgrades, etc. – Limited impact on write IO response time – Data loss – All write IOs are sent to the remote site in the same order they were received on source volumes – 1 source and 1 target volumes + change volumes on each site 2 remote sites (>300 Km) Vol 0 R W Vol 0’ Storwize V 7000 Internal Storage 20 External Storage Internal Storage Source and target can have different characteristics and be from different vendors Source and target can be in the same cluster Remote Copy between SVC & Storwize V 7000 is supported

Non-disruptive Data Migration Traditional SAN 1. Stop applications 2. Move data 3. Re-establish host Non-disruptive Data Migration Traditional SAN 1. Stop applications 2. Move data 3. Re-establish host connections 4. Restart applications Storwize V 7000 1. Move data Host systems and applications are not affected In both cases, if it is with a new back-end external storage, you need to… – – Cabling, Change the SAN zoning, Create arrays & create LUNs in the arrays, Assign those LUNs to the server or Storwize V 7000 Once Managed Disk Groups are created using the assigned LUNs, Volumes will be migrated between MDG with just one command/click SAN Migration scenarios: – – Image mode to image mode Image mode to managed mode Managed mode to image mode SAN Storwize V 7000 Migrate on-line to decommission, up-Tier, down-Tier, re-Tier… Image mode = Native mode Managed mode = Virtual mode

HARDWARE COMPONENTS HARDWARE COMPONENTS

IBM Storwize v 7000 unified innovative GUI Snapshot SAN Easy Tier virtualization RAID Unified IBM Storwize v 7000 unified innovative GUI Snapshot SAN Easy Tier virtualization RAID Unified IBM Storwize V 7000 IBM Active Cloud Engine™ Cluster system* NAS

Storwize V 7000 Overview Modular Hardware Building Blocks Software inherited from prior Offerings plus Storwize V 7000 Overview Modular Hardware Building Blocks Software inherited from prior Offerings plus Enhancements Software inherited from SVC and DS 8000 RAID New and enhanced Software functions • FCP, i. SCSI & FCo. E • RAID 0, 1, 5, 6, 10 • Storage Virtualization (Internal & external disks) • Non-disruptive Data Migration • Global & Metro Mirror (Multi-site) New! • Flash. Copy (Point-In-Time Copy) • Thin Provisioning • Real Time Compression • New GUI (Easy-to-use, web based, XIV like) • Easy Tier. TM SSD exploitation • RAID & enclosure RAS services and diagnostics • Additional scalability improvements • Enhanced Host, Controller and ISV interoperability • Integration with IBM Systems Director • Enhancements to TPC, FCM and TSM support

Enclosure Front View 2076 -112/212/312 – 12 x 3. 5” LFF Drive Bays – Enclosure Front View 2076 -112/212/312 – 12 x 3. 5” LFF Drive Bays – Four columns of three horizontally mounted drive carriers – Drive slots are numbered 1 to 12 starting top left and going left to right and top to bottom 2076 -124/224/324 – 24 x 2. 5” SFF Drive Bays – One row of 24 vertically mounted drive carriers – The drive slots are numbered 1 to 24 from left to right 25

Drive Options Drive Type Drive Name Drive Sizes SSD (e. MLC) Model 124/224 2. Drive Options Drive Type Drive Name Drive Sizes SSD (e. MLC) Model 124/224 2. 5” Small Form Factor (SFF) Vendor STEC Hitachi Hikari Ralston Peak 200, 300 & 400 GB SAS 15 K RPM Seagate Hornet 146 & 300 GB Firefly 300 GB Firestorm 450, 600 & 900 GB Seagate NL-SAS 7. 2 K RPM Model 112/212 3. 5” Large Form Factor (LFF) SAS 10 K RPM Seagate NL-SAS 7. 2 K RPM Seagate 1 TB Muskie 2 & 3 TB

Control Enclosure Rear View Top node canister Four 2/4/8 Gbps Fibre Two USB 2 Control Enclosure Rear View Top node canister Four 2/4/8 Gbps Fibre Two USB 2 ports Channel ports Power Supply Unit (PSU) Power Cooling Module (PCM) & Battery Note: identical but installed upside down Two 1 Gbps Ethernet ports Two 6 Gbps SAS ports (connections to expansions) Two 10 Gbps Ethernet ports Power Supply Unit (PSU) Power Cooling Module (PCM) & Battery Bottom node canister Note: identical but installed upside down 27 10 Gbps dual port Converged Network Adapter (CNA) can now carry not only i. SCSI but also FCo. E frames

Modular Scalability • Start with a single control enclosure (a pair of controllers) – Modular Scalability • Start with a single control enclosure (a pair of controllers) – And add up to 9 expansion enclosures to scale-in • Mix 2. 5” & 3. 5” drive enclosures • Mix drive type and drive size in an enclosure • Add control enclosures independently of expansion enclosures – Build a cluster (a Grid) of controller pairs to scale-out – Add expansion enclosures as required for capacity and performance Control Enclosures Expansion Enclosures

Overview of the I/O Stack. SCSI target • SCSI Target – looks like a Overview of the I/O Stack. SCSI target • SCSI Target – looks like a disk system and presents Volumes to Hosts (HBA driver layer) • Remote Copy – replicates data to second site for disaster recovery • Cache – mirrors writes between nodes in I/O Group • Flash. Copy creates point-in-time copies • Volume Mirroring – provides pointers to two copies of data for high availability • Thin-provisioned Volume – consumes disk space only when data written – Random Access Compression Engine. TM sits parallel to Thin-Provisioning acts in coordination • RACE is running in a controlled binary executable Comperssion • Virtualization – Volume MDisk mappings, non-disruptive data migration • RAID – Internal storage Array 1 array = 1 Mdisk migration • SCSI Initiator – talks to disk backend just like a host accessing LUNs (MDisks) – HBA driver layer Remote Copy Cache Flash. Copy Volume Mirroring Thin-provisioning

Virtualisation Concepts & Limits Enhanced! Hosts Volumes • Up to 2, 048/8, 192 Volumes Virtualisation Concepts & Limits Enhanced! Hosts Volumes • Up to 2, 048/8, 192 Volumes per IO group/cluster • Max. Volume size of 256 Ti. B • Image Mode = Native Mode • Managed Mode = Virtualized Mode LAN Internal Storage SSD 1 to 8/16 drives (HDD) to form an Array 1 Array Managed Disk (MD) • Up to 256/1024 Hosts per IO group/cluster • Up to 512/2048 FC ports per IO group/cluster • Up to 256/1024 i. SCSI ports per IO group/cluster Single Multipath driver (SDD, MPIO) i. SCSI, FCP or FCo. E Host Mapping Storage Pools SAN • Up to 128 MDisks per Storwize Storage Pool V 7000 • Up External to 128 NL-SAS storage pools Storage per cluster Multiple Storage Subsystems Pool 2 Pool Vol 3 Vol 73 Vol 4 1 LUN Managed Disk (MDisk) SAS Pool Vol 1 Vol 21 Internal Storage Pool 4 Vol 5 Pool 5 Vol 6 External Storage Up to 4, 096 MDisks Max. External MDisk Size of 2 Ti. B Or greater(1) Round-robin port selection for back-end storage subsystems

 • • • Volume Mirroring Volume copy 1 • Easy. Tier: Automatic relocation • • • Volume Mirroring Volume copy 1 • Easy. Tier: Automatic relocation of hot and cold extents SSDs HDDs Automatic Relocation Hot-spots Up to 256 – Partial (no background copy) – Space Efficient – Incremental Vol 0 Source Map 1 Vol 1 Flash. Copy target of Vol 0 Vol 2 Flash. Copy target of Vol 1 Map 2 – Cascaded Map 4 – Consistency Groups Vol 3 Flash. Copy target of Vol 1 – Reverse Vol 4 Flash. Copy target of Vol 3 Microsoft Virtual Disk Service & Volume Shadow Copy Services hardware provider Remote Copy (optional) – Synchronous & asynchronous remote replication with Storwize V 7000 Consistency groups • Optional Cycling Mode using snapshots Consolidated MM or GM Relationship DR Site Relationship Storwize V 7000 Volume copy 0 – Full (with background copy = clone) 3 • Snapshot-Flash. Copy (Point-In-Time copy) – Up to 256 target per source ap M • • Storwize V 7000 u Features New! FCP, i. SCSI & FCo. E Block Access Protocols, and file (NAS) • Cache partitioning Easy to use GUI – Real Time Performance Statistics Embedded SMI-S agent E-mail, SNMP trap & Syslog error event logging Authentication service for Single Sign-On & LDAP Virtualise data without data-loss – External storage virtualization (optional) Thin-provisioned & Compressed Volumes • – Reclaim Zero-write space • – Thick to thin, thin to thick & thin to thin migration Volume Expand or shrink Volumes on-line Storwize V 7000 On-line Volume Migration between MDisk Storage Pools & IO groups Source Target Volume Optimized performance and throughput MM or GM Relationship Storwize V 7000 • VMware – Storage Replication Adaptor for Site Recovery Manager – VAAI support & v. Center Server management plug-in

Data Movement - V 7000 unified Information Lifecycle Management /home/appl/data/web/ /appl important_big_spreadsheet. xls big_architecture_drawing. Data Movement - V 7000 unified Information Lifecycle Management /home/appl/data/web/ /appl important_big_spreadsheet. xls big_architecture_drawing. ppt /data unstructured_big_video. mpg No change to the logical directory /web 5. Perform results of scan Management role Active* Storwize V 7000 Unified Interface role Storage role File Module All File Modules participate in parallel data movement Interface role Management role Standby* Storage role File Module ACE Storage Module

Data Movement Hierarchical Storage Management /home/appl/data/web/ /appl important_big_spreadsheet. xls big_architecture_drawing. ppt /data unstructured_big_video. mpg Data Movement Hierarchical Storage Management /home/appl/data/web/ /appl important_big_spreadsheet. xls big_architecture_drawing. ppt /data unstructured_big_video. mpg /web External TSM server 5. Perform results of scan Management role Active* Storwize V 7000 Unified Interface role Storage role File Module Interface role Management role Standby* Storage role File Module ACE Storage Module Stub files left on disk Auto-recall if accessed . . . Tier 3

User Interface Based on the well-received XIV interface System recommendations Visual task flow guidance User Interface Based on the well-received XIV interface System recommendations Visual task flow guidance Integrated video instruction System status always available 34 Link to more information if needed

VMware Site Recovery Manager leverages VMware Infrastructure to transform disaster recovery • What it VMware Site Recovery Manager leverages VMware Infrastructure to transform disaster recovery • What it is: – Site Recovery Manager is a VMware product for disaster recovery • What it does: – Simplifies and automates disaster recovery processes • Discovery of replicated storage • Non-disruptive failover test using a writable copy of replicated data • Emergency and planned failover • Reverse replication after failover as part of failback • Restore replication after failover as part of a production test • Site Recovery Manager works with VMware Infrastructure to enable faster, more reliable, affordable disaster recovery

VMware v. Storage API for Array Integration VAAI support • Integration with v. Storage VMware v. Storage API for Array Integration VAAI support • Integration with v. Storage API’s to improve performance – Full copy (and Block zeroing which was delivered in 6. 1. 0) offload work from production virtual servers to storage which improves application performance – Hardware-assisted locking enables a finer grained level of locking on VMFS metadata which is more efficient and also scales better in larger VMware clusters VMware Storage Stack • Example tasks that can benefit from improved performance : Provisioning / Cloning VMFS NFS VMware LVM NFS Client Data Mover v. Storage APIs – VM creation/cloning/snapshots/deletion – v. Motion and storage v. Motion – Extending a VMFS Volume – Extending the size of a VMDK file NFS v. Storage API for Multi. Pathing HBA Drivers Network Stack NIC

VMware Storage Management • Gives a detailed look at current storage use Plugin • VMware Storage Management • Gives a detailed look at current storage use Plugin • Supports Storwize V 7000, Storwize V 7000 Unified, Scale Out NAS, SAN Volume Controller & Xi. V • Easy to use GUI • Allows the VMware operator to provision storage to: – Create datastores – Create RDMs – Extend existing datastores and RDMs – Move datastores and RDMs between storage pools

Flexible Storage Infrastructure with Storwize V 7000 Make changes to the storage without disrupting Flexible Storage Infrastructure with Storwize V 7000 Make changes to the storage without disrupting host applications Volume SAN Manage the storage pool from a central point Storwize V 7000 / SVC Apply common copy services across the storage pool Advanced Copy Services Storage Pool HP DS 8000 HDS DS 4000 EMC Combine the capacity from multiple arrays into a single pool of storage

IBM Smarter Storage for Smarter Computing Efficient by design • With Smarter Storage, essential IBM Smarter Storage for Smarter Computing Efficient by design • With Smarter Storage, essential storage technologies are built in and tightly integrated. Efficiency is effortless – requiring no manual intervention. Management is intuitive and easy – improving the efficiency of your most important asset, your people. Self-optimizing • Smarter Storage analyzes data access patterns, adapts and improves

piotr. biskupski@pl. ibm. com +48 723703549 innovation that matters piotr. [email protected] ibm. com +48 723703549 innovation that matters