db147dfa2407e65d5bed193372f73c1b.ppt
- Количество слайдов: 41
HP Storage. Works Enterprise File Services Clustered Gateway Rajesh Goel Storage Presales Lead © 2006 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice
HP Storage. Works Product Portfolio
HP Storage. Works arrays: Modular, flexible and scaleable storage 4 Gb XP Family 4 Gb EVA Family EVA 8000 EVA 6000 Aggregate Throughput MSA Family EVA 4000 Always-on Availability < 332 T Bytes • Low Cost Consolidation < 48 T Bytes • • • WEB, Exchange, SQL Simple DAS-to-SAN (Pro. Liant) Windows, Linux, Netware + more Outstanding TCO < 120 T Bytes • • • Storage consolidation + disaster recovery Simplification through virtualization Windows, HP-UX, Linux, + more Scalability • • Data center consolidation + disaster recovery Large scale Oracle/SAP applications HP-UX, Windows, + 20 more including mainframe
EVA models EVA - GL EVA - XL Model EVA 3000 EVA 5000 EVA 4000 EVA 6000 EVA 8000 Controller HSV 100 HSV 110 HSV 200 HSV 210 Cache size (controller pair) 2 GB 4 GB 8 GB Host ports (controller pair) 4 4 8 Device ports (controller pair) 4 8 4 4 8 Mirror ports (controller pair) 2 2 4 4 4 Backend loop switches None 4 None 2 4 Drives enclosures 1 -4 2 -18 1 -4 4 -8 2 -18 Range of drives 8 -56 8 -240 8 -56 16 -112 8 -240 Base configurations 2 C 1 D 2 C 2 D 2 C 1 D 2 C 4 D 2 C 2 D 2 C 6 D 2 C 12 D
HP Storage. Works EVA 4000/6000/8000 Max Disk Drives Max Capacity 56/112/240 16. 8/33. 6/72 TB (Raw) Max Sequential Data Transfer Rate 360/720/1300 MB/s Max Random IOPS from Cache Max LUNs 141, 000/20 0, 000+ 4/4/8 GB 1024 Excellent Performance, Capacity, and Reliability for Departmental Workgroups
EVA - Architecture / Concepts
Traditional RAID vs Vraid SCSI Bus 1 RAID SCSI Bus 2 SCSI Bus 3 SCSI Bus 5 SCSI Bus 6 Tedious, manual volume placement and management RAID 5 Volume RAID 0 Volume Logical Vraid SCSI Bus 4 Vraid 5 Virtual Disk RAID 1 Volume Vraid 0 Virtual Disk Physical Vraid 1 Virtual Disk
The EVA Value Proposition The Powerfully Simple Array! Great array functionality plus • Automation = fewer steps • Aggregation = fewer things to manage: • fewer RAID groups • fewer LUNs ive etit tion p com forma s! HP in nth for king mo o r ok Lo hma xt tw e nc be the n in
Virtualization – How we do it Linux W 2 K cluster HP-UX TRU 64 OVMS Solaris AIX Netware LUNs 100 GB 200 GB SAN Fabric 100 GB SAN Fabric 200 GB Virtual Disks • 1 -16 Disk Groups 8 -240 disks per disk group Disk Group 1 • Up to 1024 Virtual Disks (LUNs) Un-grouped disks
Virtualization – How we do it Linux W 2 K cluster HP-UX TRU 64 OVMS Solaris AIX Netware LUNs 100 GB 200 GB SAN Fabric 100 GB SAN Fabric 200 GB Virtual Disks Disk Group 1 • Add disks to a Disk Group non disruptively – VDisk re-levels across the extra spindles Un-grouped disks
Virtualization – How we do it Linux W 2 K cluster HP-UX TRU 64 OVMS Solaris AIX Netware LUNs 100 GB 200 GB SAN Fabric 100 GB SAN Fabric 200 GB Virtual Disks Disk Group 1 • Add disks to a Disk Group non disruptively – LUN re-levels across the extra spindles Un-grouped disks
Virtualization – How we do it Linux W 2 K cluster HP-UX TRU 64 OVMS Solaris AIX Netware LUNs 100 GB 200 GB SAN Fabric 100 GB SAN Fabric 200 GB Virtual Disks Disk Group 1 • Remove disks non disruptively from the Disk Group Un-grouped disks
Enterprise Virtualization: Distributed Sparing Disk 1 Disk 2 Disk 3 Disk 4 Disk 5 Disk 6 Disk 7 Disk 8 Disk 9 Disk 10 Data 10 Allocated space due to Distributed Sparing Data 2 Data 4 Data 6 Data 8 Parity 10 Data 9 Parity 9 Data 7 Data 7 Parity 7 Data 8 Parity 8 Data 8 Parity 5 Data 5 Data 6 Parity 6 Data 3 Parity 3 Data 4 Parity 4 Data 1 Data 1 Parity 1 Data 2 Parity 2 Data 2 Parity 10 Data 10
Enterprise File Services – Meeting Enterprise Business Needs Enterprise Clustered Gateway • Scalability • Availability • Multi protocol support Manageability En ter pris e. F ile Se rv ice s Solution Capabilities Branch Office Small and medium business WAN Accelerator • LAN performance over the WAN • Application server consolidation • Eliminate remote office backup issues Complete line of HP Pro. Liant Storage Servers
What Customers are saying: • • Don’t lock me into a proprietary system My storage is rapidly increasing and I have less people • I want to leverage my investment – people, equipment, processes, etc. • I think I’m paying too much! File Serving Needs • Scalability • High availability • High performance file serving needs • Industry standard solutions
Overview and Benefits
HP Storage. Works Enterprise File Services Clustered Gateway Delivering high performance file serving for the Enterprise Client LAN Client Scalability and performance Linear scalability up to 16 nodes • 16 TB file systems – 1000’s of TB total storage • Write throughput approaching 2. 5 GB/s Availability • • HP Clustered File System Fully transparent failover – preserving client state information Storage Utilization SAN Fabric • • Create a single pool of storage Virtualization across heterogeneous storage Manageability • • • Manage the cluster from anywhere Utilize standard HP management tools Standard OS integrates into data center Value • Animated Slide • Industry leading price performance Industry standard components
HP Clustered Gateway: Architecture Overview • Multiple Windows 2003 or Linux servers can form a single logical Windows NAS Cluster – like a large virtual server • All file servers can cache and serve all files – no hotspot problem • Clients are load-balanced across all file servers • HP Clustered Gateway is fault tolerant • HP Clustered Gateway is operationally efficient: − One set of files to backup − Backup up the shared storage, not each server − One copy of files can be shared across all servers (no replication required) Client LAN HP Clustered File System SAN Fabric Client
Leverage Your Storage Investment Build a file serving solution that scales as your storage scales. • HP Storage • Fully compatible with HP’s complete line of SAN storage including MSA, EVA and XP • EVA Snapshot capability integrated (3. X products) • Ideal File Serving solution for HP arrays • Third Party Storage • Partial list of storage arrays includes EMC CLARii. ON, HDS Thunder and Lightning, Data. Direct Networks, etc.
Flexibility with Scalable NAS Clusters • Can add servers, storage as needed − Take advantage of improving server speeds in mass market − Incrementally upgrade CPU capacity on as-needed basis − Roll out new cluster servers with zero cluster downtime • Can mix NAS and direct SAN access − Servers in cluster are standard Intel machines − Run applications on the cluster for direct-to-SAN I/O throughput − Support simultaneous CIFS, NFS and direct-from-cluster access to data • Can use standard administrative tools − Use standard backup products on cluster servers—no need for custom agent support • Backup Server Can customize servers for specific tasks − Dedicate server to backup, if desired; no impact on NAS servers • NFS Servers NFS Cluster with Dedicated Backup Server Can save backup license costs—one server backs up whole cluster!
Unlimited Backup Windows • Any One server can back up all file systems – even in a 16 node cluster • Backup the shared cluster file systems, not the nodes – fewer admin jobs • Step 1: Snapshot in Storage array • Step 2: Mount snapshot in cluster • Step 3: Backup snapshot • Easily automated • Users have continuous uninterrupted access to live data at all times • Only one copy of backup software license required All servers backed up centrally Recover to any other server • Use standard administrative tools and backup products (eg, Veritas)
Product Information
HP Storage. Works DL 380 -SL Clustered Gateway 390820 -B 21 – Initial Cluster 390819 -B 21 – Single Node Note: Strongly recommended for the first cluster at a customer site. 2 Nodes 390819 -B 21 + Installation and Startup Service Optionally • Additional nodes – up to a total of 16 • HP Pro. Curve 2848 Ethernet switch • HP Storage. Works 4/32 FC SAN switch • Interconnect cables and PDU as appropriate Hardware • HP Pro. Liant DL 380 G 4, 4 GB • Two (2) Intel 3. 4 GHz Proc, 800 MHz FSB • Redundant power supplies & fans • 2 X 36 GB SCSI Drives • 2 GB Dual Channel PCx FC HBA • 2 x 10/1000 NIC embedded • HP NC 7771 PCI-X Gigabit Server Adaptor Software • SUSE Linux OS v 9 Enterprise Server • HP Storage. Works Clustered File System Software • HP Storage. Works Clustered Volume Manager Software –LTU (optional) 391672 -B 21 Support • H/W 24/7 – 4 hour onsite • S/W – 1 year
HP Storage. Works DL 380 -WSS SKUs 399269 -B 21 – Initial Cluster 399268 -B 21 – Single Node Note: Install and Startup service is strongly recommended for the first cluster at a customer site. 2 Nodes 399268 -B 21 with Installation and Startup Service Optionally • Additional nodes – up to a total of 16 • HP Pro. Curve 2848 Ethernet switch • HP Storage. Works 4/32 FC SAN switch • Interconnect cables and PDU as appropriate Hardware HP Pro. Liant DL 380 G 4, 4 GB • Two (2) Intel 3. 4 GHz Proc, 800 MHz FSB • Redundant power supplies & fans • 2 X 36 GB SCSI Drives • 2 GB Dual Channel PCx FC HBA • 2 X 10/1000 NIC embedded • HP NC 7771 PCI-X Gigabit Server Adaptor Software • Windows Storage Server 2003 • HP Storage. Works Clustered File System Software Support • H/W 24/7 – 4 hour onsite • S/W – 1 year
Legacy File Serving Silos Managed Entities 24 Backup Jobs 24 Average Utilization 15% to 25% Hot Upgrades No Number of Free Space Puddles 24 Storage Utilization Uneven Max File System Throughput 200 Mb/sec Acquisition Cost 550 K Annual Operating Cost 210 K Three Year TCO 1, 180 K
HP Clustered Gateway: File Server Consolidation Managed Entities 5 Backup Jobs 1 Average Utilization 55 - 75% Hot Upgrades Yes Client Number of Free 1 Space Pools Storage Utilization High Max File System Throughput 1, 150 Mb/sec Acquisition Cost 300 K Annual Operating Cost 55 K Three Year TCO 465 K Client LAN HP Clustered File System SAN Fabric Client
High Throughput Workloads: The Challenge • New applications − High Performance Computing − Content serving − Digital media/video processing − Bio-informatics • Huge bandwidth requirements − Scaling to 1000 s MB/s − Incremental scaling • Desire to leverage standard components − Standard Pro. Liant (Blades coming) − Standard HP storage − Standard protocols (NFS and CIFS) • The Solution: HP Clustered Gateway ( Windows or Linux)
Clustered Gateway: Scalability • Linux NAS Cluster Supports Scalable NFS − Clients are spread across nodes − Can use round-robin assignment or load balancer − Server failover protects data availability • High degree of scalability − Scales to over 1000 MB/s − Can grow from small cluster to 16 nodes − Can use mix of different server, storage types • Uses standard components − Standard hardware/software − Standard protocols (NFS, and can serve CIFS to Windows) # Servers Mbytes/Sec. Scale Factor Scaling Coefficient 1 123. 19 1. 00 100% 2 246. 38 2. 00 100% 4 492. 75 4. 00 100% 6 739. 13 6. 00 100% 8 985. 50 8. 00 100% 9 1, 084. 24 8. 80 98% 10 1, 195. 91 9. 71 97%
Technical Information
Architecture: HP Clustered Gateway Animated Slide Clients Public (data) Network Clustered Gateway Nodes IP Switch Node Private Network (Intra-Cluster) Node IP Switch FC Switch SAN Storage
Architectures: Distributed File Systems What CGW is NOT Director Meta Data Node(s) Node Storage • • • Client Network Director Meta Data Node(s) Node Storage Each node has a piece of the overall file system Hot spots are a typical problem Requires redundant fail-over hardware pairs Node Storage • • Node Storage HP SFS adds striping for performance Net. App Spinnaker is one of these
Architectures: Clustered (SAN) File Systems What CGW IS: Client Network Node Shared Storage SAN • • Each node attached to the same shared (SAN) storage HP Clustered Gateway fall into this catagory Node
Architectures: “Shared Nothing” Symmetrical /Dir 1/File 1 /Dir 2/File 2 /Dir 3/File 3 Node Node /Dir 2/File 2 /Dir 3/File 3 Node /Dir 1/File 1 /Dir 2/File 2 /Dir 3/File 3 • All Nodes see the same storage • Any file can be presented by any client concurrently • Each node has its own storage • On failover, storage is moved to another node • Files are served only by a single node (hot spots)
HP Clustered Gateway Symmetrical File Systems Animated Slide Client Network CGW Node Storage CGW Node Storage SAN • • Each node sees the complete file system Any node can fail over for any other • More efficient use of node hardware • • Eliminates hot spot & load balancing issues Distributed Lock Manager – scales with cluster
HP Storage. Works Clustered Volume Manager Software (optional) Improve storage utilization across cluster. • Collapse storage silos into a single higher utilized storage pool • 16 TB per file system • Concatenation or striping of LUN’s Optimize for price-performance. • Use many cost-effective arrays/LUNs instead of single expensive array • Stripe across many arrays/LUNs for best performance Cluster File System Shared Volume Physical Storage Devices Flexibly manage storage across your business. • On-line volume growth • Single shared pool of data to provision, manage, and backup
HP Clustered Gateway Virtualization: Cluster Volume Manager CGW Node Animated Slide CGW Node Write Request Cluster Volume Manager Storage SAN • Provides Virtualization / Aggregation • Provides Performance Striping
Cluster Volume Manager Growing Volumes (concatenation) Each sub device is completely filled before using next one 300 GB (Full) 100 GB (Full) 200 GB Animated Slide
Cluster Volume Manager Best Practices 150 GB 100 GB 200 GB Data Striped across multiple LUNs Wasted Space • Each LUN in a stripe set should: o Be the same size o Have the same performance characteristics Wasted Space
Cluster Volume Manager Growing Striped Volumes 100 GB Animated Slide 100 GB Data Striped across multiple LUNs 100 GB 300 GB 100 GB Don’t Do This! Data Striped across multiple LUNs Results in Inconsistant Performance. • Grow striped volumes by adding uniform stripe sets for consistent performance
Special Purpose Nodes Node Animated Slide Node Virus Scan Tape Storage SAN Storage
®


