Enterprise Storage A Tale of 2 Solutions Andy

Enterprise Storage A Tale of 2 Solutions Andy Stone Principal Consultant ICL IT Consultancy ã International Computers Limited 1999 Copyright ICL 2001

Memory Lane 1970 s 1990 s Sorry mate, awaiting spares EDS 8 ED 60 FDS 640 Won’t connect to that, FDS 300 different interface. FDS 760 Switching to NT? scrap the lot SA 100 & start again SA 300 SAT 300 ã International Computers Limited 1999 Copyright ICL 2001

Enterprise Disc Storage Attributes/Features: Ø Scaleable Ø Business Continuity Ø Fast Ø Data sharing Ø Failure free Ø Serverless backup Ø Non stop Ø Fast backup Ø Shareable Ø Config independent ØOS/Platform ØOS ØPlatform ã International Computers Limited 1999 Copyright ICL 2001

The Players Ø EMC Ø Symmetrix Ø Clarion Ø IBM Ø ESS (Shark) Ø Hitachi Data Systems (HDS) Ø Freedom Series Ø Fujitsu Ø TBA Ø Storageworks ã International Computers Limited 1999 Copyright ICL 2001

Enterprise Disc Storage Feature EMC Symmetrix IBM shark Scaleability up to 34 TB Connect : SCSI up to 32 ports up to 16 ports Fibre Platform/ OS Backup SAN Support Data sharing Most platforms/OS Timefinder (instant) Yes Timefinder /Infomover up to 11. 6 TB approx 6 Flashcopy (instant) Yes Volume share/ Business Continuity SRDF pprc Systems Management Browser/Agent ã International Computers Limited 1999 Copyright ICL 2001

Storage Connection Fibrechannel V SCSI Fibre Channel 100 MB/Sec 4 wire cable or fibre optic 500 metre cabling 126 devices/loop Easy cabling Non disruptive expansion No terminators Signal isolation Storage & network Hubs, switches etc V SCSI 20 or 40 MB/Sec 68 wire cable 25 metre cabling 16 devices per bus Complex cabling Non disruptive expansion Not supported No signal isolation Storage only No interconnection ã International Computers Limited 1999 Copyright ICL 2001

Fibre Channel SAN Types Point-to-Point 100 MB > < 100 MB Arbitrated Loop 100 MB Switched Fabric 100 MB ã International Computers Limited 1999 Copyright ICL 2001

Fibre Channel SAN Types NT Unix AL & Switched Fabric Storage Control Storage Frame Novell MVS NT Shared Fibre VME AS 400 Fabric Switch Server to Storage mapping Solaris Does not signify support! ã International Computers Limited 1999 Copyright ICL 2001

Enterprise Storage Features Remote Data Mirroring Kingston Datacentre Development Crawley Datacentre Production VME NT NT Remote Volume Mirroring Storage Other OS (NT, Unix) Storage Campus/ Continent ESCON Fibre ATM Other OS (NT, Unix) EMC – SRDF Not - PPRC IBM VME ã International Computers Limited 1999 Copyright ICL 2001

Enterprise Storage Datacopy Features Ø Allows flash archive of volume data Ø Achieved via. background copy of coherent groups of discs Ø System quiesced only for copy split process Ø Copy can be utilised for: Ø Ø Ø Tape backup Test data Batch jobs Data warehousing Read only DB copy Copy recovery (a two way process!) EMC – Timefinder IBM - Flashcopy ã International Computers Limited 1999 Copyright ICL 2001

The Solutions Project 1 EMC Symmetrix and SRDF Design and implement a DR facility for an established corporate server with failover times of < 2 hours A Major financial institution processing up to 50 M transactions/day. Project 2 ESS Shark – no storage software features Design and implement a very large, scaleable, fast, highly available document management system. A Major financial institution requiring online storage and retrieval of Mortgage documentation. ã International Computers Limited 1999 Copyright ICL 2001

Project 1 – DR Facility Kingston Design Schematic Crawley 50 Km Production Development Symmetrix Only writes pass across the network ATM Network Local Recovery possible in < 1 hr ã International Computers Limited 1999 Copyright ICL 2001

Project 1 – DR Facility Common Activities Project Stages Ø Detailed Project design Ø Buy in from all departments Ø Link sizing and implementation Ø Capacity, latency and resilience Ø EMC frame(s) specification and setup Ø Check, recheck & check again Ø Application impact study Ø Do not assume applications will function on system clone. Ø Application change plan Ø Tapes! Ø Testing strategy Ø Potentially destructive Ø Operations and Technical Processes Ø Storage Management and Control ã International Computers Limited 1999 Copyright ICL 2001

Project 1 – DR Facility Common Ø Develop SRDF Scripts Ø Failover should be manual Ø Operations processes Ø System identities Kingston (Prod) Ø Move all Filestore to EMC Ø Isolate ‘local filestore’ Ø Engineer Kingston catalogue Ø Crawley knowledge Ø Filestore synchronisation Ø Test Failover Crawley (Dev) Ø Move all Filestore to EMC Ø Isolate ‘local filestore’ Ø Engineer Crawley catalogue Ø Kingston knowledge Ø Test VME service load and Apps. Ø Test failback procedure Ø SRDF Live ã International Computers Limited 1999 Copyright ICL 2001

Project 1 – DR Facility !Gotchas! Ø Links Ø Expensive Ø Long lead times Ø Environment Ø Applications have dependencies! Ø Tapes Ø Does the system assume tape availability Ø Health warning Ø SRDF is a VERY powerful facility Ø GUI/DOS command control Ø EMC AS 400 fix Ø Catalogue Maintenance ã International Computers Limited 1999 Copyright ICL 2001

The Solutions Project 1 EMC Symmetrix and SRDF Design and implement a DR facility for an established corporate server with failover times of < 2 hours A Major financial institution processing up to 50 M transactions/day. Project 2 ESS Shark – no storage software features Design and implement a very large, scaleable, fast, highly available document management system. A Major financial institution requiring online storage and retrieval of Mortgage documentation. ã International Computers Limited 1999 Copyright ICL 2001

Project 2 – Strategic Document Store Customer Requirements Ø 200 million Documents (10 Terabytes) Ø 24 x 7 and Disaster Tolerant ØDR Facility ØAble to store any Electronic “Document” ØPerformance Ø 20, 000 additions per hour Ø 60, 000 retrievals per hour Ø< 2 seconds response times ØPotential 70, 000 desktops in the Group ØIntranet based ã International Computers Limited 1999 Copyright ICL 2001

Project 2 – Strategic Document Store Storage and Retrieval System Web Browser Meridio Web Gateways Web Server Document Meta. Data rd f ata Migration System Tr a e nsf rom we Po on isi Relational Database Meridio Content Servers rv Scanning and Indexing System ã International Computers Limited 1999 Copyright ICL 2001

Project 2 – Strategic Document Store “I like the solution - but I want it on IBM hardware!” Director Of Group I. T. Ø Technical overview Ø Storage: IBM ESS (shark) ~3 Tb Ø Backup: IBM Magstar tape library Ø Servers: IBM Netfinity data/web servers, running NT 4, IIS, SQL*Server, Meridio Ø Retrievals: Browser based, Active. X control for power users Ø Desktops: Initially ~ 1000 desktops over three sites ã International Computers Limited 1999 Copyright ICL 2001

Project 2 – Strategic Document Store Architecture Scale Present ESS (Shark) 3. 6 TB 1 TB 20 M Docs Contents Server 100 GB Index Data 5. 8 TB (11. 6) Fibrechannel 100 MB/fibre Netfinity Servers (4 Way) Contents Server Index Server 8 Way SCSI 40 MB/Channel Magstar 11 decks 76 Drives 850 Carts 6240 Carts (40 GB/Cart) ã International Computers Limited 1999 Copyright ICL 2001

Project 2 – Strategic Document Store Performance Metrics Ø Performance - in load testing Ø System loaded with ~1. 2 Tb of documents (range of sizes) Ø Simultaneous input of 70, 000 documents an hour, retrieval of 200, 000 docs per hour Ø Full backup of 3 Tb in ~10 hours Ø Initial production data Ø Document images Ø Volume of ~40 m pages (~1. 8 Tb) Ø Migrated from optical media in 60 days ã International Computers Limited 1999 Copyright ICL 2001

Project 2 – Strategic Document Store !Gotchas! Ø ESS Storage Ø Immature Ø Difficult to Change Ø (Very quick) Ø Performance Measurement Ø Traffic generation Ø Backup Ø Coordination between Meridio and Legato Ø Windows NT 4 Ø Limited filestore support Ø Clustering Ø Tapes Ø Legato support of Magstar Ø Tape system lacks media database ã International Computers Limited 1999 Copyright ICL 2001

Storage EMC v IBM Symmetrix Up to 34 TB in 1 Frame RAID 1 or RAID S Online repair, phone home etc Config via BIN file – 5 day lead Facilities rich: SRDF Timefinder Infomover EDM Mature product Support on most platforms Check versions Connection types Reassuringly expensive V ESS (Shark) Up to 11. 6 TB in 1 Frame RAID 5 Online repair, phone home etc Config via Browser manager Limited facilities: pprc Flashcopy Developing product Limited platform support Competitively priced ã International Computers Limited 1999 Copyright ICL 2001