Скачать презентацию LANL Case Study Funding Computing Support NLIT 2008 Скачать презентацию LANL Case Study Funding Computing Support NLIT 2008

aa0e5e3662623bf3e1e94920df51f768.ppt

  • Количество слайдов: 17

LANL Case Study: Funding Computing Support NLIT 2008 Michael S. Zollinger CTN-1 Group Leader LANL Case Study: Funding Computing Support NLIT 2008 Michael S. Zollinger CTN-1 Group Leader Computing, Telecommunications, and Networking Division UNCLASSIFIED LA-UR-08 -2743 Operated by Los Alamos National Security, LLC for DOE/NNSA

Outline n Overview of Computing Environment at LANL n Historical Overview of Funding Computing Outline n Overview of Computing Environment at LANL n Historical Overview of Funding Computing LANL n What Led to Decision to Change Funding Methodology n New Funding Model n The Resulting Challenges n The Resulting Benefits n Real Pressure Points n Service Delivery Changes n Lessons Learned n Summary UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 2

Overview of the LANL Computing Environment n We are big! • • n Geographically Overview of the LANL Computing Environment n We are big! • • n Geographically - 42 square miles in size User Community - 10, 000+ employees Variety of computing environments • • • Protected Unclassified (Yellow) Network – over 20, 000 devices Various levels of Classified (Red) Networks Public Interface (Green) - approved public information release Visitor Network (Gray) Unclassified Scientific Enclaves (Turquoise) UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 3

Historical Overview of Funding Computer Support n To understand where we are at now, Historical Overview of Funding Computer Support n To understand where we are at now, a brief history lesson is in order n Previous to FY 08 computing support was funded by a mixture of the following: • Centrally provided personnel through a charge back (recharge) mechanism – most prevalent – covered overhead, training, materials and supplies, etc. — — • • • Service Level Agreement (SLA) with each customer organization Demand driven service Matrix (FORM B) arrangement to provide employee to partners with only care and feeding from central organization Customer owned and operated personnel (partner organizations / shadows) – directly funded Institutionally funded services provided by the central support organization – infrastructure tax (levied across all organizations as a tax on labor) Programmatic requirements determined support – standards voluntary UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 4

What Led to Decision to Change Funding Methodology? 1. LANL contract awarded to Los What Led to Decision to Change Funding Methodology? 1. LANL contract awarded to Los Alamos National Security, LLC in 2006 • More corporate style management practices required 2. Reorganization of LANL management structure • • Doubled the number of directorates Increased number of divisions and groups Doubled the number of SLA negotiations Impossible to extract money from customers 3. Requirement to become more efficient in our service delivery and standardized in our approach 4. Decreasing budgets, therefore need for more cost effectiveness required 5. LANL Director desired to fully understand manage the IT expenditures UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 5

New Funding Model n After a weighing the alternatives the decision was made to New Funding Model n After a weighing the alternatives the decision was made to fund support of unclassified standard desktop and server support from Infrastructure Tax • • • n Microsoft Windows RHEL Mac OS X Non-standard (unique programmatic requirements driven) unclassified desktop and server support • • Programs who required their own infrastructure and could not use the centrally managed infrastructure i. e. , email, DNS, home directory storage Non-standard or legacy operating systems — IRIX, True 64, etc. n All classified computer support to remain funded by charge back mechanism n The funding model to be revisited in FY 09 UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 6

Programmatic vs. Infrastructure Dividing Line Institutional Desktop (Unclassified) § Funded – Infrastructure tax § Programmatic vs. Infrastructure Dividing Line Institutional Desktop (Unclassified) § Funded – Infrastructure tax § Support hours § 8 a. m. - 5 p. m. § Central services on call § Help Desk § Remote assistance & problem diagnostics § Dispatch additional support § Deployed on site computer support (Migration to geographic not organizational, where it makes sense) § Configuration management services § Guidelines § Automated build tools § Automated verification tools § Automated SW/HW inventory tools § Support for IA standard software and OS § Computer systems security § Patching/Antivirus § Standard protection Tools § ESD systems access & license management § Central home directories storage § Institutional strategic planning § Servers in support of institutional desktop needs § CTN institutional applications servers § Print services Program and Classified (Custom support) § § Funded - Recharge Support hours § Specialized application client/server support § § § Support for non IA approved operating systems Diskless computing technologies for client/server CTN-5 like services (Institutional-Consolidation opportunities) § § § § Local Servers (Institutional-Consolidation opportunities) Scanning Web servers Data file Chat services Collaboration Server clusters Human Genome NISAC Special projects JTOT SCADA Data acquisition Additional central project storage UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA § 8 a. m. – 5 p. m. unless otherwise negotiated § § § § Pro E (W, WT) Documentum (TA-55, others) Lotus Notes (LC) MRP (TA-55) 3 D Vis (X) Genome Sequencing (B) GIS (ADISS) § § LDAP DNS 7

Budget Facts for FY 08 n Approved infrastructure tax budget for standard desktop support Budget Facts for FY 08 n Approved infrastructure tax budget for standard desktop support • n Number of employees funded • • n $27. 2 M — 90% for time and effort — 10% for operations costs (workplace recharge, training, equipment, etc. ) 175 FTE (full-time employees) $155 K (average loaded cost per support employee) Cost per platform supported • • ~ 20, 000 computers on unclassified computing network — $1360 per computer per year Tech to computer ratio average — ~ 1 : 114 • REMEMBER, this is an average UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 8

Operations Budget – Breaking Down the 10% $621 K 20% Training and travel Local Operations Budget – Breaking Down the 10% $621 K 20% Training and travel Local training and certifications for technicians and tuition reimbursement $1. 05 M 34% Service contracts to support the infrastructure Systems Management Server (SMS) (network updates to all computers), Microsoft, Macintosh, Solaris, Symantec, Red Hat, and Net Apps (storage, delivery, and management of network data and content) $755 K 24% Hardware for infrastructure services ESD (Electronic Software Delivery), SMS, Storage, and CTN technician desktop replacement $466 K 15% Internal program recharges Vehicles, ADSM (Adstar Distributed Storage Manager) backups, ESD annual maintenance, work orders, IST recharge service, DOD (Desktop on Demand), HRP cost. $208 K 7% Workplace recharge Phones, pagers, adds, moves, and engineer services UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA Slide 9

Resulting Challenges n We were not popular around campus n The infrastructure tax rate Resulting Challenges n We were not popular around campus n The infrastructure tax rate increased 3. 5% • • • n 2% was directly attributable to moving approximately 66% of our cost to that infrastructure budget from the charge back methodology In discussions with customers we received the entire blame for the 3. 5% increase Our current customers were impacted, but not as severely as our “partner” organizations — They were taxed whether they used our services or not There was no requirement to use CTN for programmatic computing support • • Programs retained most of their staff and transferred a few personnel to do infrastructure funded support They also transferred their hiring vacancies to us UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 10

Resulting Challenges - cont n 1 st Qtr FY 08 LANL was faced with Resulting Challenges - cont n 1 st Qtr FY 08 LANL was faced with a workforce restructuring • • • Contractors were trimmed first A Voluntary Separation Program was offered — Approximately 500 people left A potential Involuntary Separation (layoff) was averted n Hiring external has been nearly impossible n The initial funding for infrastructure tax funded support has been reduced n All funding for vacancies has been retracted n LANL is under a Security Compliance Order to implement the NAPS on the classified and unclassified networks • No additional resources added UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 11

Resulting Benefits n One Service Level Agreement (SLA) negotiated with senior management for infrastructure Resulting Benefits n One Service Level Agreement (SLA) negotiated with senior management for infrastructure tax funded support! • Instead of 20 to 30 n Funding secured at one level n Programmatic support requirements are more focused n Programmatic customers pay less for same level of support they received previously n Programmatic customers are migrating more of their systems to standard configurations and centralized services n Restructuring of field support to geographic support vs. organizational support is occurring where it makes sense • Support based on organizational affiliation is still happening for scientific multiplatform environments UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 12

Real Pressure Points n The goal is to drive towards more efficient support • Real Pressure Points n The goal is to drive towards more efficient support • • Minimize the need to physically touch computers Support more centrally n The “Catch 22” is that to become more efficient you need to have the headroom to change your business model n This generally requires an increased budget for a period of time to implement new processes and technologies n For LANL, all the budget pressure has been downward and not upward • Do more with less n This is painful n In addition, contract incentives require us to make changes now UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 13

Service Delivery Changes n Moving to geographic model where it makes sense n LANL Service Delivery Changes n Moving to geographic model where it makes sense n LANL Acquisition Strategy Project will provide one purchasing vehicle for computers • • n An evaluation of what we need as a service desk is in process • n Sometime of central provisioning will take place A “blind buy” process will be implemented where manufactures and JIT vendors will not know who the final end customer is for the system Restructuring our current Help Desk approach Certification and Accreditation of the unclassified networks will now apply to the 20, 000+ devices UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 14

Lessons Learned n The fact that all desktop support was not transferred into one Lessons Learned n The fact that all desktop support was not transferred into one organization created a work overload condition for infrastructure funded support n Director initially wanted to fund all support; programmatic and infrastructure out of infrastructure tax • • n We advised against this believing that it would lead to unfettered demand for service — There is unfettered demand anyway May happen in FY 09 The lack of an IT governance model at the inception of this change did not allow for IT portfolio management (prioritization of services) • Which services do we turn off when funding dries up n Managing expectations of customer base is difficult n Relying on infrastructure tax funding puts in competition with: • • Roads and grounds Snow removal Facilities Utility bills UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 15

Summary n Changing our funding model has benefits and challenges n The real payoff Summary n Changing our funding model has benefits and challenges n The real payoff may not be realized for a few more years n Streamlining processes and leveraging resources is a priority n Technology can only solve some the problems n Political change is the most difficult to achieve in any enterprise UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 16

Contact Information Mike Zollinger 505 -667 -5355 msz@lanl. gov Q&A UNCLASSIFIED Operated by Los Contact Information Mike Zollinger 505 -667 -5355 [email protected] gov Q&A UNCLASSIFIED Operated by Los Alamos National Security, LLC for NNSA 17