EGI-In. SPIRE Activity Status Reports CB - 11/04/13 EGI-In. SPIRE RI-261323 1 www. egi. eu
EGI-In. SPIRE NA 2 Community Engagement CB - 11/04/13 EGI-In. SPIRE RI-261323 2 www. egi. eu
Communications PQ 10 • • • EGI Technical Forum held in Prague, attended by 415 participants. Outreach included the launch of the European Globus Online, over 500 Twitter posts, Grid. Cast and articles in i. SGTW and HPCinthecloud. Communications handbook presented to the NILs at EGITF and feedback gathered on the EGI publications First NIL bulletin released in October 2012, to be published monthly with key info targeted at reaching out to new users. EGI presence at European Conference on Computational Biology, Digital Research 2012, e. Challenges, EUDAT 1 st Annual Meeting and EUROMED’ 12. Articles published in Pan. European. Networks: Science & Technology, i. SGTW, International Innovations, HPCwire and the CERN Bulletin. . New web pages launched for the EGI Champions scheme and promotional materials distributed to encourage applications. EGI/i. SGTW Science Writing Competition launched. Communications team participated in the Inter NGI usage VT, ENVRI VT, Scientific publications VT and NGI Compendium VT. CB - 11/04/13 EGI-In. SPIRE RI-261323 3 www. egi. eu
Communications PQ 11 • • • Preparations for EGI Community Forum 2013 and EGI Technical Forum 2013. NIL bulletin published monthly with key info targeted at reaching out to new users. EGI presence at Supercomputing’ 12 including being featured in a presentation of sonified Voyager 1 data at the NASA booth – follow up planned at AMES Space Center. EGI participated in Sci. Tech Europe, including in a panel with Sir Robert Winston Articles published in Pan. European. Networks: Science & Technology, i. SGTW, International Innovations, HPCwire and PSR: European Union Web pages for the EGI Champions updated with Champions profiles and a second call for Champions launched on 28 January. EGI/i. SGTW Science Writing Competition closed. Communications team participated in the Inter NGI usage VT, ENVRI VT, Scientific publications VT and NGI Compendium VT. Call for collaborative use examples launched with EGI and XSEDE CB - 11/04/13 EGI-In. SPIRE RI-261323 4 www. egi. eu
Strategy and Policy PQ 10 • Reports to Council – – • Demonstrating Excellent European Science on EGI’s shared resources Report Exploring how researchers can pay for EGI Resources Report EGI. eu Transition Plan to ERIC (D 2. 11) EGI Council Survey analysis – ERIC and EGI Global Tasks Other Reports and Analysis – e-IRG Blue Paper on Data Management – EGI. eu Service Portfolio definition – EGI-In. SPIRE Gender Action Plan • Virtual Team Projects – Scientific Publications Repository closed – Scientific Discipline Classification: Proposed, accepted and leading (Dec 2012 start) • Mo. Us / Collaborations – New Mo. U: PSNC (Technology Provider) – New Mo. U DANTE – ERINA+: Refined data provided – Impact assessment report received CB - 11/04/13 EGI-In. SPIRE RI-261323 5 www. egi. eu
Strategy and Policy PQ 10 • • • Communications – 2 articles for EGI Inspired newsletter – 1 blog post (ERA communication) – 2 external publications (e-IRG Newsletter – Compendium; Euro. Focus – EGI & H 2020) – 1 paper presented (e-Challenges Workshop – Lisbon) Events and Meetings – 2 Organised: EGI Technical Forum and Security for Collaborating Infrastructures (Lyon) – Attended: TAGPMA (Panama City); TERENA VAMP (Utrecht); EUGrid. PMA and IGTF (Lyon); HEPIX (Beijing) Policy Groups – Reviewed and update of policy group To. Rs – Drafted general EGI disclaimers; Terms of Use; Privacy Policy; Cookie Policy; IPR; and Licenses – Continued revisions of old top-level Security Policy and of the Accounting data handling policy – Finalising “Security for Collaborating Infrastructures” – EGI, WLCG, OSG, PRACE, and XSEDE CB - 11/04/13 EGI-In. SPIRE RI-261323 6 www. egi. eu
Strategy and Policy PQ 11 • Two important policy papers endorsed by the Council: – Demonstrating Excellent European Science on EGI’s shared resources – Exploring how researchers can pay for EGI Resources • Organisation of the Evolving EGI Workshop – Pay-for-use experiment, Pay-for-Use Survey summary and VAT Taxation Issues paper, Scientific Review Committee To. R • EGI. eu Service Portfolio • EGI mini project – collaboration with the Open. AIRE to provide an EGI Scientific Publications Repository service • Published EGI Compendium 2011 • Developed EGI Balanced Scorecard Data Dictionary • Launched Scientific Disciplines Classification VT CB - 11/04/13 EGI-In. SPIRE RI-261323 7 www. egi. eu
Strategy and Policy PQ 11 • Signed Mo. U with DANTE • EGI Community Forum 2013 – drafting the call for participation and reviewing the submitted abstracts • 3 TCB meetings and 1 SCG meeting – official closure of User Services Advisory Group (USAG) and Operations Automation Team (OAT) • ERINA+ project final assessment • Security Policy Activities – Service Operations Security Policy document – EUGrid. PMA and TAGPMA (International Grid Trust Federation) meetings – "Security for Collaborating Infrastructures" – Federated Identity Management for Research (FIM 4 R) activity CB - 11/04/13 EGI-In. SPIRE RI-261323 8 www. egi. eu
Technical Outreach to New Communities PQ 10 • Team at EGI. eu: • • Supported 6 VTs Running the VRE track of EGI TF Significant progress with requirement processing User-facing site about the EGI Federated Cloud testbed: http: //go. egi. eu/cloud Support two use cases on the Testbed (Open. Modeller; Peachnote) Federated AAI architecture for EGI portals discusion document: Testing Globus Online for EGI VOs. Preparations for EGI/EUDAT/PRACE workshop on data management • https: //indico. egi. eu/indico/conference. Display. py? ovw=True& conf. Id=1228 CB - 11/04/13 EGI-In. SPIRE RI-261323 9 www. egi. eu
Technical Outreach to New Communities PQ 10 • App. DB: http: //appdb. egi. eu – Restructuring of user interface to improve the usability. – New categories: science gateways and workflows. – Search and other improvements • Customer Relationship Management system (CRM): http: //crm. egi. eu – Upgrade from 5. 3. 0 to 5. 4. 0 with ability to track activity of each individual user) – Mod. Tracker module deployment and development of CRM metrics portal which stores historical data of changes in CRM and used for reporting – Completed development of CRM metrics portal – Authorization mechanisms implemented based on EGI interest groups and the relevant information within CRM system. – User input validation based on javascript. (improving the consistency of data) • Training Marketplace: http: //training. egi. eu – Dissemination of the TMP improved the use of gadgets. – Demo for EGI TF 2012 and three posters. Demonstration at UK Digital Research 2012. – CAPTCHA to protect from spam in the comments. CB - 11/04/13 EGI-In. SPIRE RI-261323 10 www. egi. eu
NA 2. 5 Technical Outreach to New Communities – EGI. eu • EGI. eu (3. 5 persons) – main achivements: • Support 5 active VTs. Establish 1 new VT • Preparations for the VRE track of EGI CF • Federated cloud: • Support the Open Modeller (Bio. Ve. L - EUBrazil. Open. Bio) use case of the EGI Federated Cloud • Teleconferences with portal providers (IGI, Cloud. Broker) on how to connect their services to the cloud platform • Adding a new gadget (Grelc) into the gadget portfolio. The gadget can list and display domain specific databases that are accessible on the EGI grid/cloud platform. • Collect the list of dissemination channels of scientific projects that could be new users of EGI: http: //wiki. egi. eu/wiki/Projects_events. Inform NILs and outreach teams about these channels. • Webinar trainings to ENVRI project WP 3 leader about EGI services for RIs. • Review of VO homepages in VO ID cards, collect broken items, forward these to Operations for follow up. • Work with the TCB chairs to define a framework for technology providers for the post-EMI/IGE era • Attend Open Source conference in Amsterdam • Prepare and submit two EGI abstracts to the European Geosciences Assembly • EGI Federated Cloud • Workflow technologies • Led/participate in the setup of three EGI-In. SPIRE mini-projects (2 got selected for funding) Nov 2012 – Jan 2013 EGI-In. SPIRE RI-261323 11 www. egi. eu
NA 2. 5 Technical Outreach to New Communities – Global tasks • App. DB: http: //appdb. egi. eu – Improve useability based on the review and usability studies of UCST in PQ 10 – Significant redisign of look and feel – Several new features, such as improved RSS feeds, roll-back facility • Customer Relationship Management system (CRM): http: //crm. egi. eu – Support existing users – Env. Bio VT, French & Turkish NILs – Improvements/changes based on user feedback (e. g. Read-write permissions, ESFRI cluster project type, company legal entity type, multi-selection options, etc. ) – Setup a metrics and reporting page about the use of the CRM: https: //crm. egi. eu/Metrics • Training Marketplace: http: //training. egi. eu – Dissemination of the TMP continues – STFC at UK projects/initiatives/events – New filters to increase the flexibility of the gadgets (filtering for projects, communities) Nov 2012 – Jan 2013 EGI-In. SPIRE RI-261323 12 www. egi. eu
EGI-In. SPIRE SA 1 Operations CB - 11/04/13 EGI-In. SPIRE RI-261323 13 www. egi. eu
QR 10 SA 1 accomplishments • Security – 1 security incident handled, 1 security advisory concerning g. Lite 3. 2 middleware components no longer supported on 01 August 2012, 4 vulnerability reports, 2 SVG advisories (1 Critical and 1 High) – Accreditation of EGI CSIRT with TRUSTED Introducer – Running of SSC 6 at NGIs • Support – Automated process of support of underperforming Resource Centres thanks to the support of the Operations Dashboard – New unified software support activity following revised procedures and merging TPM (SA 1) and DMSU (SA 2) TSA 1. 7 • Availability – New set of availability reports being discussed • Documentation – 2 updated procedures (VO registration procedure, Resource Centre certification procedure) – 1 new procedure for renaming of Resource Centres – EGI. eu OLA defining service level targets for EGI central technical services • Contribution to the definition of the CF 12 call for participation (operations area) CB - 11/04/13 EGI-In. SPIRE RI-261323 14 www. egi. eu
QR 10 SA 1 accomplishments • Start of decommissioning of g. Lite 3. 1/3. 2 unsupported software – Large coordination effort between EGI. eu, EGI CSIRT, COD, NGIs – Large amount of services to be upgraded or switched off • 120 sites deploying unsupported middleware (~210 services involved, ~90 Sites planning to upgrade or decommission before the end of Nov) at the end of PQ 10 – New EGI policy for retirement of unsupported software – Planning of decommissioning of new g. Lite 3. 2/EMI 1 reaching end of support in in the coming 2 PQs • Sustainability – Survey on sustainability of NGI and EGI. eu closed in August 2012, on-going preparation of D 4. 7 (Operations Sustainability), finalization of the EGI operations service portfolio • Infrastructure – – Decommissioning of IGALC federated operations centre Decommissioning of NGI_IE by the end of Dec 2012 Integration of SAGrid stalled Mo. Us with integrated infrastructures being established CB - 11/04/13 EGI-In. SPIRE RI-261323 15 www. egi. eu
QR 10 SA 1 accomplishments • Technology deployment and integration – Staged rollout of 29 products (for UMD 2. 0. 0 and 2. 1. 0), 1 rejected, 40 tests in total, 63 EA teams (64 in PQ 9) – Preparation work to get products directly from EPEL – EGI/EUDAT/PRACE integration activities started • Tools – – • New Operations Portal versions rolled to production (2. 9. 6) SAM Update 17 (30 deployed instances) New SAM instance for the monitoring of EGI. eu technical services GOCDB 4. 4 in production Accounting – Migration of production accounting in NDGF/SGAS, NGI_CH/SGAS (UNIBE-LHEP, UNIBE-ID & UNIGE-DPNC) and NGI_IT/DGAS to the new STOMP Secure Messaging infrastructure (SSM) • Main documents – Assessment of changes on operations assets introduced by the end of EMI and IGE CB - 11/04/13 EGI-In. SPIRE RI-261323 16 www. egi. eu
QR 11 SA 1 accomplishments • Definition of the operations roadmap for 2013 • NGI Operations Sustainability Survey on federation of NGI services to reduce operations costs • EGI operations services – Definition of operations service porfolio – Finalization of EGI. eu Operations Level Agreement – Prioritization of existing global tasks, gap analysis and discussion of technical evolution of these Evolving EGI workshop • Established a collaboration with EUDAT and PRACE for data access and transfer across these infrastructure to support new user communities – VPH, EPOS, VERCE, MAPPER, DRIHM CB - 11/04/13 EGI-In. SPIRE RI-261323 17 www. egi. eu
QR 11 SA 1 accomplishments • Tools – SAM Update 19 and 20 new Availability/Reliability reporting framework in My. EGI • New central instance for monitoring of software versions • New central instance for monitoring of the EGI. eu central operations tools • New central instance for Federated Cloud monitoring – – Messaging infrastructure: 2 software upgrades GGUS: 2 new releases Operations Portal prototype 3. 0. 0 under preview Discussion forum rolled to production CB - 11/04/13 EGI-In. SPIRE RI-261323 18 www. egi. eu
QR 11 SA 1 accomplishments • Decommissioning of g. Lite unsupported software completed – 2/3 of the production infrastructure affected – Deployment of new SAM instance of monitoring of obsolete software – Extensions in the security dashboard and operations dashboard – Definition of new procedure and operations escalation procedure for the retirement of obsolete software – Excellent oversight work carried out by the COD team! – EMI 1 retirement calendar defined, preparation work started • Staged rollout – 25 products released to production – UMD 1. 9. 1, UMD 2. 2. 2, UMD 2. 3. 0 and UMD 2. 3. 1 CB - 11/04/13 EGI-In. SPIRE RI-261323 19 www. egi. eu
QR 11 SA 1 accomplishments • Accounting – Adoption of APEL SSM 1 protocol almost completed, preparing for release of a new publisher based on SSM 2 – Production infrastructure being prepared to collect storage and cloud usage records – New accounting portal release providing NGI international reports – Campaign for publication of User DNs across all sites almost completed • Resource allocation – Gathering of user and resource provider requirements – Definition of resource broker models and use cases • Documentation – New wiki navigation bars – Re-categorization of pages, improved accessibility CB - 11/04/13 EGI-In. SPIRE RI-261323 20 www. egi. eu
EGI-In. SPIRE JRA 1 Operational Tools CB - 11/04/13 EGI-In. SPIRE RI-261323 21 www. egi. eu
• Operations Portal QR 10 – JRA 1 accomplishments – 1 major release has been released: http: //operations-portal. egi. eu/aboutportal/release. Notes. Browser: • Monitoring of unsupported middleware version: information collected about old middleware version is available from the Security dashboard • Underperforming site probe (RT Ticket 2298): a local probe gets the availability of certain sites from My. EGI PI and compares them it two thresholds: – If the availability is below or equal to the "warning" threshold (75%) , a WARNING is generated. – If it is below or equal to the "critical" threshold (70%) as well, a CRITICAL warning is generated. • GOCDB – GOCDB 4. 4 was released • To address a number of smaller RT feature requests and GUI improvements. – The GOCDB development roadmap was presented at the EGI Technical Forum and was refined in OTAG-13 in response to feedback from NGIs regarding regionalisation requirements: • It was agreed that the Regional-Publishing GOCDB would be dropped while new RDBMS support, an extensibility mechanism and GLUE 2 support was prioritized. – Support was given to EUDAT to capture requirements and upgrade to GOCDB v 4. 4 at http: //creg. eudat. eu/. – GLUE 2 XSD design options were presented at EGI TF and to the GLUE 2 working group at OGF 36. A consensus on the GLUE 2 XML rendering is emerging. Importantly, this includes a number of GOCDGB requirements. CB - 11/04/13 EGI-In. SPIRE RI-261323 22 www. egi. eu
• • • QR 10 – JRA 1 accomplishments EGI Helpdesk (GGUS) – Two major releases have been delivered, the release note are available at https: //ggus. eu/pages/owl. php. – A new GGUS advisory board has been set during the EGI Technical Forum in Prague. You can find more details at https: //indico. egi. eu/indico/session. Display. py? session. Id=58&conf. Id=1019#20120921. Accounting Repository – Implemented consumer for St. AR records with storage database. – CAR (Compute Accounting Record) XML format can now also be received by SSM and loaded, in addition to the APEL message format. – Testing data migration method, records from old APEL system to new begun. – Additional work carried out using indexing more effectively to improve database efficiency, schema changes will be implemented on new system. – Packages required for regional APEL server defined. – Accounting for parallel jobs: data collection agreed, defined in CAR and code used by DGAS to collect data from batch logs received for comparison and reviewed. – Started draft of an AAR (Application Accounting Record) XML format. Metrics Portal – Cosmetic fixes, optimization, IP migration to new domain, Server & VMM maintenance – New requirements: depreciable metrics, depreciable activities, new quarterly report (All common metrics for all activities in a quarter), cumulative NA 2 metrics, some redundant views were removed CB - 11/04/13 EGI-In. SPIRE RI-261323 23 www. egi. eu
• SAM QR 10 – JRA 1 accomplishments – SAM U 19 in Staged Rollout • this release is devoted to documentation and to the My. EGI component, improving many aspects of its visualization. • Release notes are available at: https: //tomtools. cern. ch/confluence/display/SAMDOC/Update-19 • Messaging – Development and completion of test suite which is needed in order to test message brokers network prior to applying software updates on PROD message broker network – Development of failover example scripts to be used by broker clients – Enabled logging of unauthenticated connections (IPs) to PROD broker network • Accounting Portal – Preparing next release foreseen by end of November 2012: • Cosmetic fixes • Optimization • Server & VMM maintenance – Work to support RFC 2253 (DNs): • Nationality code improved • Some calculations fixed • We are waiting for EMI decision on format to end integration of RFC 2253 • IP migration to new domain CB - 11/04/13 EGI-In. SPIRE RI-261323 24 www. egi. eu
QR 10 – JRA 1 meetings and events • Organization of the workshop “Long Term Sustainability of Operational and Security Tools” in Karlsruhe, Germany (https: //indico. egi. eu/indico/conference. Display. py? conf. Id=1132) • Organization of the “OTAG-13” meeting in Prague (see https: //indico. egi. eu/indico/conference. Display. py? conf. Id=1162) • Organization of the workshop on the “Future evolution of operational tools”, including tools currently developed outside EGI-In. SPIRE in Prague (https: //indico. egi. eu/indico/session. Display. py? session. Id=39&conf. Id=1019 #20120919) • A new GGUS advisory board has been set during the EGI Technical Forum in Prague (https: //indico. egi. eu/indico/session. Display. py? session. Id=58&conf. Id=1019 #20120921) CB - 11/04/13 EGI-In. SPIRE RI-261323 25 www. egi. eu
QR 11 – JRA 1 accomplishments • Operations Portal – Dashboard refactoring: • A first prototype has been delivered in December to ROD Operators and they will deliver feedback about this version. • We will use this feedback to implement a second version that we will deliver in production within the first semester of 2013. – Regionalisation: • As announced in previous work plan the regional instances have been removed and we are providing regional views of the different features when it is meaningful. – Availabilities and reliabilities report system: • A new module and system will be implemented as an availabilities/reliabilities reporting system in the operations portal according to the following guidelines: – VO specific reports are generated monthly, using the OPS VO; – Only reports for "high activity" VOs are generated; – the list of service end-points supporting VO x needs to be extracted from top-BDII; – availability results are summarized on daily, weekly and monthly basis; – apply the A/R calculation algorithm determined with SA 1 team; – A first study and estimation of this work has been done and a technical document has been written. CB - 11/04/13 EGI-In. SPIRE RI-261323 26 www. egi. eu
QR 11 – JRA 1 accomplishments • • GOCDB – Progressed with the Doctrine ORM DB layer that will replace the current Oracle PROM DB. This is the main development task until v 5 (release expected approx. ~May); – The OGF GFD document for Glue 2 XML rendering was completed and sent around the working group: http: //redmine. ogf. org/dmsf/glue-wg? folder_id=31; – Failover instance updated. Nagios checks for the failover were updated; – A number of new service types have been added; – An abstraction for the GOCDB authentication logic was developed to simplify the integration of other authentication mechanisms. EGI Helpdesk (GGUS) – During PQ 11, two major releases have been delivered, the release note are available at https: //ggus. eu/pages/owl. php. – Report Generator: most features of the Report Generator have been implemented by end of January 2013. However some minor changes are still to be done; – GGUS Structure updated; – GGUS Web Portal updated: – GGUS System updated: – Interfaces with other ticket system: – High availability: Skipped auto-switching approach. Switching to the backup machines will be done using a management script that can be run by GGUS administrators or the KIT on-call service at any time. CB - 11/04/13 EGI-In. SPIRE RI-261323 27 www. egi. eu
QR 11 – JRA 1 accomplishments • Accounting Repository – Migrated NIKHEF and IN 2 P 3 to new APEL server. – Regional APEL server coding completed, now ready for testing by external site. – Cloud: revised cloud accounting record to enable us to summarise cloud accounting data more efficiently to be sent on to the Accounting Portal. Tested new version of SSM and successfully sent cloud records to the Accounting Portal at CESGA so work on the visualisation of accounting data can begin. – Storage: test database set up and new implementation ready to receive St. AR from storage clients. – Work begun with team at Hannover on their prototype for Application Accounting and future development to set up a repository at STFC to receive application accounting records using SSM. . • Accounting Portal – – – – Improved User. DN country classification patterns; Improvements on usage by country; GET interface for CSV; Support new RFC 2253 User. DNs; Better support for custom VOs; User. DN NGI attribution; Support for local jobs, there are three options, selectable on most views: (a) Only Grid jobs (default); (b) Grid+Local jobs; (c) Only Local jobs; Moved Inter. NGI views to production; New Active Users View; New query publication percentage views; Shortened web service URLS; Fixed HEPSPEC 06 computation on Inte. NGI views; New XML endpoint for VO activity; Server work and moving, database maintenance; Many fixes and optimizations. CB - 11/04/13 EGI-In. SPIRE RI-261323 28 www. egi. eu
QR 11 – JRA 1 accomplishments • • • SAM – SAM U 20 in Staged Rollout • this release was mainly focused on the introduction of SAM Operational Tools Monitoring. In addition we worked on bug fixing identified during the wide deployment of SAM Update 19. • Release notes are available at: https: //tomtools. cern. ch/confluence/display/SAMDOC/Update-20. Messaging – Upgrade of PROD MSG broker network endpoints scheduled and completed; – Investigation of issue related to DLQ purging has started in January 2013 and is still ongoing; – Discussion with SAM on implementing authentication has started on December 2012. This task is ongoing; – Fixed an issue with NRPE module on AUTH and SRCE broker instances affecting their internal monitoring; – Redesign of monitoring tools (i. e. Nagios probes for SAM) has started in January 2013. Metrics Portal – Quarter-dependent activities (for the decommission of SA 3) and quarter-dependent metrics (for decommissioned, replaced and semantic-changing metrics); – NGI summed metrics for NA 2; New quarterly views and Excel report; – Redundant views removed; New scrolling report layout; – Internal changes in the auth system; Server work; – Fixes and optimizations. CB - 11/04/13 EGI-In. SPIRE RI-261323 29 www. egi. eu
QR 11 – JRA 1 meetings and events • Evolving EGI Workshop (Amsterdam, 28 th-30 th January 2013): https: //indico. egi. eu/indico/conference. Display. py? conf. Id=1252 • GGUS advisory board meeting (EVO, 29 November 2012): http: //indico. egi. eu/indico/conference. Display. py? conf. Id=1259 CB - 11/04/13 EGI-In. SPIRE RI-261323 30 www. egi. eu
EGI-In. SPIRE SA 2 Technology CB - 11/04/13 EGI-In. SPIRE RI-261323 31 www. egi. eu
SA 2 Technology PQ 10 UMD-1 provisioning • UMD 1. 8. 0 7 August 2012 – 4 updates from EMI (2), IGE (1) and EGI (1) • • • Storage: Globus Grid. FTP 5. 2. 1, Sto. RM 1. 8. 3 Compute: CREAM 1. 13. 4 Other: EGI Repository configuration 1. 8. 0 – http: //repository. egi. eu/2012/08/07/release-umd-1 -8 -0/ • UMD 1. 8. 1 24 August 2012 – 1 emergency update from EMI • Compute: WMS 3. 3. 7 – http: //repository. egi. eu/2012/08/24/release-umd-1 -8 -1/ • UMD 1. 9. 0 24 August 2012 – 4 new products from EMI (2) and IGE (2) and 5 update from EMI • • • Information: BDII core 1. 4. 0, ARC Info. Sys 1. 1. 1 Compute: CREAM 1. 13. 4, WMS 3. 3. 8, Grid. Way 5. 10. 2, ARC CE 1. 1. 1 Client: GFAL/lcg_util 1. 13. 0, SAGA 1. 6. 1, ARC Clients 1. 1. 1 – http: //repository. egi. eu/2012/08/24/release-umd-1 -8 -1/ CB - 11/04/13 EGI-In. SPIRE RI-261323 32 www. egi. eu
SA 2 Technology PQ 10 UMD-2 provisioning (UMD-2 provides support for 64 bit on SL 5, SL 6, Debian 6) • UMD 2. 1. 0 6 August 2012 – 15 new products from EMI(14) and IGE (1), and 2 updates from EMI (2) • • • Security: UNICORE XUUDB 1. 3. 2, glite-gsoap-gss 3. 1. 4 Information: BDII top 1. 0. 2 Compute: g. Lite CLUSTER 2. 0. 0, UNICORE X 6 5. 0. 0, CREAM LSF module 2. 0. 0, CREAM Torque module 2. 0. 0, CREAM 1. 14. 0, EMI-WN 2. 0. 0, TORQUE server config 1. 0. 0, Torque WN config 1. 0. 0, gl. Exec-wn 1. 1. 1, BLAH 1. 18. 1, Globus GRAM 5 5. 2. 1 Storage: Sto. RM 1. 10. 0 Client: EMI-UI 2. 0. 0, UNICORE Client 6 5. 0. 0, – http: //repository. egi. eu/2012/08/06/release-umd-2 -1 -0/ • UMD 2. 1. 1 24 August 2012 – 1 emergency update from EMI • Information: lcg-info-dynamic-software 1. 0. 7 – http: //repository. egi. eu/2012/09/11/release-umd-2 -1 -1/ CB - 11/04/13 EGI-In. SPIRE RI-261323 33 www. egi. eu
SA 2 Technology PQ 10 UMD-2 provisioning (continued) (UMD-2 provides support for 64 bit on SL 5, SL 6, Debian 6) • UMD 2. 2. 0 9 September 2012 – 13 new products from EMI (10) and IGE (3) • • Security: UNICORE UVOS 1. 5. 1, My. Proxy 1. 0. 1, Globus Default Security 5. 2. 1, Globus My. Proxy 5. 6. 3, Security Integration 2. 2. 0, gridsite 1. 7. 22, Trustmanager 3. 1. 4, ARGUS 1. 5. 0 Information: BDII core 1. 4. 0 Compute: g. Lite MPI 1. 3. 0, CREAM SGE module 2. 0. 0, L&B 3. 2. 7 Client Tools: GFAL/lcg_util 1. 13. 0 – http: //repository. egi. eu/2012/10/09/release-umd-2 -2 -0/ • UMD 2. 2. 1 26 October 2012 – 1 emergency update from IGE • Compute: g. Lite MPI 1. 3. 0, CREAM SGE module 2. 0. 0, L&B 3. 2. 7 – http: //repository. egi. eu/2012/10/26/release-umd-2 -2 -1/ Technology Provider Service Level Management • PSNC has signed an Mo. U as a new Technology Provider for the Qos. Cos. Grid platform CB - 11/04/13 EGI-In. SPIRE RI-261323 34 www. egi. eu
SA 2 Technology PQ 11 Main achievements: • Quality criteria definition – Released 5 th release of QC document including the new criteria for the QCG middleware • Quality criteria verification – Streamlined the instantiation of the testbed machines for the verifiers, minimizing the overhead required by every product verification – Tested the first set of products for SHA-2 certificates support • Federated clouds task force – – Continued integration of cloud resources into EGI infrastructure Extended GOCDB service types to include cloud resources Deployed SAM instance for cloud services monitoring Created support unit in GGUS EGI-In. SPIRE RI-261323 www. egi. eu
SA 2 Technology PQ 11 UMD 2 provisioning: scheduled updates UMD 2. 3. 0 • 20 November 2012 • Scheduled minor update • http: //repository. egi. eu/2012/11/20/release-umd-2 -3 -0/ • Including updates: – From EMI: EMI-WN, EMI-UI, d. Cache, LB, LFC, UNICORE HILA – From IGE: GRAM 5 • Including new products from EMI: AMGA, EMIR; and from IGE: SAGA EGI-In. SPIRE RI-261323 www. egi. eu
SA 2 Technology PQ 11 UMD 2 provisioning: emergency updates UMD 2. 2. 2 • 14 November 2012 • Security update • http: //repository. egi. eu/2012/11/14/release-umd-2 -2 -2/ • Released security patch for a d. Cache client vulnerability affecting EMI-WN and EMI-UI UMD 2. 3. 1 • 17 December 2012 • Emergency update • http: //repository. egi. eu/2012/12/17/release-umd-2 -3 -1/ • 4 updates from EMI and 1 update from IGE. These updates included important bug fixes, and a security vulnerability fix that triggered the release. EGI-In. SPIRE RI-261323 www. egi. eu
SA 2 Technology PQ 11 UMD 1 updates UMD 1. 9. 1 • 19 December 2012 • Emergency update • http: //repository. egi. eu/2012/12/19/release-umd-1 -9 -1/ • Security update for the Gridftp component from the IGE technology provider Trust anchors releases CA Update 1. 52 -1 • 19 December 2012 • Scheduled minor • Regular EUGrid. PMA trust anchor update EGI-In. SPIRE RI-261323 www. egi. eu
EGI-In. SPIRE SA 3 Support for Heavy Users CB - 11/04/13 EGI-In. SPIRE RI-261323 39 www. egi. eu
Domain specific support and shared services & tools • HEP Dashboard Application – Job-monitoring historical view for CMS production activities prototyped and under testing. • Data Management Monitoring – WLCG Transfer Dashboard extended; latency monitoring prototyped. • Life Science Dashboard Design – Continued monitoring of computing resources (used & required). • Ganga – Ganga. Task improvements; drip-feed job submission & automataic output transfer. • Hydra – Liaising with sites to resolve Hydra client deployment issues. • GRe. IC – Dashboard. DB monitoring service released in official Dashboard. DB appplication. • Workflows & Schedulers – Integration of Kepler and Grid. Way services. CB - 11/04/13 EGI-In. SPIRE RI-261323 40 www. egi. eu
Domain specific support and shared services & tools • HEP: LHCb Dirac – Popularity service exposed to users. • HEP: CRAB Client – Watch dog system introduced to improve job execution reliability. • HEP: Persistency Framework – Development and debugging of the CORAL Frontier monitoring package. • HEP: ATLAS & CMS Common Analysis Framework – Proof-of-concept of integration of ATLAS workload system with CMS-specific plugins. • Life Sciences – On-going testing of VRC resources. • Astronomy & Astrophysics – Porting of the Vis. IVO MPI release to g. Lite, and utilisation of Graphical Processing Units. • Earth Sciences – New version of GI-Cat (v 9. 3) deployed on SCAI’s infrastructure. CB - 11/04/13 EGI-In. SPIRE RI-261323 41 www. egi. eu
Скачать презентацию EGI-In SPIRE Activity Status Reports CB — 11 04 13
6daf0849417678d2236cbb45b20cda66.ppt