Xtrem Web-HEP EGEE CSST-HUST-Wuhan Octobre 11 -15

Xtrem. Web-HEP & EGEE CSST-HUST-Wuhan Octobre 11 -15 th, 2010 Oleg Lodygensky - LAL - lodygens@lal. in 2 p 3. fr The EDGe. S project receives Community research funding

EDGe. S BOINC-based DGs local BOINC DG Correlation Systems new public BOINC DG EDGe. S@home 10. 000 PCs public BOINC DG Ibervicis public BOINC DG SZDG 0 PCs 24. 000 30. 000 PCs 77. 000 (256%) public BOINC DG Almere. Grid public BOINC DG Extremadura 0 PCs 1. 700 70. 000 PCs 22. 500 (32%) local BOINC DG Westminster 1. 500 PCs 1881 (125%) EGEE VO local Xtrem. Web DG IN 2 P 3 200 PCs 300 (150%) new public Xtrem. Web DG EDGe. S@home 1. 000 PCs public Xtrem. Web DG IN 2 P 3 300 PCs 6 (2%) public Xtrem. Web DG Almere. Grid 3. 000 PCs ? Xtrem. Web/XWHEP-based DGs Authors : O. Lodygensky HUST : Xtrem. Web-HEP 2

EDGe. S an EGEE VO Core Service voms bdii lfc AR lb wms Resource UI myproxy BOINC-based DGs bridge Uo. W, Correlation Systems local DGs EGEE>DG bridge CE ce ce Uo. W queue SDZGr queue Almere queue Fundecyt queue wms BOINC-EGEE bridge SZDGr, bridge Almere, bridge Fundecyt public DGs desktopgrid. vo Authors : O. Lodygensky HUST : Xtrem. Web-HEP 3

Bridging EGEE and Desktop Grids : Boinc, XWHEP Undefined infrastructure: - anonymity - volatility EGEE (Service Grid) Well defined infrastructure: - authentication - authorization - logging and bookkeeping - quality of service (Qo. S) How to bridge ? - security - monitoring - logging Server (scheduler) VOMS Admin VOMS Proxy Accounting Logging & Bookkeeping ? Volunteer PCs Gives Job Status Submits Job with VOMS proxy Sends back Grid User Volunteer PCs DG User VOMS Proxy = X 509 proxy with VOMS extensions Grid Admin Site Admin Manages VO VOMS Server X 509 proxy A strong effort of standardization Gives Accounting and Auditing Log Meta-scheduler (WMS) Output Sandbox Accesses Data with VOMS proxy Manages Site Publishes available Resources Pushes Job Sends back Output Sandbox Site Computing Resource Accesses Data with VOMS proxy Site Storage Resource 4 Authors : O. Lodygensky HUST : Xtrem. Web-HEP V 5. 7. 5 -1

XWHEP->EGEE resource sharing 5 Authors : O. Lodygensky HUST : Xtrem. Web-HEP V 5. 7. 5 -1

XWHEP : Xtrem. Web by High Energy Physics XWHEP environment ➡ multi users ➡ multi applications XWHEP ensures security at different levels: LAL : • LCG Tiers-2 • EGEE seed resource • Xtrem. Web by High Energy Physics (XWHEP) developer & maintainer XWHEP is based on Xtrem. Web 1. 8. 0. by INRIA. http: //www. xtremweb-hep. org/spip. php? rubrique 16 • authentication : ✓ SSL and X 509 certificates • authorization and confidentiality : ✓ user rights management ✓ user groups ✓ access rights • volunteer nodes integrity : ✓ application repository ✓ sandboxing • monitoring and bookeeping : ✓all messages are logged Authors : O. Lodygensky 9 HUST : Xtrem. Web-HEP V 5. 7. 5 -1

XWHEP : Architecture, authentication and resource integrity XW Services Server certificate Server public key XW Coordinator (scheduler) All communications are encrypted XW Data Repository Job Mgt Authentication: - login/password - X 509 cert. Data Mgt Local I/O Deployed XW-Client UI Deployed XW-Computing Service PC Authentication: - login/password - X 509 cert. Data Sandbox Dynamically downloaded XW user data and application XW User Job User data and applications Execution Sandbox External data servers Node integrity: Volunteer PC - sandboxing 10 Authors : O. Lodygensky HUST : Xtrem. Web-HEP V 5. 7. 5 -1

XWHEP->EGEE bridging Security, monitoring and logging are the main issues in Pilot Jobs. (http: //edms. cern. ch/document/855383) User X. 509 Cert Retreived signed DG user job XW Coordinator (scheduler) Server certificate Download DG user X 509 proxy DG user job submission with X 509 proxy Server public key DG user job deployment, status, results Submit Pilot job w/ user X 509 proxy Site Computing Resource DG User XW Bridge Meta-scheduler (WMS) WN Public worker Group worker User X. 509 proxy Pilot Job j. Lite : proxy init Private worker j. Lite by Oleg Sukhoroslov http: //code. google. com/p/jlite/ VOMS Server Pilot Job submitted as EGEE Job 24 Authors : O. Lodygensky HUST : Xtrem. Web-HEP V 5. 7. 5 -1

EDGe. S Monitoring 27 Authors : O. Lodygensky HUST : Xtrem. Web-HEP V 5. 7. 5 -1

How to port an application from XWHEP to EGEE • EGEE is made of Linux computing resources • XWHEP applications must have a Linux version • There is no specific need to recompile nor relink binaries 28 Authors : O. Lodygensky HUST : Xtrem. Web-HEP V 5. 7. 5 -1

EGEE->XWHEP resource sharing 29 Authors : O. Lodygensky HUST : Xtrem. Web-HEP V 5. 7. 5 -1

Bridging EGEE and Desktop Grids : Boinc, XWHEP Undefined infrastructure: - anonymity - volatility EGEE (Service Grid) Well defined infrastructure: - authentication - authorization - logging and bookkeeping - quality of service (Qo. S) Server (scheduler) VOMS Admin Volunteer PCs DG User ? Volunteer PCs X 509 proxy VOMS Proxy Accounting Logging & Bookkeeping Gives Job Status Submits Job with VOMS proxy Sends back Grid User VOMS Proxy = X 509 proxy with VOMS extensions Grid Admin Site Admin Manages VO VOMS Server How to bridge ? - security - monitoring - logging A strong effort of standardization Gives Accounting and Auditing Log Meta-scheduler (WMS) Output Sandbox Accesses Data with VOMS proxy Manages Site Publishes available Resources Pushes Job Sends back Output Sandbox Site Computing Resource Accesses Data with VOMS proxy Site Storage Resource 30 Authors : O. Lodygensky HUST : Xtrem. Web-HEP V 5. 7. 5 -1

EGEE->XWHEP bridge : authentication, authorization, logging, monitoring g. Lite ensures security: XWHEP ensures security at different levels: • authentication : ✓ X 509 cert. and VOMS ext. • authentication : ✓ SSL and X 509 certificates • authorization and confidentiality : ✓ VOMS server • authorization and confidentiality : ✓ user rights management ✓ user groups ✓ access rights • monitoring and bookeeping • volunteer nodes integrity : ✓ application repository ✓ sandboxing • monitoring and bookeeping : ✓all messages are logged 31 Authors : O. Lodygensky HUST : Xtrem. Web-HEP V 5. 7. 5 -1

XW plugin QM WS client QM P-GRADE Portal Meta-scheduler (WMS) EDGe. S CE WS Interface EGEE -> Xtrem. Web resource sharing XW Coordinator (scheduler) VOMS Server EDGe. S AR LCG CE Volunteer PCs Xtrem. Web User Volunteer PCs 35 Authors : O. Lodygensky HUST : Xtrem. Web-HEP V 5. 7. 5 -1

Authors : O. Lodygensky HUST : Xtrem. Web-HEP 8 V 5. 7. 5 -1

Standard g. Lite tools usage Authors : O. Lodygensky HUST : Xtrem. Web-HEP 10 V 5. 7. 5 -1

Authors : O. Lodygensky HUST : Xtrem. Web-HEP 17 V 5. 7. 5 -1