P. Malzacher@gsi. de Summary: HEP CG WP 3 Distributed Interactive Data Analysis Partner: LMU (Atlas), GSI (Alice) unfunded: Uni Karlsruhe (CMS), MPI Heidelberg (LHCb), LRZ, MPI M, RZ Garching Optimise application specific job scheduling Analyse and test of software environment required Job management and Bookkeeping of distributed analysis Distribution of analysis, sum-up of results Interactive Analysis: Creation of a dedicated analysis cluster Dynamic partitioning of Grid analysis clusters
Deliverables: Interactive Analysis for Atlas: LMU Interactive Analysis for Alice: GSI Automated Jobmanagement System: LMU Application specific Scheduling: GSI PM 12 Report Gap Analysis and Design Proposals PM 24 Prototypes PM 35 Production Releases PM 36 Project Summary
Start with Gap Analysis LMU: Investigating Job-Scheduler requirements for distributed and interactive analysis GANGA (ATLAS/LHCb) project shows good features for this task Used for test MC production on LCG GSI: Analysis based on PROOF Investigating different versions of PROOF clusters Connect ROOT and g. Lite: TGlite class TGrid : public TObject { public: … virtual TGrid. Result *Query ( … static TGrid *Connect ( const char *grid, const char *uid = 0, const char *pw = 0 … Class. Def(TGrid, 0) }; J. Elmsheuser K. Schwarz, A. Manafov
Job Split approach catalog files Storage queues query data file splitting jobs my. Ana. C merging final analysis submit manager outputs § “static” use of resources § jobs frozen: 1 job / worker node § “manual” splitting, merging § limited monitoring (end of single job) G. Ganis, CHEP 06, 13 Feb 2006
The PROOF approach catalog files Storage scheduler query PROOF query: data file list, my. Ana. C MASTER feedbacks final outputs (merged) § farm perceived as extension of local PC § same macro, syntax as in local session § more dynamic use of resources § real time feedback § automated splitting and merging G. Ganis, CHEP 06, 13 Feb 2006
Deliverables: Interactive Analysis for Atlas: LMU advanced Interactive Analysis for Alice: GSI advanced Automated Jobmanagement System: LMU on track Application specific Scheduling: GSI in a very early stage, we learned a lot during this WS PM 12 Report Gap Analysis and Design Proposals PM 24 Prototypes PM 35 Production Release PM 36 Project Summary