Introduction to TAGs Elizabeth Gallas Oxford ATLAS-UK Distributed

Introduction to TAGs Elizabeth Gallas Oxford ATLAS-UK Distributed Computing Tutorial 29 -30 January 2009 30 Jan 2009 Elizabeth Gallas 1

Outline o Introduction: n n n o ELSSI – Event Level Selection Service Interface n o A Web based interface to ATLAS event selection Hands on tutorial n n n o ATLAS TAGs in the ATLAS Computing model TAG Contents TAG Formats Selecting events of interest, refining selection criteria Extracting that selection Using selection as input to Athena analysis Important TAG related hyperlinks 30 Jan 2009 Elizabeth Gallas 2

The TAG Development Group • Argonne: David Malon, Jack Cranshaw, Qizhi Zhang, Peter van Gemmeren • Glasgow: Mike. Kenyon, Helen. Mc. Glone, Tom. Doherty • CERN: Florbela Viegas, Trivan Pal • Oxford: Elizabeth Gallas • Chicago: Marco Mambelli • Grenoble: Solveig Albrand • Orsay LAL: Julius Hrivnac • Sheffield: Tulay Donszelmann (PAT) Thanks to everyone above and to all users with feedback ! 30 Jan 2009 Elizabeth Gallas 3

What’s a “TAG” (in this talk) o ATLAS “TAG” overload: n n n o Not Not Not an acronym (retrospectively TAGs Are Great !) a CVS tag or a release tag or a project tag tracked by the ATLAS Tag Collector a COOL (Conditions Database) Tag a config. Tag a B, flavor, or muon tag In this talk: ATLAS TAG application is n n n A system supporting Event-level metadata o About 200 indexed variables for each event Stored in a ‘database’ (Oracle or file based) o 1 k. B/event -> 1 TB/year PURPOSE: Facilitates event selection for analysis 30 Jan 2009 Elizabeth Gallas 4

ATLAS TAGs in the ATLAS Computing model o Stages of ATLAS reconstruction Ø RAW data file Ø ESD (Event Summary Data) ~ 500 k. B/event Ø AOD (Analysis Object Data) ~ 100 k. B/event Ø TAG (not an acronym) ~ 1 k. B/event o TAGs n n Produced in reconstruction Can be re-produced in re-processing Customized TAGs can be defined/produced TAG formats: o File based: n o Database: n n 30 Jan 2009 Athena. Aware. Ntuple format (AANT) available globally through network connection Used by the TAG Browser (ELSSI) Elizabeth Gallas 5

TAG related hyperlinks: TWiki with TAG content in ATLAS release: n https: //twiki. cern. ch/twiki/bin/view/Atlas. Protected/ Tag. For. Event. Selection TWiki for Tutorial: n n https: //twiki. cern. ch/twiki/bin/view/Atlas/Event. Tag Tutorials 4 Tutorial Components o ELSSI (Browser based) o File-based TAGs (Command line based) o Jive. XML with TAGs (Atlantis Event Display) o TAG based selection with PAthena on the Grid ELSSI - Event Level Selection Service Interface: n 30 Jan 2009 https: //voatlas 18. cern. ch/tagservices/index. htm Elizabeth Gallas 6

“TAG content”: Your selection variables o PAT (Physics Analysis Tools) group n supports ‘official’ TAG content based on input from physics groups Ø o (YOU !) ‘TAG Database’ Application includes n ~200 variables/event: o o Event identification (run, event, lumi block numbers, timestamp, …) Global quantities (e. g. , missing e. T) Trigger decisions at all three levels (now bit encoded) Numbers of electrons, muons, photons, taus, and jets n o o n n n o p. T, eta, phi for highest-p. T objects Detector status and quality words Physics and performance group status words ‘Run Metadata’ at Temporal, Fill, Run, Lumi-block levels references to AOD, ESD, RAW for back-navigation A variety of supporting tools and infrastructure ELSSI is a web based supporting tool n n n Helps you navigate through “TAG content“ Uses other supporting tools and infrastructure Retrieve results in a number of forms 30 Jan 2009 Elizabeth Gallas 7

ELSSI: TAG Browser Basics o An interface to the TAG Database n Supported browsers: Firefox, Safari (not IE) n o Requires Grid Certificate Allows pre-selection of events for analysis, guiding the user through the selection process User Input Stream Quality Trigger COUNT events 30 Jan 2009 Temporal SELECT attributes RETRIEVE Elizabeth Gallas Physics events 8

ELSSI: Implementation & Features o Running on server at CERN n o PHP and Javascript on backend Features: n Formulate multi-dimensional queries o n n n At Run/LB and Event level Query caching Event counting Display Results (graphical and tabular form) Retrieve events in ROOT file Register collection in AMI 30 Jan 2009 Elizabeth Gallas 9

https: //voatlas 18. cern. ch/tagservices/index. htm ELSSI Gateway Choose FDR 2 C link 30 Jan 2009 Elizabeth Gallas 10

Summary o Metadata in a database is a powerful tool n o Development is ongoing to improve n n o A great variety of dynamic selection criteria and reporting become possible Interfaces o Functionality o Usability Integrate infrastructure tools For comments/suggestions: ATLAS Physics Metadata Hypernews 30 Jan 2009 Elizabeth Gallas 11

Backup Slides 30 Jan 2009 Elizabeth Gallas 12

Browser front page for FDR 2 – ‘Temporal Tab’ 30 Jan 2009 Elizabeth Gallas 13

Browser – ‘Stream Tab’ 30 Jan 2009 Elizabeth Gallas 14

Browser – ‘ Trigger Tab’ 30 Jan 2009 Elizabeth Gallas 15

‘Physics Attributes Tab’ 30 Jan 2009 Elizabeth Gallas 16

‘Review Query tab’ 30 Jan 2009 Elizabeth Gallas 17

‘Perform Query’: Count tab Count events meeting criteria … revise criteria… count again… revise criteria … 30 Jan 2009 Elizabeth Gallas 18

‘Perform Query’: Display Results tab o o Get an idea of the attribute distributions Draw histograms – new functionality from Julius (still in development) 30 Jan 2009 Elizabeth Gallas 19

Retrieve Events o After refining query, generate a ROOT TAG file with selected events 30 Jan 2009 Elizabeth Gallas 20

Left Frame: about your Session(s) o Save/Share Session(s) n n Can now save a query session for later use Uses cookies o n o Browser specific Share saved sessions with others Selection Summary n Displays selection criteria of your session 30 Jan 2009 Elizabeth Gallas 21

Working on … (1) o o Incorporating Detector Status (DQ) Loading online Runs n o An ELSSI “skim” button (Skimming Service) using Ganga. TNT: n n n o Even in the absence of TAG production From your selected TAG events, generate an AOD dataset with only those events Output registered as new dataset Runs GANGA on the server to run the job on behalf of the user o User proxy is delegated to the server o Monitoring loop checks job status and notifies user of job completion / failure Integrate Ganga. TNT into Ganga. GUI. 30 Jan 2009 Elizabeth Gallas 22

Ganga TNT 30 Jan 2009 Elizabeth Gallas 23

Working on … (2) o Using TAGs with PAthena: Steps n n n o create an event collection (events. root) with ELSSI setup Pathena and the Grid environment use a joboption like the one you'd use to run a local analysis based on TAGs submit the Pathena job use Panda monitoring to check for completion use DQ 2 enduser clients (dq 2 -get) to retrieve the output files Problem: AOD to AOD (copy) is problematic in some releases 30 Jan 2009 Elizabeth Gallas 24

TAG job with Pathena Panda Pathena job. Option ELSSI or POOL Collection Utilities Output Dataset events. root POOL Collection Utilities TAG DB events. root events 1. root DQ 2 Catalogues DQ 2 Client 30 Jan 2009 Elizabeth Gallas 25