Partner Logo WP 5 Summary Paris John Gordon

Partner Logo WP 5 Summary Paris John Gordon WP 5 6 th March 2002 Author - Title- Date - n° 1

u. WP 5 Meeting 4 th March u. Replica. Manager & Storage. Element John Gordon - SE Workshop - 24/09/01° 2

WP 5 meeting u. Deliverables n D 5. 1 - Review of Current Technology s n submitted and accepted D 5. 2 - Architecture and Design s submitted and accepted u. Testbed 1 n RFIO server on SE, Client on CE, SE, WN n Information providers for SE use by RB (and Files) n Staging scripts in GDMP John Gordon - SE Workshop - 24/09/01° 3

So what is an SE in Testbed 1? u. A disk server urunning GDMP v 2. 1 urunning information providers urunning data servers (RFIO, Grid. FTP) uoptionally NFS mount user data on local CE uoptionally stage replicated data to MSS John Gordon - SE Workshop - 24/09/01° 4

Testbed 1 u. Testbed 1. 0 January n RFIO rpms in overall package lists but not on all nodes n Staging script rpms corrupt, not tested with GDMP n SE information providers used by RB n File information providers tested? u. Testbed 1. 1 and later n RFIO tested on SE, CE, WN n Staging scripts finally tested with Castor n Multiple instances of GDMP for multiple VOs John Gordon - SE Workshop - 24/09/01° 5

Testbed 2 u. SE will be a Grid Service that interfaces storage systems to the Grid u. It will support multiple data transfer protocols and Mass Storage Systems n although a particular SE may only support one protocol and one MSS u. It will present a common API to storage and will add extra functionality John Gordon - SE Workshop - 24/09/01° 6

Clients Top layer Interface 1 SE Architecture Interface 2 Interface 3 Session Manager Core Message Queue System Log Bottom layer Meta. Data House Keeping MSS Interface MSS 1 MSS 2 Storage Element John Gordon - SE Workshop - 24/09/01° 7

Published Plans for 2002 u. From December 2001 u. Revise? John Gordon - SE Workshop - 24/09/01° 10

Project List u. Core n SE Gradually breaking down design into components. u. GSI/Castor needed u. Disk Pool Manager - July u. Information n Provider Testing performanc testing and R-GMA testin u. Grid. FTP n - multithreads being added, mapfile & Globus i/o (JJ, MG) HSM (Globus xio) John Gordon - SE Workshop - 24/09/01° 11

Project List 2 u. RFIO n RFIO over Grid. FTP, u. BBFTP n RFIO, HPSS, Grid. FTP Interface u. Castor Filesystem n use slashgrid module for handling grid certs n VFS rather than Coda John Gordon - SE Workshop - 24/09/01° 12

Partner Logo WP 1/2/5/8 Paris Wednesday 6 th March 2002 Author - Title- Date - n° 13

RM and SE Issues u. What is an owner? n File creator gets full control and can delegate. n Could call ‘administrator’ rather then owner. u. Who n RM has admin rights for master and replicas u. File n owns files in SE? Metadata many items of metadata need to be copied when replica is created so that (eg) access rights are the same for replicas as master. John Gordon - SE Workshop - 24/09/01° 14

Security u. GSI taken for granted for authentication u. What n n model of authorisation? Will CAS meet requirements? We don’t know yet. How fine-grained should permissions be? (file, directory, role? ) directory u. Input to Security Group John Gordon - SE Workshop - 24/09/01° 15

Storage u. All disk servers should be SEs even if integrated in CE u. Advanced n API to get filenames for new files in SE u. How n reservation in SE to handle reservation of internal WN disk? Does batch system handle this? John Gordon - SE Workshop - 24/09/01° 16

Broker. Info. File u. Extensions are needed in the short term for TB 1 n Which SE(s) n Output Filename n TFN? s WP 8 want all files to look local John Gordon - SE Workshop - 24/09/01° 17

Metadata u. Additional metadata still to be defined. John Gordon - SE Workshop - 24/09/01° 18

Additional Data Interfaces u. Extra u. Root n information on creation - permanent server supports collections of files and partial file access u. Slashgrid n under development as local filesystem on grid site n could develop as unix filesystem interface to SE. u. Remote open? John Gordon - SE Workshop - 24/09/01° 19

Replica. Manager examples u. By Heinz Stockinger u. How n n does one apply ACL to file being registered? Possible now by creating file yourself in SE and registering with RM not when using copy and register John Gordon - SE Workshop - 24/09/01° 20

Scheduling & Open u. Example of RB/RM scheduling from Kurt John Gordon - SE Workshop - 24/09/01° 21

JDL extensions u. Access u. Partial pattern hints file access John Gordon - SE Workshop - 24/09/01° 22