ICAT Integration at ISIS Tom Griffin ISIS Facility

ICAT Integration at ISIS Tom Griffin, ISIS Facility ICAT Developer Workshop The Cosener’s House, Abingdon August 2009 tom. griffin@stfc. ac. uk

ISIS • Neutrons and Muons • Operating since 1984 • 1600 user base; ~200 staff • Volume of data ~6 TB • ~5 M datafiles (27 instruments, 500/hour) • >6. 7 GB metadata, >33 M rows

Current Pre-Experiment

Data. ISIS

Data. ISIS • Main point of access for ISIS data • Maintains index of Run number -> Folder – GEM 12345 – \isisinst$NDXGEMInstrumentdatacycle_01_1GEM 12345. raw –. txt. log. sav 0 • Ranges • Zip files

Data. ISIS Authentication 1 User performs search via application e. g. Data Portal 2 Search is executed in ICAT 3 Permitted results are returned to application 4 Results are displayed to the user 5 6 7 User performs request to download datafile, multiple datafiles or dataset ICAT creates http GET link and passes to back to user (routed through application) session. Id email (optional) file. Id(s) or dataset. Id action (i. e. download, zip, compressed) User clicks http link 8 Data. ISIS call ICAT API to check permissions session. Id & datafile. Id(s) or dataset. Id 9 Return 10 Exception on failure or Download. Object on success - user. Id - array [filename, cycle, run number] User gets their data! 7 1 0 5 Data. ISIS 8 1 4 Data Portal 2 3 ICAT API 6 9

Current Pre-Experiment

‘To Be’ Pre-Experiment

Problems • RB Numbers • Business System • Not released to users • Replace Data. Portal with Top. Cat

Related Projects • Grid MP – distributed PC network • Analysis and simulation • New portal required anyway -> 1) Single point of access for Grid MP 2) Use ISIS data in Grid jobs 3) Store results and process in ICAT Where to store data?

Acknowledgments (who did what at ISIS) Freddie Akeroyd (Data. ISIS) Chris Moreton-Smith (ISIS DFS/FRS) Hannah Guest (Facilities Business System & ERAS) Matt Clarke (SECI modifications) Damian Flannery Stuart Ansell (write. Raw) ISIS Computing Group ISIS Data Analysis Group Laurent Lerusse (NXIngest) Database Services, Roger Downing, FBU IT Service Desk (servers and hosting) Core ICAT – Glen, Shoaib, Michael. . .

Questions. . .