Extensions for the ETICS client for Multi-Platform Support in NGIs Driven by User Requirements Eamonn Kenny*, Brian Coghlan, Peter Lavin, John Walsh Conference: CGW’ 09 Date: Oct 12 th
User Community in EGI/NGI Infrastructure SPARC SL 5 Site Ubuntu site linked EGI/NGI linked NGI Site/NGI provision User requirements site platform NGI sites AIX Debian Communications EGI SLES SL 5 Site YDL NGI Darwin Site SL 5
Open Source ETICS Structure SPARC SL 5 Site Ubuntu ETICS server ETICS clients NGI Site/NGI provision User requirements NGI sites AIX Debian Communications EMI/UMD SLES SL 5 Site YDL NGI Darwin Site SL 5
Extensions for Multi-Platform Support XML Build System Wrapper • XML based build descriptions for multi-platform support • An automated GNU patch generation based on fixes to ETICS components, timestamped and stored for future patching. • Python based module, used as an interpreter for XML build descriptions, an intermediate patching system applied between checkout and builds, and table/report generation. Extra Utilities • Automated timestamped checkouts of ETICS configurations to be patched from the ETICS command-line interface. • Automatic RPM/deb to tarball generators in a form ready for integration into ETICS. • Python scripts used to create wiki tables showing differences between multiple build result files. Reporting • Automatic sync and storage of XML/HTML in a directory structure allowing automatic HTML table generation. • A Hypergraph generator using the ETICS XML results set
Extended client directory structure etics Main: xml-etics-build ETICS client Command line Xml parsing patches bin Main extension ETICS lib/lib 64 timestamp autocheckout repository autocommit Hypergraphs HTMLgen LEGEND python bash update web-server workspace RPM/deb DM DM-modules generator project-rules build-rules patches Project/ component patches xml vendor Tarball creator
XML Based Build Structure build-rules. xml project-rules. xml WN-modules-3. 2. 0. xml WN-3. 2. 0. xml User runs commands like: $. /xml-etics-build 2 --dryrun --targets=“patch, build, publish” org. glite-workspace/WN-3. 2. 0. xml
Build Results & Achievements • • • Building on Cent. OS 5. x/4. x (x 86/x 86_64), Debian 4. 0/5. 0 (x 86_64), Mac OS X 10. 5 (x 86), Play Station 3 (Power. PC), open. SUSE 11. 1 (x 86_64) Local builds are way ahead of CERN for Debian 5. 0 x 86_64/x 86 although all patches auto-generated with timestamps are applied locally and defined in CERN savannah bug tracking system. Debian 5. 0/4. 0 x 86_64 g. Lite-UI/WN and open. SUSE 11. 1 x 86_64 glite-WN are ready for test. g. Lite-WN without DM is running on PS 3 for local users drug screening software.
Conclusions • TCD has been effectively using this software for 3 -4 years now. • The software is much more well developed since presented in CGW’ 07. • The software is relatively easy to manage and provides a good framework for anyone using ETICS locally. • The patches generated at the local sites MUST be fed back by NGI’s to EGI. • Going forward, open source development/porting of grid middleware should be encouraged!