Towards Service Oriented Geoscience SEE Grid and APAC

Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining www. csiro. au

Outline • The “geoscience” modelling workflow • Inefficiencies • The Solid Earth and Environment Grid • The APAC (Geoscience) Grid • Putting it all together: pmd*CRC Modelling Workflow 2

Modelling Workflow Define the geological problem Build the model Run the model strong View and Interpret Results Iterate to achieve Understanding strong Tensile failure very weak Report and feed into knowledge base What is the role of: …Must be repeatable, robust and timely 3 Block model of dilation: • Competency of Fault set showing impact contrasts? “A” Dip variation • Permeability? mod. strong • Pore fluid pressure & flow fields? mod. strong

Inefficiencies in the Workflow Information is scattered across: § Organisations – company, geological survey, etc § Resources – different hardware and software platforms § Geography – geological surveys in each state and territory § Cost of data integration is high, in some situations exceeding all other costs Can these issues be removed? • Computational resources: § Different architectures suit different numerical codes better § Are often available but outside your organisations direct control § Are setup in different ways § Cost of adapting an investigators specific toolkit to use multiple sites is often prohibitive 4

The SEE Grid Community Working together (loosely) to develop a toolkit for interoperability for the Solid Earth and Environmental Sciences § Together… because our information and services need to be shared more easily to achieve our goals § Loosely… because ultimately we are separated by political and economic boundaries § Toolkit… because our World is dynamic and we need tools that can be reconfigured and chained together quickly to answer our questions …in this context we must reduce the barriers to becoming a part of the community 5

Pre-competitive geoscience data - The trouble is… Proprietary Software Versions of Software Client Data Structures 6

Our aim… Client XML GML/XMML 7

GA Reports Application Web. Map Composer CLIENT APPLICATIONS Common Interface Binding – GML/XMML DATA ACCESS SERVICES DOIR Web Feature Translation Service (WFS) Geoserver (Open Source) DATA SOURCES 8 DOIR Geochemistry or Little Feature Data Source Post. GIS (Open Source) GA to standards here Web Feature Service (WFS) PIRSA Web Feature Service (WFS) no PIRSA change required Geochemistry Feature Data Source Post. GIS (Open Source) here GA Geochemistry Feature Data Source Oracle

pmd*CRC Model Tools GA Reports Application CLIENTS Web. Map Composer Frac. SIS ? Common Interface Binding – GML/XMML DOIR WFS GA WFS PIRSA WFS DATA SERVICES NSWDPI WFS DATA SOURCES 9 NRM WFS MRT WFS NTGS WFS VICDPI WFS

Features – Geoscience Community (XMML & Geo. Sci. ML) Borehole § § § § collar location shape Fault collar diameter § shape length § surface trace operator Basin? § displacement logs § § age related observations formations § shape – time dependent § … … § resource estimate § … Ore-body Observation § § § § 10 location subject/specimen/station property/theme method operator date/time result (+ type/reference system/scale/classification) § … § § § commodity deposit type host formation shape resource estimate …

How would you use an interoperable service? Rendered into a map layer AND queried by a user or…. A user makes a request and gets back GML based data which can be …. … formatted into a report or …. … read and used by any enabled application 11 Slides courtesy Stuart Girvan – Geoscience Australia

Web Map Interface (courtesy of Social Change Online) Bounding Box Known Layers 12

Tabular Reports by Source (courtesy of Geoscience Australia) 13

Desktop Visualisation (courtesy of Fractal Technologies) 14

The Grid Application… Service Interactions User Workflow. . . Client Edit Problem Description Login Authentication Community Infrastructure Run Simulation Resource Registry Information Geology W. A Geology S. A 15 Job Monitor Job Management Service Local Repository Archive Search Data Management Service Computation Rock Prop. W. A Rock Prop. N. S. W Physical Resource Fastflo. RT Service Finley Service HPC Repository Physical Resource

Grid Technology Layers pmd*CRC SEE Grid APAC Grid 16

Traditional Mechanical Modelling Workflow • Models (mesh + data files) are individually and labouriously constructed • The manual process is error prone • “Powerful” desktop computes several models at a time • Limitations are in the order of ~2 models per week. Slide courtesy of Robert Cheung and Warren Potma 17 • Results are manually visualised one at a time. • Screenshots are manually taken and made into “movies”. • Very little, if any, standardised data archiving is done. This results in potential confusion or loss of the originating conditions of the experiments, making it unrepeatable in the long term.

New Refined Workflow Parameterised Geometry Creation Automated generation of visualisations Automated movie generation • Parameterised template or wizard driven model geometry/mesh creation. • Boundary condition & model properties parameter sweep utilities Automated archiving • automatically creates a “family” of model, data files based on varying a set of parameters. • Inversion algorithms • determine input parameters of future iterations automatically based on the user ranking of previous results. Multi-site data storage Storage Resource Broker Slide courtesy of Robert Cheung and Warren Potma 18 via 3 D Time varying volume visualisation

Results to Date For one Investigator, on one investigation: • 500 Models in 4 months (100 x more!) • Inversion/parameter sweep algorithms – semi-automated model creation; faster, less errors • Automated post-processing/visualisation – all views X all timescale X all models await the investigator automatically • Automated archiving – metadata searchable, more accurate store of experimental conditions, delivered to your store! 19

Conclusion Major modelling inefficiencies have been removed by: • Integrating the pmd*CRC geoscience modelling workflow with the: • Solid Earth and Environment Grid, and • APAC (Geoscience) Grid 20

Exploration and Mining Name Dr Robert Woodcock Title Principle Software Engineer Phone +61 8 6436 8780 Email Mr Ryan Fraser Software Engineer +61 8 6436 8760 Ryan. Fraser@csiro. au Robert. Woodcock@csiro. au Web Name Title Phone Email www. csiro. au www. seegrid. csiro. au Thank You Contact CSIRO Phone Email Web 1300 363 400 +61 3 9545 2176 enquiries@csiro. au www. csiro. au