Australian Society of Archivists Victorian Branch Seminar Accessibility

Australian Society of Archivists Victorian Branch Seminar Accessibility over time – the retention, use and re-use of information in the digital age Thursday 21 August 2008, 2 - 4. 30 pm Outcomes from the Clever Recordkeeping Metadata Project Joanne Evans and the CRKM Research team www. monash. edu. au

Outline • • Metadata Recordkeeping metadata Clever Recordkeeping Metadata Project Outcomes – Service oriented architectures and implications for recordkeeping – Developing and implementing recordkeeping metadata standards www. monash. edu. au 2

Maturing understanding of metadata • From ‘data about data’ to: Data are any and all complex data entities from observations, experiments, simulations, models, and higher order assemblies, along with the associated documentation needed to describe and interpret the data. Metadata are a subset of data, and are data about data. Metadata summarize data content, context, structure, interrelationships, and provenance (information on history and origins). They add relevance and purpose to data, and enable the identification of similar data in different data collections. National Science Foundation, Cyberinfrastructure Vision for 21 st Century Discovery, March 2007 http: //www. nsf. gov/od/oci/CI_Vision_March 07. pdf www. monash. edu. au 3

Defining metadata • Metadata – structured data/information that describes an object in order to facilitate its understanding, management and use. • Characteristics – Metadata is recursive – Metadata may be intrinsic – Metadata may be extrinsic – Metadata is dynamic – Metadata is complex – Metadata may apply at various layers of granularity, aggregation and abstraction – Purpose of metadata determines the attributes of the object that are described – Metadata may be different and similar across metadata communities www. monash. edu. au 4

Defining metadata (continued) • Metadata communities – Resource Discovery, Recordkeeping, Geospatial, Digital Rights, Preservation, Document Management, Data management, etc. • Metadata creation processes – Describing, Titling, Identifying, Annotating, Labelling, Cataloguing, Classifying, Categorising, Relating, Audit trailing, Tagging, etc. • Creation and management challenges – Expense – Resource intensive – Quality assurance www. monash. edu. au 5

Recordkeeping Metadata • Standardised information that identifies, authenticates, describes, manages and makes accessible, through time and space, documents created in the context of social and business activity. – Traditionally some of this metadata has been captured in records systems and some in archival control systems and finding aids. And some of it has been present in the physical form, ordering, juxtaposition and location of records. Increasingly recordkeeping metadata is also captured in workflow, document management and knowledge management systems, and it is essential to make what was before evident in the physicality of the record explicit in metadata. Source: Records Continuum Research Group, SPIRT Recordkeeping Metadata Project Glossary, http: //www. sims. monash. edu. au/research/rcrg/research/spirt/glossary. html www. monash. edu. au 6

Clever Recordkeeping Metadata Project ARC Linkage Project mid 2003 -2006 Chief Investigator • Professor Sue Mc. Kemmish, Monash University Partner Investigators • • Professor Anne Gilliland-Swetland, UCLA Mr Adrian Cunningham, National Archives of Australia Industry Partners and Collaborators • • • National Archives of Australia State Records Authority of New South Wales Australia Society of Archivists, Committee on Descriptive Standards http: //www. infotech. monash. edu. au/research/groups/rcrg/crkm www. monash. edu. au 7

Challenges for electronic recordkeeping • Manual descriptive processes unsustainable – cannot keep up with exponential increases in volumes of records created in the course of business and social activities – cannot be applied at lower levels of granularity inherent to digital medium – cannot keep up with transformations in way people work and communicate brought about by digital and network technologies www. monash. edu. au 8

Metadata systems approach • Bearman, Archivaria, 1993 – develop tools and methods ‘to acquire descriptions of individual records, files and record-keeping systems directly from the self-documenting features of electronic records systems. ’ • Hedstrom, Archivaria, 1993 – ‘In the electronic era, the descriptive paradigm will shift from the practice of augmenting scarce descriptive information to one of selecting from an abundance of metadata, which could form a complete audit trail of all actions taken to create, update and modify a record, and all of its uses. Automated systems have the capacity to capture and record far more descriptive information than was technically possible or economically feasible with manual systems. ’ www. monash. edu. au 9

www. monash. edu. au 10

Services model Points to description Registry Service Descriptions Locate service Describes service Finds service Exchange messages Consumer Service Source: Based on diagram from http: //www. softstar-inc. com/ www. monash. edu. au 11

Service oriented architectures (SOA) Recordkeeping Services www. monash. edu. au 12

Recordkeeping in SOA Metadata Broker www. monash. edu. au 13

Metadata Broker as cluster of web services Request the AGEMS – RKMSCA crosswalk Translation Service Registry Service Web Service Layer Request to translate AGEMS to RKMSCA AGEMS – RKMSCA Crosswalk Service Web Service Layer AGEMS RKMSCA Metadata Broker Client www. monash. edu. au 14

Are we ready for service orientation? Design for recordkeeping metadata Design for interoperability www. monash. edu. au 15

To participate in SOA … • Overcome paper thinking and dominance of paper paradigm www. monash. edu. au 16

To participate in SOA … • Move beyond static resource discovery metadata models www. monash. edu. au 17

To participate in SOA … • Standards for machine rather than human processability Abstract Recordkeeping Metadata Standards Conceptual Model Metadata/Data Standard Version 1 Metadata/Data Standard Version 2 Metadata/Data Standard Version n Representation Encoding 1 Encoding 2 Encoding n Version 1 Version 2 Version n Transport and Exchange Registry Objects www. monash. edu. au 18

Standards and interoperability • Standards compliance does not guarantee interoperability – Recordkeeping metadata standards are just a part of an infrastructure for interoperability Ø Balance between standardisation activities for best current practice versus standardisation activities to deliver better next generation practices www. monash. edu. au 19

Implementing recordkeeping metadata Schema Email and Desktop Schema Desktop Applications Business Schema Systems Schema Records Web Management System Web Management Crosswalk Application Systems Archival Gateways Records Archival Subject Metadata Subject Crosswalk Schema Management Crosswalk Schema Portals Broker Portals Application Crosswalk Business Information Systems Archival Metadata Management Broker Application Community Archives www. monash. edu. au 20

Innovate to service oriented future Recordkeeping Services www. monash. edu. au 21

• For more information see the Clever Recordkeeping Metadata Project Website • http: //www. infotech. monash. edu. au/ research/groups/rcrg/crkm joanne. evans@infotech. monash. edu. au www. monash. edu. au 22