Leopold Franzens Universität Innsbruck WP 2 Media

Leopold Franzens Universität Innsbruck WP 2 – Media Semantics and Ontologies Martin Hepp, Michael Luger, and Francois Scharffe University of Innsbruck EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel Copyright 2007 DERI Innsbruck www. deri. at

Outline • • • 2 Workpackage Overview RDF Storage and Retrieval Service Metadata Mapping Archivist Metadata Management Future Work Publications EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

Workpackage overview • T 2. 2 Ontology and Semantics for Media Object Representation (Completed) – Audio and speech ontology integrated to the framework. Still need testing of the representation functionalities of the speech extension. – MARC import module delivered. To be integrated in the archivist application. • T 2. 3 Ontology Management Environment (Ongoing) – WSMT Ontology management environment delivered. Still need to enhance the ontology language integration part (release planned in January) – General architecture delivered (see publications) – Web prototype delivered. The code was re-factored enabling its sharing. Plan is to set it on http: //www. easaier. org – RDF storage service just released (see later). Support to other partners will be provided for writing SPARQL queries. – Archivist application for ontology population still to be realized. (Start in January, see later) 3 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

Leopold Franzens Universität Innsbruck RDF Storage and Retrieval WP 2 – Media Semantics and Ontologies 4 Copyright 2006 EASAIER 18 Month Coordination Meeting, Tel. Israel EASAIER 18 Month Coordination Meeting, Tel Aviv, DERI Innsbruck www. deri. at

RDF Storage and Retrieval The Big Picture 5 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

RDF Storage and Retrieval The Big Picture 6 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

RDF Storage and Retrieval 7 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

RDF Storage and Retrieval • Persistent Storage • Insert, Update & Delete Operations • Intended for RDF Metadata generated from Feature Extractors – object identifiers, metadata, and related media • Retrieval • SPARQL Query Endpoint • Decoupled Component • Access via HTTP REST or Java API 8 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

RDF Storage and Retrieval • Sesame 2 Framework – Chosen after investigation of popular Semantic Web Frameworks • Boca, Jena, Joseki, Virtuoso, RDF RAP, etc. – Open Source (BSD license) – Modularized architecture – Storage • File System, Memory, RDBMS Storage Taken from http: //www. openrdf. org/doc/sesame 2/users/ch 03. html 9 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

RDF Storage and Retrieval • Sesame 2 Architecture application HTTP / SPARQL protocol application HTTP Server Repository Access API Se. RQL SPARQL SAIL Query Model SAIL API Rio RDF Model Taken from J. Broekstra et al - ESWC'06 Tutorial: Application Development with the Sesame Framework 10 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

RDF Storage and Retrieval • Programmatic (Remote) Access – Storage (Insert, Update, Delete Operations) • Sesame 2 Java API – RDF Statements: From File, Stream, utilizing Java I/O – Individual RDF Statements • HTTP REST API – Client libraries available for the majority of programming languages – Allows RDF/XML, N-Triple, N 3, . . . – Retrieval over SPARQL Endpoint • Sesame 2 Java API • HTTP REST API – Returns results in SPARQL Query Results XML Format 11 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

RDF Storage and Retrieval • Programmatic Access – Example GET /sesame/repositories/easaier? query=“select * where {? a ? b ? c}” HTTP/1. 1 Host: localhost Accept: application/sparql-results+xml POST /sesame/repositories/easaier HTTP/1. 1 Host: localhost Content-Type: application/rdf+xml [RDF statements] 13 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

RDF Storage and Retrieval • Tutorial 14 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

RDF Storage and Retrieval • Sesame 2 Framework – Native Inferencing Support for RDFS & OWL-Lite Fragment – Extensible • Support for External Reasoners and Rule Engines – OWLIM OWL Reasoner being ported to Sesame 2 (WSML support) • Transaction Support • Context Support 15 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

The Archivist Application • Allows the archivist to populate the archive by – Uploading Audio Content • Selection of the feature extraction algorithms – Importing new external sources (ex: Hotbed) – Importing Metadata (e. g. MARC) – Subsequently Update RDF Store & Binary Store • Configure parameters of the client applications. 16 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

Metadata Management • MARC 21 Metadata Mapping – Utilisation of MARCXML Toolkit (from loc. gov) • MARC 21 -> MARCXML Conversion – XSLT Transformation to RDF Dublin Core – Open Issue / TODO • Address special fields according to the Music. Ontology • METS – Administrative Format (LOC) • On-demand integration of other archives. • WSML Conversion with OWL-DL 17 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

Future Work • Continue and finish the OWL-WSML conversion. • Develop the archivist application • Support other partners with usage of the RDF storage and query functionalities • Support the integration of other archives. • Prepare the report on metadata management infrastructure and ontology language for media objects 18 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel

Publications • Publications – Michael Luger, Ying Ding, François Scharffe, Rubing Duan, Zhixian Yan. EASAIER: Semantic Music Retrieval Portal. Poster and Demonstration, SAMT Conference, Genova, Italy, 2007. – Michael Luger, Ying Ding, Zhixian Yan, François Scharffe, Rubing Duan, Yves Raimond, Luc Barthélémy, Josh Reiss. EASAIER: Semantic Music Retrieval Portal. Poster and Demonstration, ISWC, Busan, Korea, 2007. – François Scharffe, Yves Raimond, Luc Barthélémy, Ying Ding, and Michael Luger. Publishing and Accessing Digital Archives using the EASAIER Framework. Workshop on cultural heritage and the semantic web. ISWC, Busan, Korea, 2007. – François Scharffe. Ontology and Semantic Web Aspects. Enabling Access to Sound Archives Workshop. Minerva Conference, Jerusalem, 2007. 19 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel