Скачать презентацию Internet Streaming Media Metadata Interchange with MPEG-7 Eric
3b9b70df726a6beb46c4cca5f4d5643a.ppt
- Количество слайдов: 37
Internet Streaming Media Metadata Interchange with MPEG-7 Eric Rehm CTO, singingfish. com Thomson multimedia 4 May 2001, Hong Kong
Overview • Brief look at Singingfish • Indexing Internet streaming media • Automating metadata delivery and processing • Case Study: Using XSL to transform MSNBC schema to MPEG-7
singingfish. com • • • Wholly-owned subsidiary of Thomson Multimedia B 2 B Streaming Media Search Service Pay per query business model Over 15 M streams indexed Live with customers since Jan 2000 – Info. Space: Metacrawler, Dogpile – Inside Internet AG: Swiss-Search, Austria-Search • Involved with MPEG-7 standards development since Sept 1999
Service Model
Indexing Streaming Media • High quality metadata improves relevancy of multimedia search results • Crawl…. or…work directly with multimedia “Content Producers” to acquire quality metadata • Solution: Implement FTP push/pull of metadata – Automated processing upon FTP close – Support bulk or incremental operations: add, update, delete, reset – Future: SOAP or other W 3 C XML protocol
Design Content Producer Program Metadata Engine
Development Goals • Single metadata schema interface to a database – Control development costs – Partition engineering and content development • Adapt to any “content partner” metadata – XML, CSV, Excel, Virage VDF, …. – Transform “content partner” metadata to MPEG-7 via: • Custom applications (CSV, Excel) MPEG-7 • Proprietary XML schemas XSL MPEG-7
Case Study Create XSL transformation • From: – MSNBC "Partner XML Format" • To: – MPEG-7 Description
Experimental Results • XSL Stylesheet: 370 lines of lightly commented code File lines chars elemnts attrs MSNBC Partner XML Example 73 1199 58 16 MPEG-7 Result 263 4471 151 74
Discussion • Basic MPEG-7 Tools • Semantic Encoding of MSNBC Keywords into MPEG-7 Structured Annotation DS (Who, What, Where, When, Why, How) • Encoding Controlled Terms using namespaces • Encoding Streaming Media Validity with the Availability DS • Extending an MPEG-7 DS
MSNBC Video Distribution Entry tdy_fletcher_mideast_001023 Keywords: Israel, palestinian, Yasser Arafat Top News Order: 12 Peace hopes slip farther The slim hopes for peace in the Mideast are rapidly fading, NBC’s Martin Fletcher reports Monday from the outskirts of Jerusalem. Today’s show • Barak, Sharon talk coalition • What’s on Today • What’s on Weekend Today • What’s on Today
MPEG-7 link to stream
" src="https://present5.com/presentation/3b9b70df726a6beb46c4cca5f4d5643a/image-15.jpg" alt="
< description>,
Enhanced
Encoding Controlled Terms 1. Singingfish. com Genres are described in one namespace (urn: sf: genre). 2. MSNBC Genres are described in another namespace (urn: msnbc: category )
Extending an MPEG-7 DS
. . .
Summary • Quality search depends on quality metadata – MPEG-7 standards ease development costs – Controlled vocabularies • MPEG-7 MDS can be used to interoperate • XML Schema allows controlled extensions
Thank you singingfish. com
Optional MPEG-7 Background Slides
MPEG-7 Basics • ISO/IEC 15928 Multimedia Content Description Interface • Comprehensive set of audiovisual description tools. • Enabled by key Internet standards: – W 3 C: XML, XML Schema – IETF standards: URI, URN, URL for resource naming and location • Harmonized with other emerging metadata standards: – Dublin Core, MPEG-21, News. ML, SMPTE Metadata Dictionary, TVAnytime, and more. • Text and compressed binary encodings – Both encodings have streaming add, delete, update features for delivery over real-time transports: MPEG-2, MPEG-4, IP, etc. • International Standard in October 2001 – Ballot period begins 14 March 2001
Basic elements Textual Annotation (free text, structured annotation, syntactic dependency, etc. ) Controlled vocabularies, Agent, Place, Graph, etc. Time, Duration, Medialocators Basic elements Schema tools Datatype & structures Link & media localization Basic DSs
Content Management & Description Format, Coding, Instances, Identification, Transcoding Hint, etc. (Several instances) Title, Creator, Creation location & date, Purpose, Classification, Genre, etc. (Author generated) Rights holder, Access rights, Usage Record, Financial aspects, etc. (Evolution) Creation & production Media Content Usage Content management Content description Structural aspects Conceptual aspects Viewpoint of the structure: Segments • Spatial / temporal structure& Schema Datatype • Audio, video low-level Ds structures tools • Elementary semantic information. Link & media localization Basic DSs
Content Management & Description (Conceptual aspects) Creation & production Media Content Usage Content management Content description Structural aspects Schema tools Conceptual aspects Datatype & structures Viewpoint of conceptual notions Link. Events, objects, abstract concepts, and Basic DSs • & media localization their relation
Navigation and Access Efficient & Creation support of : discovery, browsing, navigation, visualization / production sonification Media Content Usage Content management Navigation & Access Summary Content description Structural aspects Schema tools Conceptual aspects Datatype & structures Link & media localization Variation Basic DSs
Navigation and Access Navigation & Access Creation & production Media Content Usage Content management Summary Content description Structural aspects Schema tools Conceptual aspects Variation Substitution of the original content Adaptation to terminal, network, or Datatype & Link & media Basic DSs user preferences structures localization
Content Organization Collection & Classification Content organization Description and organization of Creation collection of documents & Navigation & Access production Media Probability Model Statistical functions and structures to describe Content sample of AV content and classes of descriptors. Summary Usage Content management Analytic model: Content description Definition of cluster, classes and models to associate a semantic label to a set of data. Structural aspects Schema tools Model Conceptual aspects Datatype & structures Link & media localization Variation Basic DSs
User Interaction Collection & Classification Content organization Analytic Model User identification and preferences: Navigation & Filtering, search and browsing Access Creation & production Media Content Usage Content management Summary Content description Structural aspects Schema tools Conceptual aspects Datatype & structures Link & media localization User Interaction User preferences Variation User preferences Basic DSs Usage History
MPEG-7 DDL • XML Schema • Data type extensions – MIME type, ISO country, region, currency codes – ISO Character set codes – Revised time data types to support arbitrary fractional seconds denominator for per-frame positioning • 2001 -05 -01 T 15: 23: 46 N 11 F 30 (11 th frame @ 30 FPS) • Type-centric approach using root abstract types – Control available global elements – Allow extension via name spaces and