1 / 24

Description of some multimedia ontologies

Description of some multimedia ontologies. Rapha ë l Troncy. Thursday 1 st of December, 2005. Raphael.Troncy@cwi.nl. Multimedia Ontologies. Multimedia ontologies can be related to many works, standards, communities … Focus here on MPEG-7 ... as a whole

glenna
Download Presentation

Description of some multimedia ontologies

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Description of somemultimedia ontologies Raphaël Troncy Thursday 1st of December, 2005 Raphael.Troncy@cwi.nl

  2. Multimedia Ontologies • Multimedia ontologies can be related to many works, standards, communities … • Focus here on MPEG-7 ... as a whole • ISO Standard composed of 11 parts but it is still growing … • DDL = XML Schema + small extensions • Descriptors and Description Schemes • 1182 elements, 417 attributes, 377 complex types in the schema (MDS + Visual + Audio parts) • 40 Classification Schemes

  3. Agenda • DSTC's Proposal • Jane Hunter & Suzanne Little (ABC model) • TUC's Proposal • Chrisa Tsinaraki (DELOS) • INA's Proposal • Antoine Isaac & Raphaël Troncy • DMAG/MTG's Proposal • Roberto Garcia & Oscar Celma

  4. DSTC's Proposal (summary) • 1st proposal chronologically • MPEG-7 ontology developed in RDFS, then converted into DAML+OIL and now OWL • Contains 60 classes and 40 properties • OWL Full ontology • Cover the upper level of the MDS • segments and decomposition • agent, role, place, time and instrument • basic visual descriptors • Available at: http://maenad.dstc.edu.au/slittle/mpeg7.owl

  5. TUC's Proposal • Software Engineering Framework aiming to facilitate Knowledge-based MPEG-7 Multimedia Application Development • Being developed in TUC/MUSIC • Consists of: • An Ontological Infrastructure • Methodologies for Interoperability between MPEG-7 and OWL • An underlying MPEG-7 Repository • Tools implementing the DS-MIRF approach

  6. DS-MIRF Ontological Infrastructure

  7. DS-MIRF Ontological Infrastructure • An Upper Ontology that fully captures the MPEG-7 MDS and a part of the MPEG-7 Visual • Being extended to capture the MPEG-21 DIA Architecture • Transformation Rules to transform OWL Ontologies and OWL/RDF metadata into MPEG-7 documents • Implemented in the GraphOnto Ontology and Metadata Editor

  8. TUC's Ontology Definition Methodology • Manual definition based on the following rules: • MPEG-7 Simple Datatype Representation: Integration of the XML Schema simple datatypes (rdfs:Datatype) • MPEG-7 Complex Type Representation: Homonym OWL Classes • Attributes & Simple Type Elements: Datatype Properties • Complex Type Elements: Object Properties • Subclassing: • Simple Types: Datatype property with rdf:ID “type_nameContent” – where type_name is the type of the supertype • Complex Types: rdfs:subclassOf • Constraints: OWL Restrictions • MPEG-7 Classification Scheme Representation: Individuals of the MDS type “ClassificationSchemeType”

  9. TUC's Proposal (summary) • Cover the full standard • Contains 420 classes and 175 properties for the MDS part • OWL DL • Cover also the CSs • The 40 CSs have been translated into simple OWL hierarchy • Available at: http://elikonas.ced.tuc.gr/ontologies/av_semantics.zip

  10. INA's Proposal • Different uses of AV Document Descriptions • Archival and description of documents from a cultural heritage point of view: INA • Exchanging program identification and characterization for interactive TV: TV-Anytime • Diffusion of program information (news agencies): ProgramGuideML • Storing and sharing AV content descriptions (automatic extraction results): MPEG-7 standard

  11. Can we find an AV core ontology? • There are many common needs amongst observed applications • Characterization of programs and sequences • Decomposition of programs and sequences • Ability to introduce description of the activities that constitute the context of AV documents (roles of people involved, ways production and broadcast are achieved) • These concepts are close to a "neutral" archival viewpoint

  12. C.O. content • Concerning AV objects: • distinction sequence/program • decomposition and qualification of those objects • link to external world themes and entities (content description) • Underlying use patterns for elicited categories

  13. Example:Upper-level categorization of sequences

  14. Example:Upper-level categorization of program

  15. INA's Proposal (summary) • Cover the MDS upper part, and partially the audio and visual parts • Contains 610 classes • OWL DL • Cover also (partially) the CSs • adapted to TV Anytime (and ProgramGuideML) • adapted to INA's needs • Linked to the DOLCE ontology • Available at: http://www.cwi.nl/~troncy/MPEG-7/

  16. DMAG/MTG's Proposal • Reuse MPEG-7 implicit semantics. • XMLSemantic Web: • XSD2OWL: schema to ontology. • XML2RDF: XML instance data to RDF instances. • Tested as integration base for:MusicBrainz, Simac, Music Vocabulary, etc.

  17. XML Schema OWL rdf:Property owl:DatatypeProperty owl:ObjectProperty element|attribute element@substitutionGroup rdfs:subPropertyOf element@type rdfs:range complexType|group|attributeGroup owl:Class complexType//element owl:Restriction extension@base|restriction@base rdfs:subClassOf @maxOccurs @minOccurs owl:maxCardinality owl:minCardinality sequence choice owl:intersectionOf owl:unionOf XMLSchema to OWL Mappings

  18. DMAG/MTG's Proposal (summary) • Cover the whole MPEG-7 + the upper level of the Classification Schemes • Contains 2372 classes and 975 properties • OWL Full • Available at: http://dmag.upf.edu/ontologies/mpeg7ontos/

  19. Questions ?

  20. Towards an harmonization of these multimedia ontologies Raphaël Troncy Thursday 1st of December, 2005 Raphael.Troncy@cwi.nl

  21. Preliminary results • Current state: • Proposals are made individually, for specific research project • The OWL files contains some errors • Corrected versions available for DSTC and DMAG/MTG ontologies • Different conceptualizations have been obtained … even if they start from the same MPEG-7 schema • No MPEG-7 endorsement

  22. (Personal) Idea: Three step process • Aligning pair-wise ontologies • Visual part of aceMedia vs DMAG vs TUC • MDS part of Hunter vs DMAG vs TUC vs INA • CSs part of DMAG vs TUC vs INA • Merging and fusing • Re-engineering (manually) ! • Current proposals are based on automatic translation rules from XSD to OWL (except INA) • Does NOT go beyond what XML Schema can express

  23. Open Issues • OWL DL vs OWL Full • Real modularization of MPEG-7 • upper part, visual, audio, CSs • requires breaking some existing relationships ! • Do we have to capture all MPEG-7 ? • people, agent, role, place are not multimedia-specific • Are there more multimedia ontologies currently developed ? • Proton: http://proton.semanticweb.org/ • Boemie: re-use the aceMedia ontologies (MDO, VDO)

  24. Questions ?

More Related