Conference track contains 16 ontologies from the same domain (conference organization). These ontologies are suitable for ontology matching task because of their heterogenous character of origin. An evaluation process will be supported by SEALS platform, see section below for list of planned evaluation methods.
Results are available.
Data sets are available from this web-page (see below). You can either download them and try them on your own or you can directly use SEALS platform. Both options are possible, however finally you have to wrap your tool against the SEALS client provided via the OAEI mainpage and run this client against the Conference testsuite. For this purpose, a tutorial is linked via the OAEI 2012 page. For running the Conference testsuite you will have to specify the following input parameters:
The collection of ontologies is dealing with conference organization. They have been developed within OntoFarm project. 16 ontologies are included; the last one (linklings.owl) is in the OWL 2 profile. Each of them is shortly described in the following table. Ontologies have been based upon three types of underlying resources:
Name | Type | Number of Classes | Number of Datatype Properties | Number of Object Properties | DL expressivity | Related link |
Ekaw | Insider | 74 | 0 | 33 | SHIN | http://ekaw.vse.cz |
Sofsem | Insider | 60 | 18 | 46 | ALCHIF(D) | http://www.sofsem.cz |
Sigkdd | Web | 49 | 11 | 17 | ALEI(D) | http://www.acm.org/sigs/sigkdd/kdd2006 |
Iasted | Web | 140 | 3 | 38 | ALCIN(D) | http://iasted.com/conferences/2005/cancun/ms.htm |
Micro | Web | 32 | 9 | 17 | ALCOIN(D) | www.microarch.org |
Confious | Tool | 57 | 5 | 52 | SHIN(D) | http://www.confious.com |
Pcs | Tool | 23 | 14 | 24 | ALCIF(D) | http://precisionconference.com |
OpenConf | Tool | 62 | 21 | 24 | ALCOI(D) | http://www.zakongroup.com/technology/openconf.shtml |
ConfTool | Tool | 38 | 23 | 13 | SIN(D) | http://www.conftool.net |
Crs | Tool | 14 | 2 | 15 | ALCIF(D) | http://www.conferencereview.com |
Cmt | Tool | 36 | 10 | 49 | ALCIN(D) | http://msrcmt.research.microsoft.com/cmt |
Cocus | Tool | 55 | 0 | 35 | ALCIF | http://cocus.create-net.it/ |
Paperdyne | Tool | 47 | 21 | 61 | ALCHIN(D) | http://www.paperdyne.com/ |
Edas | Tool | 104 | 20 | 30 | ALCOIN(D) | http://edas.info/ |
MyReview | Tool | 39 | 17 | 49 | ALCOIN(D) | http://myreview.intellagence.eu/ |
Linklings | Tool | 37 | 16 | 31 | SROIQ(D) | http://www.linklings.com/ |
Note: Linklings ontology have been slightly changed wrt. replacement of xsd:date datatype (unsupported by OWL2) with xsd:dateTime. There are also other ontologies which use xsd:date datatype (Cmt, Iasted, Pcs, Sofsem and MyReview), however these ontologies have been made in OWL1. Thanks for reporting this bug to Ernesto Jimenez-Ruiz from Oxford, UK.
Note: these ontologies are in English. Based on this collection multilingual collection MultiFarm have been made and included into the OAEI campaign.
Participants will use SEALS platform to deliver their results. Alignments submitted via SEALS platform will be evaluated based on reference alignment, manual labeling, data mining method and logical reasoning.
Reference alignment contains 21 alignments (testcases), which corresponds to the complete alignment space between 7 ontologies (Cmt, ConfTool, Edas, Ekaw, Iasted, Sigkdd, Sofsem) from the data set. This is a subset of all ontologies within this track (16). Total number of possible testcases is hence 120. There are two variants of reference alignment:
Furthermore, participants can directly submit their 'interesting individual correspondences' ('nuggets') which could represent complex correspondences to organizers of this conference track, for contacts please see below. These correspondences will be evaluated manually.
Contact address is Ondřej Šváb-Zamazal (ondrej.zamazal at vse dot cz).