Conference track contains 16 ontologies from the same domain (conference organization). These ontologies are suitable for ontology matching task because of their heterogenous character of origin. This year we will get the support from the MELT framework (see MELT evaluation for OAEI 2023). For list of planned evaluation methods see section below. Seven ontologies are involved in the reference alignment: Cmt, ConfTool, Edas, Ekaw, Iasted, Sigkdd, Sofsem.
Results are available.
Data set is available from this web-page (see below). You can either download them and try them on your own, but, finally, you have to create a package or a Web service of your tool based on MELT (see MELT evaluation for OAEI 2023). For running the Conference testsuite you will have to specify the following input parameters:
Additionally, we have three experimental test cases with regard to matching the cross-domain DBpedia ontology to three OntoFarm ontologies. We merely focus on entities of DBpedia ontology (dbo) from DBpedia namespace (therefore we prepared filtered DBpedia ontology), i.e. http://dbpedia.org/ontology/ and three selected ontologies from OntoFarm: confof, ekaw, sigkdd.
Available reference alignments are below
The collection of ontologies is dealing with conference organization. They have been developed within OntoFarm project. 16 ontologies are included; the last one (linklings.owl) is in the OWL 2 profile. Each of them is shortly described in the following table. Ontologies have been based upon three types of underlying resources:
|Name||Type||Number of Classes||Number of Datatype Properties||Number of Object Properties||DL expressivity||Related link|
These ontologies are in English. Based on this collection multilingual collection MultiFarm have been made and included into the OAEI campaign as MultiFarm track. Further, three ontologies (Cmt, Ekaw and Sofsem) from this track has been added into the complex matching track.
Participants will use MELT framework to deliver their results (see MELT evaluation for OAEI 2023). Alignments will be evaluated based on
The confidence values for all matches in the crisp reference alignment are 1.0, while the uncertain version of the reference alignment has confidence values that reflect the degree of agreement of a group of twenty people on the validity of the match. Crisp reference alignment contains 21 alignments (test cases), which corresponds to the complete alignment space between 7 ontologies (Cmt, ConfTool, Edas, Ekaw, Iasted, Sigkdd, Sofsem) from the data set. This is a subset of all ontologies within this track (16). Total number of possible test cases is hence 120. There are three variants of reference alignment:
Furthermore, participants can directly submit their 'interesting individual correspondences' ('nuggets') which could represent complex correspondences to organizers of this conference track, for contacts please see below. These correspondences will be evaluated manually.
 Michelle Cheatham, Pascal Hitzler: Conference v2.0: An Uncertain Version of the OAEI Conference Benchmark. International Semantic Web Conference (2) 2014: 33-48.
 Alessandro Solimando, Ernesto Jiménez-Ruiz, Giovanna Guerrini: Detecting and Correcting Conservativity Principle Violations in Ontology-to-Ontology Mappings. International Semantic Web Conference (2) 2014: 1-16.
 Alessandro Solimando, Ernesto Jiménez-Ruiz, Giovanna Guerrini: Minimizing conservativity violations in ontology alignments: algorithms and evaluation. Knowl. Inf. Syst. 51(3): 775-819 (2017)
 Ondřej Zamazal, Vojtěch Svátek. The Ten-Year OntoFarm and its Fertilization within the Onto-Sphere. Web Semantics: Science, Services and Agents on the World Wide Web, 43, 46-53. 2017.