Conference track

Conference track contains 16 ontologies from the same domain (conference organization). These ontologies are suitable for ontology matching task because of their heterogenous character of origin. This year we will get the support from the MELT framework (see MELT evaluation for OAEI 2024). For list of planned evaluation methods see section below. Seven ontologies are involved in the reference alignment: Cmt, ConfTool, Edas, Ekaw, Iasted, Sigkdd, Sofsem.

Results

Results will be available according to the schedule.

Data set

Data set is available from this web-page (see below). You can either download them and try them on your own, but, finally, you have to create a package or a Web service of your tool based on MELT (see MELT evaluation for OAEI 2024). For running the Conference testsuite you will have to specify the following input parameters:

Conference Testsuite

Repository: http://oaei.webdatacommons.org/tdrs/
Suite-ID: conference
Version-ID: conference-v1

Additionally, we have three experimental test cases with regard to matching the cross-domain DBpedia ontology to three OntoFarm ontologies. We merely focus on entities of DBpedia ontology (dbo) from DBpedia namespace (therefore we prepared filtered DBpedia ontology), i.e. http://dbpedia.org/ontology/ and three selected ontologies from OntoFarm: confof, ekaw, sigkdd.

Conference DBpedia Testsuite (subtrack)

Repository: http://oaei.webdatacommons.org/tdrs/
Suite-ID: conference
Version-ID: conference-dbpedia

Available reference alignments are below

	Equiv
confof	dbpedia_confOf
ekaw	dbpedia_ekaw
sigkdd	dbpedia_sigkdd

The collection of ontologies is dealing with conference organization. They have been developed within OntoFarm project. 16 ontologies are included; the last one (linklings.owl) is in the OWL 2 profile. Each of them is shortly described in the following table. Ontologies have been based upon three types of underlying resources:

actual conference (series) and its web pages (indicated in column Type with mark Web),
actual software tool for conference organisation support (indicated in column Type with mark Tool),
experience of people with personal participation in organisation of actual conference (indicated in column Type with mark Insider).

Name is derived from name of conference or conference organisation tool. For downloading this ontology, just click on its name or you can download all ontologies at once.
DL expressivity was obtained by Pellet reasoner.

Name	Type	Number of Classes	Number of Datatype Properties	Number of Object Properties	DL expressivity	Related link
Ekaw	Insider	74	0	33	SHIN	http://ekaw.vse.cz
Sofsem	Insider	60	18	46	ALCHIF(D)	http://www.sofsem.cz
Sigkdd	Web	49	11	17	ALEI(D)	http://www.acm.org/sigs/sigkdd/kdd2006
Iasted	Web	140	3	38	ALCIN(D)	http://iasted.com/conferences/2005/cancun/ms.htm
Micro	Web	32	9	17	ALCOIN(D)	www.microarch.org
Confious	Tool	57	5	52	SHIN(D)	http://www.confious.com
Pcs	Tool	23	14	24	ALCIF(D)	http://precisionconference.com
OpenConf	Tool	62	21	24	ALCOI(D)	http://www.zakongroup.com/technology/openconf.shtml
ConfTool	Tool	38	23	13	SIN(D)	http://www.conftool.net
Crs	Tool	14	2	15	ALCIF(D)	http://www.conferencereview.com
Cmt	Tool	36	10	49	ALCIN(D)	http://msrcmt.research.microsoft.com/cmt
Cocus	Tool	55	0	35	ALCIF	http://cocus.create-net.it/
Paperdyne	Tool	47	21	61	ALCHIN(D)	http://www.paperdyne.com/
Edas	Tool	104	20	30	ALCOIN(D)	http://edas.info/
MyReview	Tool	39	17	49	ALCOIN(D)	http://myreview.intellagence.eu/
Linklings	Tool	37	16	31	SROIQ(D)	http://www.linklings.com/

These ontologies are in English. Based on this collection multilingual collection MultiFarm have been made and included into the OAEI campaign as MultiFarm track. Further, three ontologies (Cmt, Ekaw and Sofsem) from this track has been added into the complex matching track.

Modalities

Participants will use MELT framework to deliver their results (see MELT evaluation for OAEI 2024). Alignments will be evaluated based on

crisp reference alignment,
its uncertain version (presented at ISWC 2014 [1]) and
logical reasoning evaluation based on violations of conservativity principle (published in ISWC 2014 and KAIS 2017 [2,3]).

The confidence values for all matches in the crisp reference alignment are 1.0, while the uncertain version of the reference alignment has confidence values that reflect the degree of agreement of a group of twenty people on the validity of the match. Crisp reference alignment contains 21 alignments (test cases), which corresponds to the complete alignment space between 7 ontologies (Cmt, ConfTool, Edas, Ekaw, Iasted, Sigkdd, Sofsem) from the data set. This is a subset of all ontologies within this track (16). Total number of possible test cases is hence 120. There are three variants of reference alignment:

original reference alignment (ra1) which you can download - if you use the data set please cite new paper about conference ontologies [4].
entailed reference alignment (ra2) generated as a transitive closure computed on the original reference alignment (ra1). In order to obtain coherent reference alignment set, conflicting correspondences have been inspected and resolved by evaluators. As a result the degree of correctness and completeness of ra2 is probaly slightly better than for ra1. However, the differences are relatively restricted. ra2 is not available.
rar2 is a violation free version of reference alignment (ra2). First violating correspondences have been detected using approach from [2, 3] and then carefully resolved by an evaluator.

Furthermore, participants can directly submit their 'interesting individual correspondences' ('nuggets') which could represent complex correspondences to organizers of this conference track, for contacts please see below. These correspondences will be evaluated manually. There is also a track targetting complex correspondences see Complex.

Schedule

The schedule is available at the OAEI main page.

Organizers

Ondřej Zamazal (Prague University of Economics and Business, CZ), main contact for the track, ondrej dot zamazal at vse dot cz
Jana Vataščinová (Prague University of Economics and Business, Prague, CZ)
Lu Zhou (Flatfee Corp, USA)

References

[1] Michelle Cheatham, Pascal Hitzler: Conference v2.0: An Uncertain Version of the OAEI Conference Benchmark. International Semantic Web Conference (2) 2014: 33-48.

[2] Alessandro Solimando, Ernesto Jiménez-Ruiz, Giovanna Guerrini: Detecting and Correcting Conservativity Principle Violations in Ontology-to-Ontology Mappings. International Semantic Web Conference (2) 2014: 1-16.

[3] Alessandro Solimando, Ernesto Jiménez-Ruiz, Giovanna Guerrini: Minimizing conservativity violations in ontology alignments: algorithms and evaluation. Knowl. Inf. Syst. 51(3): 775-819 (2017)

[4] Ondřej Zamazal, Vojtěch Svátek. The Ten-Year OntoFarm and its Fertilization within the Onto-Sphere. Web Semantics: Science, Services and Agents on the World Wide Web, 43, 46-53. 2017.