Ontology Alignment Evaluation Initiative - OAEI-2014 Campaign

MultiFarm

The goal of the MultiFarm track is to evaluate the ability of matcher systems to deal ontologies in different natural languages. It serves the purpose of evaluating the strength and weakness of matchers (by being progressive and wide coverage) and measuring the progress of matchers (by being stable and reusable over the years), with a special focus on multilingualism.

• Schedule
• Data sets
• Testing your tool
• Contacts

The schedule is that of http://oaei.ontologymatching.org/2014/

The MultiFarm data set is composed of a set of 7 ontologies translated into 8 languages (+English) -- Chinese (cn), Czech (cz), Dutch (nl), French (fr), German (de), Portuguese (pt), Russian (ru), Spanish (es) -- and the corresponding cross-lingual alignments between these ontologies. This data set is based on the OntoFarm data set, which has been used successfully for several years in the Conference track in the OAEI campaigns. For details on Multifarm, please refer to the data set description page.

This year, in order to provide some blind evaluation, we do not made available the translations on edas and ekaw ontologies in the current testing data set. The identifiers of the data set available for testing are given below :

The [pair-language] refers to one of the 36 different language pairs: cn-en, cn-cz, cz-es, fr-pt, en-pt, cz-de, pt-ru, cn-pt, cz-ru, de-fr, de-pt, en-es, en-fr, cn-nl, de-ru, cn-de, cn-es, en-nl, cz-en, en-ru, cz-fr, es-ru, de-en, nl-ru, es-pt, de-es, fr-nl, de-nl, nl-pt, es-nl, fr-ru, cz-pt, es-fr, cn-ru, cn-fr, cz-nl. For instance, cn-cz-multifarm refers to the test cases involving the chinese-czech language.

We encourage you to use the Alignment API for manipulating and generating your alignments, and, in particular, for computing evaluation of your results.

Please, refer to the instructions on how you can test your tools. Following those instructions, you have to use the MultiFarm data set identifiers indicated above.