Ontology Alignment Evaluation Initiative - OAEI-2021 CampaignOAEI OAEI

Complex track - Evaluation

General description

The complex track aims at evaluating the systems which can generate complex correspondences.

This track contains 2 datasets: Conference, Populated Conference.

The detailed description of each dataset can be found at the OAEI Complex track page

Participating systems

This track is not attracting many participants since several years. This year, MatchaC, LogMap and LogMapLite have been registered to participate. While LogMapLite and LogMap are dedicated to generate simple correspondences, only LogMap was able to generate alignments.

MatchaC, the only systems specifically designed to generated expressive alignments, had some problems to deal with the datasets and was not able to generate valid correspondences.

Conclusions

As last year, this track attracts a too few number of participants. Unfortunately, several datasets have also been discontinued (Hydrography, GeoLink, Populated GeoLink, Populated Enslaved and Taxon) given the unavailability of organisers. New organisers are welcome. So, several efforts have to be made in order to increase participation and gather also new track organisers.

Organizers

References

[1] Ondřej Zamazal, Vojtěch Svátek. The Ten-Year OntoFarm and its Fertilization within the Onto-Sphere. Web Semantics: Science, Services and Agents on the World Wide Web, 43, 46-53. 2017.

[2] Élodie Thiéblin, Ollivier Haemmerlé, Nathalie Hernandez, Cassia Trojahn. Task-Oriented Complex Ontology Alignment: Two Alignment Evaluation Sets. In : European Semantic Web Conference. Springer, Cham, 655-670, 2020.

[3] Élodie Thiéblin, Fabien Amarger, Nathalie Hernandez, Catherine Roussey, Cassia Trojahn. Cross-querying LOD datasets using complex alignments: an application to agronomic taxa. In: Research Conference on Metadata and Semantics Research. Springer, Cham, 25-37, 2017.

[4] Lu Zhou, Michelle Cheatham, Adila Krisnadhi, Pascal Hitzler. A Complex Alignment Benchamark: GeoLink Dataset. In: International Semantic Web Conference. Springer, 2020.

[5] Marc Ehrig, and Jérôme Euzenat. "Relaxed precision and recall for ontology matching." K-CAP 2005 Workshop on Integrating Ontologies, Banff, Canada, 2005.

[6] Lu Zhou, Michelle Cheatham, Adila Krisnadhi, Pascal Hitzler. GeoLink DataSet: A Complex Alignment Benchmark from Real-world Ontology. In: Data Intellegence. Volume 2, Issue 3, Pages 353-378, MIT Press, 2020.

[7] Lu Zhou, Cogan Shimizu, Pascal Hitzler, Alicia M. Sheill, Seila Gonzalez Estrecha, Catherine Foley, Duncan Tarr, Dean Rehberger. The Enslaved Dataset: A Real-world Complex Ontology Alignment Benchmark using Wikibase. In: Conference on Information and Knowledge Management, ACM, 2020.