The Digital Humanities (DH) track is newly established for OAEI 2024. It aims at the alignment of highly technical, multilingual domain vocabularies. The high quality reference is compiled manually, ensuring semantic, lexical and part-of-speech similarity. It offers different test cases from a subset of the Humanities: archaeology, cultural history and the interlink of DH and computer science. The goal is to evaluate the matching system perfomance when dealing with small datasets in different languages and specialist terms.
The resources and a comprehensive description is available in the DH-benchmark github repo. Each test case consists of a source and a target ontology and a manual reference alignment. For data provenance, see github description for more details.
MELT will be used and the output of the correspondences will automatically be evaluated against the manually complied reference by MELT. The evaluation will be based on precision, recall and F-measure. There will be additional criteria such as max. memory consumption and runtime.
The schedule is available at the OAEI 2024 main page.
The DH track is organised by Felix Kraus (https://www.scc.kit.edu/en/staff/14032.php).
For any kind of help or suggestions you are very welcome to contact the organizer using the following email (copying is not possible for spam protection reasons):