Ontology Alignment Evaluation Initiative - HOBBIT evaluation for OAEI 2021 Campaign

HOBBIT evaluation for OAEI 2021

Instructions for participants

System developers willing to participate in the HOBBIT tracks are required to follow different instructions with respect to the MELT instructions.

Check the following examples to submit a HOBBIT compliant system:

• Ontology matching tasks. See example of LogMap wrapping for HOBBIT. So far implements the interfaces for Conference, Anatomy, Largebio and SPIMBENCH tracks. Contact: Ernesto Jimenez Ruiz: ernesto [dot] jimenez [dot] ruiz [at] gmail [dot] com
• Link discovery task. See instructions here. Main contact: Nina Saveta: jsaveta [at] gmail [dot] com

In addition, MELT implements a framework to create HOBBIT compliant matching systems. Check details here.

The standalone software library called the HOBBIT Java SDK may also enable an easier way to implement a benchmark or a system. It will also make possible to run local tests before submitting to the platform.

Participants have to follow this procedure:

1. Register your matching tool. Participants must register their intention to participate in the OAEI 2021 by filling this online form.
2. Wrap the current version of your matching tool. Follow the instruction in the examples above and push the docker images to the HOBBIT platform (a personal access token is required).
3. Test your tool with the data sets available. Test your system (locally when possible) and remotely using HOBBIT's public instance. More details in the HOBBIT wiki pages.