HOBBIT evaluation for OAEI 2021
Instructions for participants
System developers willing to participate in the HOBBIT tracks are required to follow different instructions with respect to the MELT instructions.
Check the following examples to submit a HOBBIT compliant system:
- Ontology matching tasks. See example of LogMap wrapping for HOBBIT.
So far implements the interfaces for Conference, Anatomy, Largebio and SPIMBENCH tracks.
Contact: Ernesto Jimenez Ruiz: ernesto [dot] jimenez [dot] ruiz [at] gmail [dot] com
Link discovery task. See instructions
here. Main contact: Nina Saveta: jsaveta [at] gmail [dot] com
In addition, MELT implements a framework to create HOBBIT compliant matching systems.
Check details here.
The standalone software library called the HOBBIT Java SDK may also enable
an easier way to implement a benchmark or a system. It will also make possible to run local tests before submitting to the platform.
Participants have to follow this procedure:
- Register your matching tool. Participants must register their intention to participate in the OAEI 2021
by filling this online form.
- Wrap the current version of your matching tool.
Follow the instruction in the examples above and push the docker images to the HOBBIT platform (a personal access token is required).
- Test your tool with the data sets available.
Test your system (locally when possible) and remotely using HOBBIT's public instance.
More details in the HOBBIT wiki pages.