Ontology Alignment Evaluation Initiative - OAEI-2012 Campaign

Mapping repair in the large biomedical ontologies

We have used LogMap's repair facility [1] and Alcomo [2] to repair the alignments generated by the top-7 ontology matching systems [3].

The original alignments and the computed approximate repairs (R≈) can be downloaded as a zip file [255Mb].

The coherence results, before and after repair, are summarized in Tables 1-3 (see complete results in [3]). Note that LogMap and its variant LogMap-noe already provided an almost coherent output.

Table 1: Mapping coherence of the top 7 systems
System FMA-NCI FMA-SNOMED SNOMED-NCI
 |A ⊑ ⊥|    Ratio    |A ⊑ ⊥|    Ratio    |A ⊑ ⊥|    Ratio  
LogMap_noe 9 0.01% 10 0.003% ≥0 ≥0%
LogMap 9 0.01% 10 0.003% ≥17 ≥0.005%
ServOMap 48,743 27% 273,242 71% ≥313,643 ≥84%
ServOMapL 50,334 28% 99,726 26% ≥314,939 ≥84%
GOMMA 5,574 4% 10,752 3% ≥266,051 ≥71%
GOMMA_bk 12,939 9% 119,657 31% ≥313,015 ≥84%
YAM++ 50,550 29% 106,107 28% ≥269,107 ≥72%

Table 2: Mapping repair using LogMap.
System FMA-NCI FMA-SNOMED SNOMED-NCI
  |R≈|    |A ⊑ ⊥|    |R≈|    |A ⊑ ⊥|    |R≈|    |A ⊑ ⊥| 
ServOMap 115 9 2,640 0 1,671 ≥296
ServOMapL 166 9 2,953 0 1,656 ≥1,241
GOMMA 142 9 618 0 2,949 ≥37
GOMMA_bk 259 9 5,295 0 5,003 ≥1
YAM++ 141 9 3,461 0 1,049 ≥0

Table 3: Mapping repair using Alcomo.
System FMA-NCI FMA-SNOMED SNOMED-NCI
  |R≈|    |A ⊑ ⊥|    |R≈|    |A ⊑ ⊥|    |R≈|    |A ⊑ ⊥| 
ServOMap 97 9 829 0 937 ≥35
ServOMapL 126 9 975 0 1,076 ≥2,055
GOMMA 123 15 463 0 1,903 ≥2,085
GOMMA_bk 184 29 1,726 1,363 2,720 ≥30,583
YAM++ 116 10 783 0 757 ≥0

References

[1] Ernesto Jimenez-Ruiz and Bernardo Cuenca Grau. LogMap: Logic-based and scalable ontology matching. In Proc. of 10th International Semantic Web Conference (ISWC), 2011 [url]

[2] Christian Meilicke. Alignment Incoherence in Ontology Matching. University of Mannheim, Chair of Artificial Intelligence, 2011 [url]

[3] Ernesto Jimenez-Ruiz, Christian Meilicke, Bernardo Cuenca Grau and Ian Horrocks. Evaluating Mapping Repair Systems with Large Biomedical Ontologies. In 26th International Workshop on Description Logics, 2012 [pdf]

Original page: http://www.cs.ox.ac.uk/isg/projects/SEALS/oaei/2012/repair2012.html [cached: 24/06/2014]