Ontology Alignment Evaluation Initiative - OAEI-2011 Campaign

Participants at IM@OAEI 2011

DatasetAgrMakerSERIMIZhishiCODI
DI-nyt-dbpedia-locations
DI-nyt-dbpedia-organizations
DI-nyt-dbpedia-people
DI-nyt-freebase-locations
DI-nyt-freebase-organizations
DI-nyt-freebase-people
DI-nyt-geonames
IIMB

Composition of the Data Interlinking task

Facet#ConceptsLinks to FreebaseLinks to DBPediaLinks to Geonames
People 4,979 4,979 4,977 0
Organizations 3,044 3,044 1,965 0
Locations 1,920 1,920 1,920 1,920

Data Interlinking results

AgreementMakerSERIMIZhishi.links
Dataset Prec. FMeas. Rec. Prec. FMeas. Rec. Prec. FMeas. Rec.
DI-nyt-dbpedia-loc. 0,79 0,69 0,61 0,69 0,68 0,67 0,92 0,92 0,91
DI-nyt-dbpedia-org. 0,84 0,74 0,67 0,89 0,88 0,87 0,90 0,91 0,93
DI-nyt-dbpedia-peo. 0,98 0,88 0,80 0,94 0,94 0,94 0,97 0,97 0,97
DI-nyt-freebase-loc. 0,88 0,85 0,81 0,92 0,91 0,90 0,90 0,88 0,86
DI-nyt-freebase-org. 0,87 0,80 0,74 0,92 0,91 0,89 0,89 0,87 0,85
DI-nyt-freebase-peo. 0,97 0,96 0,95 0,93 0,92 0,91 0,93 0,93 0,92
DI-nyt-geonames. 0,90 0,85 0,80 0,79 0,80 0,81 0,94 0,91 0,88
H-mean. 0,92 0,85 0,80 0,89 0,89 0,88 0,93 0,92 0,92

Precision/Recall for DI

Results of the IIMB task

CODI
Test Case Prec. FMeas. Rec.
001–010 0.94 0.84 0.76
011–020 0.94 0.87 0.81
021–030 0.89 0.79 0.70
031–040 0.83 0.66 0.55
041–050 0.86 0.72 0.62
051–060 0.83 0.72 0.64
061–070 0.89 0.59 0.44
071–080 0.73 0.33 0.21

Precison/Recall for IIMB

Original page: http://www.instancematching.org/oaei/imei2011/results.html [cached: 06/12/2011]