Ontology Alignment Evaluation Initiative - OAEI-2009 CampaignOAEI

Ontology Alignment Evaluation Initiative

Benchmark preliminary results

This year 12 systems participated in the benchmark track.

The evaluation has been performed on the files provided by the participants (available here) which have been processed by the following script). The full set of normalised alignments is also available.

Summarised results

Table 1 provides the consolidated results by groups of tests. We display the results of participants as well as those given by some simple edit distance algorithm on labels (edna). The computed values are real precision and recall and not an average of precision and recall. Two systems are ahead, Lily and ASMOV, with aflood and RiMOM as close followers. GeRoME, AROMA, DSSim, and AgreementMaker (AgrMaker in the results) have intermediary performance. Last year, ASMOV, Lily and RiMOM had the best performance, followed by AROMA, DSSim, and aflood. No system had strictly lower performance than edna.

algo refalign edna aflood AgrMaker aroma ASMOV DSSim GeRoMe kosimap Lily MapPSO RiMOM SOBOM TaxoMap
test Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec.
1xx 1.00 1.00 0.96 1.00 1.00 1.00 0.98 0.98 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.99 0.99 1.00 1.00 1.00 1.00 1.00 1.00 0.98 0.97 1.00 0.34
2xx 1.00 1.00 0.41 0.56 0.98 0.74 0.98 0.60 0.98 0.69 0.96 0.85 0.97 0.62 0.92 0.71 0.94 0.57 0.97 0.86 0.75 0.73 0.93 0.81 0.97 0.46 0.90 0.23
3xx 1.00 1.00 0.47 0.82 0.90 0.81 0.92 0.79 0.85 0.78 0.81 0.82 0.94 0.67 0.68 0.60 0.72 0.50 0.84 0.81 0.54 0.29 0.81 0.82 0.92 0.55 0.77 0.31
H-mean 1.00 1.00 0.43 0.59 0.98 0.80 0.99 0.62 0.94 0.69 0.95 0.87 0.97 0.66 0.91 0.73 0.91 0.59 0.97 0.88 0.64 0.59 0.93 0.82 0.98 0.44 0.86 0.26

Comparison to 2008 tests

The tests are roughly the same as last year. We only suppressed some correspondences that rendered the merged ontologies inconsistent (in 301 and 304) since an increasing number of systems were able to test the consistency of the resulting alignments.

Table 2 provides the results of the systems on the tests of last year. Three systems that had participed last year (CIDER, SAMBO, and SPIDER) did not participate this year, and three systems have the first participation this year: AgreementMaker, kosimap, and SOBOM. For comparative purposes, Table 2 contains only the systems participating in both campaigns.

algo refalign edna aflood AgrMaker aroma ASMOV DSSim GeRoMe kosimap Lily MapPSO RiMOM SOBOM TaxoMap
test Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec.
1xx 1.00 1.00 0.96 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.96 0.79 1.00 1.00 0.92 1.00 1.00 1.00 1.00 0.34
2xx 1.00 1.00 0.41 0.56 0.96 0.69 0.96 0.70 0.95 0.85 0.97 0.64 0.56 0.52 0.97 0.86 0.48 0.53 0.96 0.82 0.95 0.21
3xx 1.00 1.00 0.47 0.82 0.95 0.66 0.82 0.71 0.81 0.77 0.90 0.71 0.61 0.40 0.87 0.81 0.49 0.25 0.80 0.81 0.92 0.21
H-mean 1.00 1.00 0.43 0.59 0.97 0.71 0.95 0.70 0.95 0.86 0.97 0.67 0.60 0.58 0.97 0.88 0.51 0.54 0.96 0.84 0.91 0.22

Table 2: Results on the 2008 tests.

Comparison to 2004 tests

Table 3 provides results on the very easy tests of 2004. As expected, systems perform very well.

algo refalign edna aflood AgrMaker aroma ASMOV DSSim GeRoMe kosimap Lily MapPSO RiMOM SOBOM TaxoMap
test Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec.
1xx 1.00 1.00 0.96 1.00 1.00 1.00 0.98 0.98 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.99 0.99 1.00 1.00 1.00 1.00 1.00 1.00 0.98 0.97 1.00 0.34
2xx 1.00 1.00 0.67 0.74 0.98 0.93 0.98 0.88 0.99 0.94 0.99 0.98 0.97 0.86 0.97 0.94 0.95 0.78 0.99 0.98 0.96 0.96 0.99 0.98 0.97 0.65 0.91 0.26
3xx 1.00 1.00 0.47 0.82 0.90 0.81 0.92 0.79 0.85 0.78 0.81 0.82 0.94 0.67 0.68 0.60 0.72 0.50 0.84 0.81 0.54 0.29 0.81 0.82 0.92 0.55 0.77 0.31
H-mean 1.00 1.00 0.67 0.80 0.98 0.93 0.97 0.89 0.97 0.93 0.97 0.96 0.97 0.86 0.94 0.90 0.93 0.78 0.97 0.96 0.94 0.88 0.97 0.96 0.97 0.69 0.90 0.28

Table 3: Results on the 2004 tests.

Precision/recall graphs

Figure 1 shows the precision and recall graphs of this year. These results are only relevant for the results of participants who provide confidence measures different from 1 or 0. This graph has been drawn with only technical adaptation of the technique used in TREC. Moreover, due to lack of time, these graphs have been computed by averaging the graphs of each of the tests (instead to pure precision and recall).

These results and those displayed in Figure 2 single out the same group of systems, Lily, ASMOV, aflood, and RiMOM which seem to perform these tests at the highest level of quality. Of these, Lily and ASMOV have slightly better results than the two others. So this confirms the leadership that we observed on raw results.

Like in the three previous campaigns, there is a gap between these systems and their followers (GeRoME, AROMA, DSSim, and AgreementMaker).

Figure 1: Precision/recall graphs. They cut the results given by the participants under a threshold necessary for achieving n% recall and compute the corresponding precision. Systems for which these graphs are not meaningful (because they did not provide graded confidence values) are drawn in dashed lines.

Triangle

The triangular display shows the same results as the other representations.

Figure 2: Each point expresses the position of a system with regard to precision and recall.

Full results

algo refalign edna aflood AgrMaker aroma ASMOV DSSim GeRoMe kosimap Lily MapPSO RiMOM SOBOM TaxoMap
test Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec. Prec. Rec.
101 1.00 1.00 0.96 1.00 1.00 1.00 0.98 0.98 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.99 0.99 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.99 1.00 0.34
103 1.00 1.00 0.96 1.00 1.00 1.00 0.98 0.98 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.99 0.99 1.00 1.00 1.00 1.00 1.00 1.00 0.97 0.96 1.00 0.34
104 1.00 1.00 0.96 1.00 1.00 1.00 0.98 0.98 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.99 0.99 1.00 1.00 1.00 1.00 1.00 1.00 0.98 0.97 1.00 0.34
201 1.00 1.00 0.04 0.04 0.94 0.78 0.98 0.84 1.00 0.99 1.00 1.00 0.84 0.84 0.92 0.98 0.80 0.29 1.00 1.00 1.00 1.00 1.00 1.00 n/a n/a 0.55 0.06
201-2 1.00 1.00 0.76 0.79 1.00 0.97 0.98 0.96 1.00 1.00 1.00 1.00 0.98 0.98 1.00 1.00 0.95 0.85 1.00 1.00 1.00 1.00 1.00 1.00 0.97 0.79 0.94 0.32
201-4 1.00 1.00 0.57 0.60 1.00 0.94 1.00 0.95 1.00 1.00 1.00 1.00 0.94 0.94 0.98 0.99 0.91 0.74 1.00 1.00 0.98 0.98 1.00 1.00 1.00 0.65 0.83 0.26
201-6 1.00 1.00 0.40 0.41 0.98 0.90 1.00 0.92 1.00 0.99 1.00 1.00 0.92 0.91 0.98 0.98 0.89 0.66 1.00 1.00 1.00 1.00 1.00 1.00 0.98 0.47 0.71 0.21
201-8 1.00 1.00 0.23 0.24 0.98 0.89 1.00 0.86 1.00 0.99 1.00 1.00 0.88 0.87 0.96 0.98 0.81 0.45 1.00 1.00 1.00 1.00 1.00 0.99 0.96 0.27 0.67 0.12
202 1.00 1.00 0.02 0.02 1.00 0.78 1.00 0.01 1.00 0.38 0.94 0.82 1.00 0.24 0.64 0.38 1.00 0.03 1.00 0.84 0.64 0.64 1.00 0.84 n/a n/a NaN 0.00
202-2 1.00 1.00 0.76 0.79 1.00 0.97 1.00 0.79 0.95 0.87 0.99 0.97 0.99 0.84 0.99 0.90 0.95 0.79 0.99 0.95 0.94 0.94 1.00 0.97 1.00 0.48 0.87 0.28
202-4 1.00 1.00 0.57 0.60 1.00 0.92 1.00 0.60 0.96 0.76 0.96 0.93 1.00 0.69 0.94 0.78 0.90 0.63 1.00 0.92 0.70 0.70 1.00 0.93 1.00 0.35 0.78 0.22
202-6 1.00 1.00 0.40 0.41 1.00 0.88 1.00 0.41 0.96 0.66 0.92 0.88 1.00 0.56 0.94 0.62 0.83 0.49 1.00 0.88 0.86 0.86 1.00 0.88 1.00 0.20 0.67 0.16
202-8 1.00 1.00 0.22 0.23 1.00 0.84 1.00 0.22 0.96 0.55 0.93 0.86 1.00 0.40 0.79 0.49 0.75 0.25 0.95 0.84 0.69 0.69 1.00 0.87 1.00 0.09 0.80 0.08
203 1.00 1.00 0.96 1.00 1.00 1.00 1.00 1.00 0.96 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.96 0.98 0.98 1.00 1.00 1.00 1.00 1.00 0.84 1.00 0.34
204 1.00 1.00 0.90 0.94 0.99 0.97 0.98 0.98 1.00 1.00 1.00 1.00 0.99 0.72 1.00 1.00 0.98 0.97 1.00 1.00 1.00 1.00 1.00 1.00 0.98 0.93 0.91 0.31
205 1.00 1.00 0.34 0.35 0.91 0.75 1.00 0.97 1.00 0.99 1.00 0.99 0.91 0.81 1.00 0.97 0.83 0.59 1.00 0.99 1.00 0.99 1.00 0.99 1.00 0.29 0.53 0.09
206 1.00 1.00 0.51 0.54 1.00 0.91 0.98 0.88 1.00 0.98 1.00 0.99 0.88 0.69 0.94 0.97 0.83 0.71 1.00 0.99 1.00 0.99 1.00 0.99 n/a n/a 0.40 0.06
207 1.00 1.00 0.51 0.54 1.00 0.91 0.98 0.88 1.00 0.98 1.00 0.99 0.88 0.69 0.94 0.97 0.83 0.71 1.00 0.99 1.00 0.99 1.00 0.99 n/a n/a 0.40 0.06
208 1.00 1.00 0.90 0.94 0.99 0.97 1.00 0.85 0.97 0.90 1.00 1.00 0.97 0.71 1.00 1.00 0.98 0.93 0.99 0.98 0.97 0.97 1.00 0.96 1.00 0.77 0.91 0.31
209 1.00 1.00 0.35 0.36 0.92 0.71 1.00 0.21 0.95 0.59 0.92 0.88 1.00 0.36 0.81 0.61 0.71 0.36 0.99 0.87 0.68 0.67 0.95 0.82 1.00 0.09 0.36 0.05
210 1.00 1.00 0.51 0.54 1.00 0.88 1.00 0.20 1.00 0.62 0.99 0.96 1.00 0.36 0.66 0.81 0.83 0.61 1.00 0.88 0.70 0.69 0.93 0.82 n/a n/a 0.40 0.06
221 1.00 1.00 0.96 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.96 0.89 1.00 1.00 1.00 1.00 1.00 1.00 0.98 0.97 1.00 0.34
222 1.00 1.00 0.92 1.00 1.00 1.00 0.98 0.98 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.99 0.99 1.00 1.00 1.00 1.00 1.00 1.00 0.97 0.96 0.88 0.31
223 1.00 1.00 0.96 1.00 1.00 1.00 0.97 0.96 0.95 0.95 1.00 1.00 1.00 1.00 0.99 0.99 0.97 0.96 0.99 0.97 0.97 0.97 1.00 1.00 0.96 0.95 0.97 0.33
224 1.00 1.00 0.96 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.99 0.99 1.00 1.00 1.00 1.00 1.00 1.00 0.98 0.97 1.00 0.34
225 1.00 1.00 0.96 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.99 0.99 1.00 1.00 1.00 1.00 1.00 1.00 0.96 0.95 1.00 0.34
228 1.00 1.00 0.38 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.94 0.94 1.00 1.00
230 1.00 1.00 0.71 1.00 0.94 1.00 0.91 0.97 0.91 0.97 0.99 1.00 1.00 1.00 1.00 1.00 0.96 0.99 0.94 1.00 0.91 0.93 0.92 0.99 0.93 0.94 1.00 0.35
231 1.00 1.00 0.96 1.00 1.00 1.00 0.98 0.98 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.99 0.99 1.00 1.00 1.00 1.00 1.00 1.00 0.98 0.97 1.00 0.34
232 1.00 1.00 0.96 1.00 1.00 1.00 0.98 0.98 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.96 0.89 1.00 1.00 1.00 1.00 1.00 1.00 0.98 0.97 1.00 0.34
233 1.00 1.00 0.38 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
236 1.00 1.00 0.38 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.94 0.94 1.00 1.00
237 1.00 1.00 0.92 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.99 0.99 1.00 1.00 0.99 1.00 1.00 1.00 0.99 0.98 0.88 0.31
238 1.00 1.00 0.96 1.00 1.00 1.00 0.99 0.98 0.95 0.95 1.00 1.00 1.00 1.00 1.00 1.00 0.97 0.96 0.98 0.98 0.96 0.96 0.99 0.99 0.95 0.94 0.97 0.33
239 1.00 1.00 0.29 1.00 0.97 1.00 0.97 1.00 0.97 1.00 0.97 1.00 0.97 1.00 0.93 0.97 0.85 0.97 0.97 1.00 0.97 1.00 0.97 1.00 0.90 0.90 0.88 1.00
240 1.00 1.00 0.33 1.00 0.94 0.97 0.94 0.94 0.82 0.85 0.97 1.00 0.97 1.00 0.94 0.97 0.94 0.91 0.97 1.00 0.82 0.85 0.97 1.00 1.00 1.00 0.97 0.97
241 1.00 1.00 0.38 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 0.94 0.94 1.00 1.00
246 1.00 1.00 0.29 1.00 0.97 1.00 0.97 1.00 0.97 1.00 0.97 1.00 0.97 1.00 0.97 1.00 0.85 0.97 0.97 1.00 0.97 1.00 0.97 1.00 0.97 0.97 0.88 1.00
247 1.00 1.00 0.33 1.00 0.94 0.97 0.94 0.94 0.82 0.85 0.91 0.94 0.97 1.00 0.97 1.00 0.94 0.91 0.94 0.97 0.85 0.88 0.97 1.00 0.97 0.97 1.00 1.00
248 1.00 1.00 0.03 0.03 1.00 0.40 1.00 0.01 0.97 0.34 0.91 0.74 1.00 0.24 0.64 0.38 1.00 0.02 1.00 0.81 0.61 0.61 0.82 0.75 n/a n/a NaN 0.00
248-2 1.00 1.00 0.76 0.79 1.00 0.94 1.00 0.79 0.97 0.87 0.99 0.96 0.99 0.84 0.99 0.88 0.95 0.78 1.00 0.95 0.61 0.61 0.96 0.85 1.00 0.44 0.90 0.27
248-4 1.00 1.00 0.57 0.60 1.00 0.88 1.00 0.60 0.93 0.71 0.96 0.91 1.00 0.69 0.93 0.77 0.88 0.62 1.00 0.92 0.58 0.58 1.00 0.91 1.00 0.33 0.83 0.21
248-6 1.00 1.00 0.40 0.41 1.00 0.77 1.00 0.41 0.92 0.60 0.92 0.86 1.00 0.56 0.93 0.56 0.82 0.46 1.00 0.88 n/a n/a 0.87 0.86 1.00 0.20 0.64 0.14
248-8 1.00 1.00 0.23 0.24 1.00 0.62 1.00 0.22 0.88 0.44 0.93 0.84 1.00 0.40 0.78 0.47 0.74 0.24 1.00 0.87 n/a n/a 0.86 0.82 1.00 0.08 0.88 0.07
249 1.00 1.00 0.05 0.05 1.00 0.59 1.00 0.01 1.00 0.01 0.82 0.62 1.00 0.01 0.25 0.01 1.00 0.03 0.76 0.73 n/a n/a 0.87 0.61 n/a n/a NaN 0.00
249-2 1.00 1.00 0.76 0.79 1.00 0.97 1.00 0.79 0.94 0.78 0.99 0.95 0.99 0.79 0.96 0.89 0.95 0.79 1.00 0.97 n/a n/a 1.00 0.96 1.00 0.48 0.90 0.29
249-4 1.00 1.00 0.57 0.60 1.00 0.92 1.00 0.60 0.92 0.63 0.93 0.89 1.00 0.60 0.83 0.76 0.90 0.63 0.98 0.91 0.23 0.23 0.98 0.88 1.00 0.35 0.78 0.22
249-6 1.00 1.00 0.40 0.41 1.00 0.88 1.00 0.41 0.82 0.42 0.91 0.82 0.98 0.41 0.73 0.65 0.83 0.49 0.98 0.87 n/a n/a 0.93 0.78 1.00 0.20 0.67 0.16
249-8 1.00 1.00 0.23 0.24 1.00 0.84 1.00 0.22 0.89 0.25 0.84 0.72 0.95 0.22 0.68 0.40 0.75 0.25 0.95 0.82 0.10 0.10 0.81 0.65 1.00 0.09 0.80 0.08
250 1.00 1.00 0.05 0.12 1.00 1.00 NaN 0.00 1.00 0.36 1.00 0.45 1.00 0.27 1.00 0.27 1.00 0.06 1.00 0.55 0.39 0.39 0.70 0.70 n/a n/a NaN 0.00
250-2 1.00 1.00 0.30 0.79 1.00 1.00 1.00 0.79 0.96 0.82 1.00 1.00 0.96 0.82 0.97 0.91 0.96 0.79 1.00 1.00 1.00 1.00 0.91 0.91 1.00 0.79 0.90 0.85
250-4 1.00 1.00 0.23 0.61 1.00 1.00 1.00 0.61 1.00 0.79 1.00 1.00 1.00 0.70 1.00 0.88 0.95 0.61 1.00 1.00 0.79 0.79 1.00 1.00 1.00 0.61 0.81 0.67
250-6 1.00 1.00 0.16 0.42 1.00 1.00 1.00 0.42 1.00 0.70 1.00 0.94 1.00 0.61 0.93 0.79 0.83 0.45 1.00 1.00 0.55 0.55 1.00 1.00 1.00 0.42 0.67 0.48
250-8 1.00 1.00 0.09 0.24 1.00 0.97 1.00 0.21 1.00 0.58 1.00 0.67 1.00 0.42 1.00 0.52 0.75 0.27 0.90 0.79 0.48 0.48 0.94 0.94 1.00 0.21 0.80 0.24
251 1.00 1.00 0.03 0.03 1.00 0.31 1.00 0.01 1.00 0.38 0.94 0.80 1.00 0.25 0.64 0.40 1.00 0.01 0.96 0.76 0.58 0.58 0.85 0.59 n/a n/a NaN 0.00
251-2 1.00 1.00 0.73 0.80 1.00 0.90 1.00 0.80 0.93 0.84 0.99 0.96 0.99 0.84 0.96 0.88 0.99 0.74 0.99 0.96 0.87 0.87 0.96 0.85 1.00 0.45 0.80 0.26
251-4 1.00 1.00 0.55 0.60 0.97 0.83 1.00 0.60 0.95 0.74 0.98 0.92 1.00 0.70 0.96 0.70 0.98 0.57 0.99 0.90 0.72 0.72 1.00 0.89 1.00 0.32 0.90 0.20
251-6 1.00 1.00 0.38 0.41 0.97 0.71 1.00 0.41 0.94 0.63 0.94 0.87 1.00 0.56 0.93 0.57 0.95 0.40 0.96 0.84 0.58 0.58 0.99 0.83 1.00 0.17 0.81 0.14
251-8 1.00 1.00 0.23 0.25 1.00 0.59 1.00 0.23 0.92 0.51 0.95 0.84 1.00 0.42 0.77 0.49 0.91 0.23 0.99 0.83 0.57 0.57 0.99 0.81 1.00 0.09 0.89 0.09
252 1.00 1.00 0.02 0.02 0.96 0.27 1.00 0.01 0.95 0.36 0.94 0.76 1.00 0.24 0.58 0.36 1.00 0.03 0.95 0.77 0.45 0.45 0.90 0.68 n/a n/a NaN 0.00
252-2 1.00 1.00 0.76 0.79 0.98 0.92 1.00 0.79 0.90 0.84 0.97 0.95 0.99 0.84 0.98 0.89 0.92 0.78 0.98 0.94 0.77 0.77 0.93 0.84 1.00 0.44 0.87 0.28
252-4 1.00 1.00 0.76 0.79 0.98 0.92 1.00 0.79 0.90 0.84 0.97 0.95 0.99 0.84 0.98 0.89 0.92 0.78 0.98 0.94 0.76 0.76 0.93 0.84 1.00 0.44 0.87 0.28
252-6 1.00 1.00 0.76 0.79 0.98 0.92 1.00 0.79 0.90 0.84 0.97 0.95 0.99 0.84 0.98 0.89 0.92 0.78 0.98 0.94 0.77 0.77 0.93 0.84 1.00 0.44 0.90 0.29
252-8 1.00 1.00 0.76 0.79 0.98 0.92 1.00 0.79 0.90 0.84 0.97 0.95 0.99 0.84 0.98 0.89 0.92 0.78 0.97 0.93 0.84 0.84 0.93 0.84 1.00 0.44 0.87 0.28
253 1.00 1.00 0.03 0.03 1.00 0.01 1.00 0.01 1.00 0.01 0.80 0.53 1.00 0.01 0.25 0.01 1.00 0.02 0.85 0.62 0.06 0.06 0.63 0.41 n/a n/a NaN 0.00
253-2 1.00 1.00 0.76 0.79 1.00 0.94 1.00 0.79 0.96 0.79 0.99 0.93 0.99 0.79 0.97 0.87 0.95 0.78 1.00 0.93 0.18 0.18 1.00 0.77 1.00 0.44 0.90 0.27
253-4 1.00 1.00 0.57 0.60 1.00 0.85 1.00 0.60 0.92 0.59 0.92 0.87 1.00 0.60 0.86 0.75 0.88 0.62 1.00 0.91 0.06 0.06 0.98 0.85 1.00 0.33 0.83 0.21
253-6 1.00 1.00 0.40 0.41 1.00 0.74 1.00 0.41 0.78 0.37 0.88 0.78 0.98 0.41 0.76 0.62 0.82 0.46 0.94 0.82 0.03 0.03 0.83 0.78 1.00 0.20 0.64 0.14
253-8 1.00 1.00 0.22 0.23 1.00 0.55 1.00 0.22 0.74 0.18 0.85 0.70 0.95 0.22 0.74 0.38 0.74 0.24 0.98 0.82 0.09 0.09 0.70 0.64 1.00 0.08 0.88 0.07
254 1.00 1.00 0.00 0.00 1.00 0.27 NaN 0.00 0.89 0.24 1.00 0.27 1.00 0.27 1.00 0.27 NaN 0.00 1.00 0.27 0.18 0.18 1.00 0.27 n/a n/a NaN 0.00
254-2 1.00 1.00 0.30 0.79 1.00 0.82 1.00 0.79 1.00 0.82 1.00 0.82 0.96 0.82 0.96 0.82 0.96 0.73 1.00 0.82 0.70 0.70 1.00 0.82 1.00 0.79 0.90 0.79
254-4 1.00 1.00 0.23 0.61 1.00 0.70 1.00 0.61 0.91 0.61 1.00 0.70 1.00 0.70 1.00 0.67 0.95 0.58 1.00 0.70 0.48 0.48 1.00 0.70 1.00 0.61 0.83 0.61
254-6 1.00 1.00 0.16 0.42 1.00 0.61 1.00 0.42 0.89 0.48 1.00 0.61 1.00 0.61 1.00 0.48 0.82 0.42 1.00 0.61 0.30 0.30 1.00 0.61 1.00 0.42 0.64 0.42
254-8 1.00 1.00 0.08 0.21 1.00 0.42 1.00 0.21 0.69 0.27 1.00 0.42 1.00 0.42 1.00 0.36 0.70 0.21 1.00 0.42 0.12 0.12 1.00 0.42 1.00 0.21 0.88 0.21
257 1.00 1.00 0.01 0.03 1.00 0.85 NaN 0.00 NaN 0.00 0.50 0.06 NaN 0.00 NaN 0.00 1.00 0.06 1.00 0.12 0.24 0.24 0.58 0.58 n/a n/a NaN 0.00
257-2 1.00 1.00 0.30 0.79 1.00 0.97 1.00 0.79 0.93 0.76 1.00 0.97 0.96 0.79 0.97 0.88 0.96 0.79 1.00 0.97 0.88 0.88 0.85 0.85 1.00 0.79 0.90 0.85
257-4 1.00 1.00 0.23 0.61 1.00 1.00 1.00 0.61 0.96 0.70 1.00 0.88 1.00 0.61 0.96 0.79 0.95 0.61 1.00 0.94 0.94 0.94 0.88 0.88 1.00 0.61 0.81 0.67
257-6 1.00 1.00 0.16 0.42 1.00 1.00 1.00 0.42 0.89 0.48 0.88 0.70 0.93 0.42 0.81 0.64 0.83 0.45 0.87 0.82 0.61 0.61 0.73 0.73 1.00 0.42 0.67 0.48
257-8 1.00 1.00 0.08 0.21 0.91 0.91 1.00 0.21 0.91 0.30 0.83 0.45 0.88 0.21 1.00 0.36 0.75 0.27 0.85 0.67 0.52 0.52 0.55 0.55 1.00 0.21 0.80 0.24
258 1.00 1.00 0.04 0.04 1.00 0.09 1.00 0.01 1.00 0.01 0.82 0.63 1.00 0.01 0.25 0.01 1.00 0.01 0.76 0.56 0.10 0.10 0.50 0.15 n/a n/a NaN 0.00
258-2 1.00 1.00 0.73 0.80 1.00 0.90 1.00 0.80 0.92 0.76 0.99 0.94 0.99 0.80 0.90 0.87 0.99 0.74 0.99 0.96 0.28 0.28 0.99 0.76 1.00 0.45 0.80 0.26
258-4 1.00 1.00 0.55 0.60 0.97 0.78 1.00 0.60 0.92 0.61 0.93 0.88 1.00 0.60 0.87 0.74 0.98 0.57 0.96 0.88 0.17 0.17 0.97 0.81 1.00 0.32 0.90 0.20
258-6 1.00 1.00 0.38 0.41 0.97 0.67 1.00 0.41 0.80 0.40 0.92 0.82 0.97 0.41 0.84 0.57 0.95 0.40 0.95 0.83 0.07 0.08 0.80 0.74 1.00 0.17 0.81 0.14
258-8 1.00 1.00 0.23 0.25 1.00 0.53 1.00 0.23 0.80 0.22 0.83 0.69 0.95 0.23 0.83 0.38 0.91 0.23 0.94 0.80 0.12 0.12 0.79 0.58 1.00 0.09 0.89 0.09
259 1.00 1.00 0.02 0.02 0.86 0.06 1.00 0.01 0.86 0.06 0.81 0.62 0.88 0.07 0.28 0.05 1.00 0.03 0.91 0.73 0.04 0.04 0.53 0.16 n/a n/a NaN 0.00
259-2 1.00 1.00 0.76 0.79 0.98 0.92 1.00 0.79 0.90 0.78 0.97 0.93 0.98 0.80 0.91 0.90 0.92 0.78 0.97 0.94 0.23 0.23 0.86 0.70 1.00 0.44 0.87 0.28
259-4 1.00 1.00 0.76 0.79 0.98 0.92 1.00 0.79 0.90 0.78 0.97 0.93 0.98 0.80 0.91 0.90 0.92 0.78 0.97 0.94 0.22 0.22 0.86 0.70 1.00 0.44 0.87 0.28
259-6 1.00 1.00 0.76 0.79 0.98 0.92 1.00 0.79 0.90 0.78 0.97 0.93 0.98 0.80 0.91 0.90 0.92 0.78 0.96 0.93 0.23 0.23 0.86 0.70 1.00 0.44 0.87 0.28
259-8 1.00 1.00 0.76 0.79 0.98 0.92 1.00 0.79 0.90 0.78 0.97 0.93 0.98 0.80 0.91 0.90 0.92 0.78 0.97 0.94 0.21 0.21 0.86 0.70 1.00 0.44 0.87 0.28
260 1.00 1.00 0.00 0.00 0.92 0.41 0.00 0.00 0.91 0.34 0.92 0.41 0.90 0.31 1.00 0.31 0.67 0.07 0.94 0.55 0.13 0.14 0.58 0.52 n/a n/a NaN 0.00
260-2 1.00 1.00 0.23 0.79 0.96 0.90 0.96 0.79 0.84 0.72 0.96 0.93 0.92 0.83 0.93 0.86 0.88 0.79 0.93 0.93 0.77 0.79 1.00 0.83 1.00 0.79 0.80 0.83
260-4 1.00 1.00 0.18 0.62 0.96 0.79 0.95 0.62 0.91 0.72 0.96 0.86 0.95 0.72 0.96 0.83 0.86 0.62 0.90 0.93 0.60 0.62 0.97 0.97 1.00 0.62 0.86 0.66
260-6 1.00 1.00 0.12 0.41 0.95 0.69 0.92 0.41 0.90 0.62 0.96 0.79 0.95 0.62 0.95 0.66 0.72 0.45 0.93 0.86 0.37 0.38 0.79 0.79 1.00 0.41 0.81 0.45
260-8 1.00 1.00 0.07 0.24 0.94 0.59 0.88 0.24 0.81 0.45 0.95 0.62 0.93 0.48 0.87 0.45 0.69 0.31 0.95 0.69 0.33 0.34 0.72 0.72 1.00 0.24 0.89 0.28
261 1.00 1.00 0.00 0.00 0.92 0.33 0.00 0.00 0.71 0.30 0.87 0.39 0.80 0.24 0.89 0.24 0.67 0.06 0.61 0.33 0.12 0.12 0.65 0.61 n/a n/a NaN 0.00
261-2 1.00 1.00 0.26 0.79 0.97 0.88 0.96 0.79 0.81 0.76 0.85 0.88 0.93 0.82 0.88 0.88 0.90 0.79 0.88 0.91 0.47 0.48 0.83 0.73 1.00 0.79 0.87 0.82
261-4 1.00 1.00 0.26 0.79 0.97 0.88 0.96 0.79 0.81 0.76 0.85 0.88 0.90 0.79 0.88 0.88 0.90 0.79 0.88 0.91 0.59 0.61 0.83 0.73 1.00 0.79 0.87 0.82
261-6 1.00 1.00 0.26 0.79 0.97 0.88 0.96 0.79 0.81 0.76 0.85 0.88 0.90 0.79 0.88 0.85 0.90 0.79 0.88 0.91 0.53 0.55 0.83 0.73 1.00 0.79 0.90 0.85
261-8 1.00 1.00 0.26 0.79 0.97 0.88 0.96 0.79 0.81 0.76 0.85 0.88 0.93 0.82 0.88 0.88 0.90 0.79 0.88 0.91 0.50 0.52 0.83 0.73 1.00 0.79 0.90 0.85
262 1.00 1.00 0.01 0.03 NaN 0.00 NaN 0.00 NaN 0.00 NaN 0.00 NaN 0.00 NaN 0.00 NaN 0.00 NaN 0.00 0.06 0.06 NaN 0.00 n/a n/a NaN 0.00
262-2 1.00 1.00 0.30 0.79 1.00 0.79 1.00 0.79 1.00 0.79 1.00 0.79 0.96 0.79 0.96 0.79 0.96 0.73 1.00 0.76 0.76 0.76 1.00 0.76 1.00 0.79 0.90 0.79
262-4 1.00 1.00 0.23 0.61 1.00 0.61 1.00 0.61 0.95 0.58 1.00 0.61 1.00 0.61 1.00 0.61 0.95 0.58 1.00 0.61 0.58 0.58 1.00 0.61 1.00 0.61 0.83 0.61
262-6 1.00 1.00 0.16 0.42 1.00 0.42 1.00 0.42 0.79 0.33 1.00 0.42 0.93 0.42 1.00 0.42 0.82 0.42 1.00 0.42 0.45 0.45 1.00 0.42 1.00 0.42 0.64 0.42
262-8 1.00 1.00 0.08 0.21 1.00 0.21 1.00 0.21 0.43 0.09 1.00 0.21 0.88 0.21 1.00 0.21 0.70 0.21 1.00 0.21 0.27 0.27 1.00 0.21 1.00 0.21 0.88 0.21
265 1.00 1.00 0.01 0.03 0.80 0.14 0.00 0.00 0.00 0.00 0.40 0.07 0.00 0.00 NaN 0.00 0.67 0.07 0.80 0.14 0.10 0.10 0.33 0.10 n/a n/a NaN 0.00
266 1.00 1.00 0.01 0.03 0.50 0.06 0.00 0.00 0.00 0.00 0.40 0.06 0.00 0.00 0.00 0.00 0.67 0.06 0.50 0.09 0.06 0.06 0.18 0.06 n/a n/a NaN 0.00
301 1.00 1.00 0.46 0.78 0.86 0.75 0.90 0.75 0.85 0.68 0.89 0.81 0.84 0.27 0.88 0.59 0.69 0.49 0.87 0.81 0.47 0.44 0.85 0.80 0.93 0.24 0.85 0.29
302 1.00 1.00 0.31 0.65 0.97 0.60 1.00 0.60 0.81 0.60 0.71 0.56 0.97 0.58 0.37 0.52 0.59 0.27 0.84 0.65 NaN 0.00 0.79 0.63 0.60 0.13 0.75 0.25
303 1.00 1.00 0.40 0.83 0.81 0.81 0.83 0.79 0.74 0.83 0.67 0.88 0.91 0.81 0.71 0.52 0.53 0.48 0.63 0.75 NaN 0.00 0.68 0.81 0.95 0.79 0.60 0.31
304 1.00 1.00 0.71 0.95 0.96 0.97 0.96 0.95 0.93 0.93 0.91 0.95 0.97 0.95 0.87 0.70 0.94 0.66 0.96 0.96 0.59 0.53 0.89 0.96 0.95 0.91 0.88 0.37
H-mean 1.00 1.00 0.43 0.59 0.98 0.80 0.99 0.62 0.94 0.69 0.95 0.87 0.97 0.66 0.91 0.73 0.91 0.59 0.97 0.88 0.64 0.59 0.93 0.82 0.98 0.44 0.86 0.26

n/a: result alignment not provided or not readable
NaN: division per zero, likely due to empty alignment.

http://oaei.ontologymatching.org/2009/results/benchmarks.html
$Id: benchmarks.html,v 1.3 2009/10/07 16:25:04 euzenat Exp $