Modifications of the benchmark library

8.1: 5/6/2011

This is the last released version, newer benchmarks are automatically generated.

Updated 3xx tests to 2011

8.0: OAEI-2011 preversion (1/6/2011)

No change since last year, beside corrected a few problems (from Maria Roşoiu):

Instance suppression would not suppress Workshops [238, 247]
Instance suppression did not work after renaming [249, 253, 257, 258, 259, 262, 265, 266]
Property suppression did not work on instances after renaming [250, 254, 260, 261]
Flattening has preserved non OWL-DL cardinality constraints [222, 239, ...]

7.0: OAEI-2010 preversion

No change since last year

In 2011, we found that tests were corrupted in 2010. So various instances and properties were not correctly suppressed from the files. This problem was specific to 2010.

6.3: updated version 06/07/2009

Correction from Christoph Quix:

Fixed all URIs [1xx,2xx].

6.2: updated version 15/06/2009

Correction from Christian Meilicke:

Updated ontology URIs to 2009 [301,304].

6.1: updated version 07/06/2009

Added the forgotten 3xx tests [301-304];

Correction from Christian Meilicke and Ernesto Jimenez Ruiz:

Supressed month=hasMonth and year=hasYear in [301].

6.0: OAEI-2009 preversion released 31/05/2009

No change since last year

5.0: OAEI-2008 preversion released 25/05/2008

Version 5.0 was the evaluation version of OAEI-2008.

Added new partially scrambled tests [*-2,4,6,8]
Added correctly scrambled tests for instances (previous year tests had the instances) [249,253,257,258,259,262,265]

Corrections from Christian Meilicke:

Changed the range of "numberOrVolume" in ontology 101 from "Reference" to "Reference OR Conference" this is also changed in all the generated ontologies [101+2xx]
Changed "Part = Publication" into "Part < Publication" [302]
Removed "Collection < booktitle", changed "collection = booktitle" into "collection < booktitle" [303]

4.0: OAEI-2007 preversion released 15/05/2007

Version 4.0 was the evaluation version of OAEI-2007.

Modified refalign (was not RDF/XML) [ALL]

3.5: updated version 23/08/2006

Version 3.5 was the evaluation version of OAEI-2006.

Corrections from Alfio Ferrara:

Foaf specifications unreadable by Protégé [222,223,237-240,246,247,251,252,258-261,265,266]

3.4: updated version 31/07/2006

Changed the generation procedure

Corrections from Sabine Massmann, Alfio Ferrara, Jérôme Euzenat:

Bad onto1/onto2 value in refalign [230]
Incorrect reference to property [223, 230, 238, 252, 259]
Incorrect xmlns and xml:base [301, 302, 304]
Incorrect refalign.rdf [301-304]

3.3: updated version 22/07/2006

Corrections from Wei Hu:

Some tests were not correctly generated due to namespace problems [222,237,239,246,251,258,260,265]

3.2: updated version 12/07/2006

Corrections from Sławomir Niedbała and Guillermo Nudelman Hess:

Many tests had incorrect refalign.rdf [ALL]
Domain of "institution" becomes "Report" for avoiding equivalence out of references [ALL]

3.1: updated version 08/07/2006

Corrections from Sławomir Niedbała and Guillermo Nudelman Hess:

Many tests had incorrect refalign.rdf [ALL]
230 was inconsistent [230]
Attributes month and year have been reformatted for complying XMLSchema datatypes [ALL]

3.0: OAEI-2006 preversion released 09/06/2006

UTF-8 is now the standard test encoding (iso-latin an alternative) [206/207/210]
tests URIs/locations are now to https://oaei.ontologymatching.org/tests [ALL]
corrected an obvious bug in 102/refalign.rdf [102]

2.7: updated version 02/08/2005

Version 2.7 was the evaluation version of OAEI-2005.

A correction by Raphaël Troncy:

Corrected a small syntactic error (datatype declaration in the value) [ALL]

2.6: updated version 08/07/2005

Really suppressed properties! [228...]
Reinstalled the declaration of FOAF entities [228...]
Fixed namespace problems [230]

2.5: updated version 04/07/2005

Used local version of wine and food ontologies [102]
Made the UTF-8 reference alignments refering to the UTF-8 ontologies [206/207/210]
Corrected a bug before the export of the UTF-8 ontologies [206/207/210]
Added namespace in real-world test [301/304]

2.4: updated version 01/07/2005

#lastName is declared with rdf:ID

2.3: updated version 01/07/2005

Addresses comments from Ningsheng Jian:

Replaced references to &xsd;String by &xsd;string [230]
Replaced firstName by &foaf;firstName [230]
Added lastName and language in the alignments
Added in index.html a comment stating that the original file can be used for 102 [102]
Cleaned-up the reference alignment for [230]
Added in index.html a comment stating that the original file can be used for 102 [102]

2.2: updated version 29/06/2005

Addresses comments by Marc Ehrig and Mikalai Yatskevich:

Translated the labels of all translation transformation;
The generation of an allValuesFrom with empty body has been avoided [104];
Avoided discarding the foaf property declarations [228/230/...]
Replaced institutionName by organizationName [230]
Suppressed dc:descriptions in Property declarations [230]
Updated the wine/food ontologies to the standard ones [102]

2.1: preversion released 10/06/2005

2.0: unreleased version

1.7: OAEI-2004 final version released 10/10/2004

Version 1.7 was the evaluation version of OAEI-2004.

1.6: unreleased

1.5: unreleased

1.4: unreleased

1.3: unreleased

1.2: released 5/9/2004

List of modifications (thanks to Natasha Noy and David Loup) to the tests:

changed test n°102 with the actual food.owl file (bug);
suppressed mentions to BookPart objects in n°101,204,223,224,225 (bug);
corrected rdf:reference mention in n°103 (bug);
corrected xsd:langage mention in n°206 (bug);
corrected mentions to parseType="Compilation" and parseType="sqxsqkd" to parseType="Collection" (bug)
corrected mentions to &xsd;sqkxndc and &xsd;idiom to xsd;language (bug)
corrected mentions to plink.org to purl.org (bug)
corrected ill-written "Techreport" in refaligns (bug).
changed refalign mentions to local filesystem URI;
changed refalign and RDF namespaces in refalign to the correct ones;
updated many discarded entities in the refalign n°230, and others in 301-304;
turned location from a DatatypeProperty to an ObjectProperty (bug).
added an UTF-8 206 file;
introduced more generalisation in test n°103 using xsd:integer instead of xsd:nonNegativeIngeger in startPage and endPage (improvement);
better defined test n°230 (School and Institution being embedded into their refering classes).
added in https://co4.inrialpes.fr/align/dtd/refalign.rdfs kindly provided by Natasha.
added a letter at the begining of each fragment identifiers (for Jena compliance, this is a reasonable request);
not changed the diacritics in tests n°206 and 224 (for OWLAPI compliance, this must be solved by these Parsers. However, contestors may use the UTF-8 counterpart provided).
OWL API parser display problems with importing in test n°102.