|
Ontology Alignment Evaluation Initiative - OAEI-2010 Campaign 
IM@OAEI2010 is an initiative for the evaluation of instance matching techniques and tools. IM@OAEI2010 is a track of the Ontology Alignment Evaluation Initiative (OAEI - http://oaei.ontologymatching.org/2010), held every year in collaboration with the Ontology Matching Workshop at ISWC (http://www.ontologymatching.org).
HOW TO PARTICIPATE
IM@OAEI2010 is focused on RDF and OWL data in the context of the Semantic Web. Participants will be asked to execute their algorithms against various datasets and their results will be evaluated by comparing them with a pre-defined reference alignment provided by IM@OAEI2010. Participating systems are free to use any combination of matching techniques and background knowledge. Participants are requested to send their results in form of RDF Alignments (http://alignapi.gforge.inria.fr/format.html) to the address
This e-mail address is being protected from spambots. You need JavaScript enabled to view it
. Results will be evaluated according to standard precision and recall metrics.
IM@OAEI2010 is organized in two sub-tracks, namely:
- Data interlinking track (DI)
- OWL data track (IIMB & PR)
Data interlinking track (DI). As the number of datasets published on the Web of data grows quickly, there is a need for tools providing assistance in interlinking the data they contain with other datasets. Many tools have recently be proposed that are able to perform semi-automatic interlinking. In order to scale, and in prevision to the explosion of the quantity of datasets published, semi-automatic interlinking is hardly acceptable. We propose in this track of the Ontology Alignment Evaluation Initiative to evaluate systems able to *automatically* find interlinks between Web datasets. Participants to these tracks will be given a set of datasets to interlink. The interlinking will need to be performed with no a priori knowledge of the datasets content, neither on the data nor on the schema behind them. An important dimension of the problem being the scalability of the tools wrt datasets size, participants should expect having to deal with datasets comparable in size to DBPedia. Datasets to interlink will be actual datasets published as linked-data. Evaluation will be performed by comparing the tools results to existing links.
OWL data track (IIMB & PR). The OWL data track is focused on two main goals: i) to provide an evaluation dataset for various kinds of data trasformations, including value trasformations, structural tranformations, and logical transformations; ii) to cover a wide spectrum of possible techniques and tools. To this end, the IIMB benchmark is generated by starting from an initial OWL knowledge base that is transformed into a set of modified knowledge bases by applying several automatic transformations of data. Participants are requested to find the correct correspondences among individuals of the first knowledge base and individuals of the others. An important task here is that some of the transformations require reasoning for finding the expected alignments.
IMPORTANT DATES (according to http://oaei.ontologymatching.org/2010/)
June 7th datasets are out
June 21st end of commenting period
July 5th tests are frozen
August 30th participants send preliminary results (for interoperability-checking)
October 4th participants send final results
October 11th organisers publish results for comments
November 7th final results ready
ORGANIZERS
Alfio Ferrara, Universita` degli Studi di Milano, Italy
Andriy Nikolov, Knowledge Media Institute, The Open University, UK
Jan Noessner, University of Mannheim, Germany
Stefano Montanelli, Universita` degli Studi di Milano, Italy
Francois Sharffe, INRIA, France
Heiko Stoermer, Fondazione Bruno Kessler (FBK-irst) |
