Annual International Contest S3 on

Semantic Service Selection

Retrieval Performance Evaluation of Matchmakers for Semantic Web Services

The fourth edition of this contest evaluates the retrieval performance of publicly available  matchmakers for Semantic Web services. It is planned to conduct this comparative retrieval performance  evaluation for services in the formats OWL-S, SA-WSDL over service retrieval test collections that are publicly available at this time such as currently OWLS-TC and SAWSDL-TC. A WSML-TC required for evaluating WSML matchmakers is not available yet.

This edition of the contest consists of following tracks:

  • Track 1:    OWL-S matchmaker evaluation
  • Track 2:    SAWSDL matchmaker evaluation

The final presentation of this year’s edition of the S3 contest is in collaboration with the SWS evaluation campaign of the SEALS project at the international semantic web conference in 2010.

This edition is supported by

    CELCT (Center for Evaluation of Language and Communication Technology), Italy

Summary report of S3 in 2010.