A Comparison on MANETs’ Service Replication Schemes: Interest versus Topology Prediction
A Cost Model for Distributed Coverage Processing Services
An Evaluation Methodology and Framework for Semantic Web Services Technology
An Interest-Based Load Balancing Mechanism for the Service Distribution Protocol in MANETs
Enabling Trust-Aware Semantic Web Service Selection – A Flexible and Personalized Approach
Enabling Trust-Aware Semantic Web Service Selection – A Flexible and Personalized Approach
Evaluating Semantic Web Service Technologies: Criteria, Approaches and Challenges
Heuristic Geo Query Decomposition and Orchestration in a SOA
Impact of Heterogeneous Mobility Models on the Service Distribution Protocol for MANETs
Information and Management Support for Mass Casualty Incident Scenarios
IntrospectiveViews: An Interface for Scrutinizing Semantic User Models
Measures for Benchmarking Semantic Web Service Matchmaking Correctness (SEALS Best Evaluation Paper Award)
New Service Selection Strategies for the Service Distribution Protocol for MANETs.
Scrutinizing User Interest Models with IntrospectiveViews
SDP Primary Implementation in Microsoft® VisualC++®, A Service Distribution Protocol for MANETs
SDP-Implementation in Opnet® v.1: MANETs’ Service Replication and Load Balancing: Release Notes-User Manual-Programmer Guide
SDP-Implementation in Opnet® v.2, SDP-Based Composite Service Execution in MANETs: Release Notes-User Manual-Programmer Guide
Semantic Enrichment of Social Media Resources for Adaptation
Service Replication in Wireless Mobile Ad Hoc Networks
Supporting Consumers in Providing Meaningful Multi-Criteria Judgments
Evaluating Semantic Web Service Technologies: Criteria, Approaches and Challenges
Title: | Evaluating Semantic Web Service Technologies: Criteria, Approaches and Challenges |
---|---|
Authors: | Ulrich Küster, Birgitta König-Ries, Matthias Klusch |
Source: | Progressive Concepts for Semantic Web Evolution: Applications and Developments (Advances in Semantic Web Information Systems series), IGI Global (The link below points to a draft version of the paper. The final version is available through IGI Global) |
Date: | 2010-03-01 |
Type: | Book Chapter |
Abstract: |
In recent years a huge amount of research effort and funding has been devoted to the area of semantic web services (SWS). This has resulted in the proposal of numerous competing approaches to facilitate the automation of discovery, composition and mediation for web services using semantic annotations. However, despite of a wealth of theoretical work, too little effort has been spent towards the comparative experimental evaluation of the competing approaches so far. Progress in scientific development and industrial adoption is thereby hindered. An established evaluation methodology and standard benchmarks that allow the comparative evaluation of different frameworks are thus needed for the further advancement of the field. To this end, a criteria model for SWS evaluation is presented and the existing approaches towards SWS evaluation are comprehensively analyzed. Their shortcomings are discussed in order to identify the fundamental issues of SWS evaluation. Based on this discussion, a research agenda towards agreed upon evaluation methodologies is proposed. |
File: | SWSEval.pdf |