1. CWA Part 4 - Evaluation and Recommendations

Contents

CWA Part 4 - Evaluation and Recommendations

1.1. Purpose and scope

This part will focus on evaluating the outcome of the CWA and to perform some tests to it by performing the test data registrations. Obviously this can only happen as soon as a the first implementations are available. The deliverable is therefore split into two phases: In the first phase, which is available for CWA version 2 the document will contain a general description about the test data that will be used for evaluation. In CWA version 3, the document will contain a detailed description and the outcome of the test. Based on those results, parts 4.3 and 4.4 will be created. Following this approach, the current version of this deliverable contains a description of the test data only as well a description of the methodology in 4.1.

1.2. Test Registrations

1.2.1. Introduction and Methodology

In order to ensure the usability of the CWA concepts in real world scenarios, a test registration will be created and used as a way to evaluate the results. This will help the project team to find bottlenecks and to give practical tipps and experiences for users that want to apply the results for sharing resources. The evaluation will be performed by creating two tests. The first one is testing the outcome of part 1, which is an approach to resource sharing and the corresponding Protocol for the Syndication of Service Descriptions. The second test is focusing on testing the Federated Terminological Resource Network (TRN) as described in part 2 of the CWA.

1.2.2. Test Registration 1

1.2.2.1. Test Data Description

Test first test scenario will focus on the approach to resource sharing and the corresponding Protocol for the Syndication of Service Descriptions as described in part 1 of the CWA. It will perform this test by following the use case described below:

1.2.2.1.1. Precondition

It is assumed that an eGovernment resource has been created and that this resource should be shared among different partners or in the public. IT is also assumed that the responsible partners are aware of eGov-Share and that they have read and understood the CWA specification.

1.2.2.1.2. Testing steps

The eGovernment resource needs to be able to cope with the ontology defined in part 1a.
The eGovernment need to be published so that they can be accessed with the syndication protocol described in part 1b
A subscription needs to be tested with an external ATOM compatible program

1.2.2.1.3. Evaluation criteria

The following criteria will be checked:

Correctness of response (semantically)
Correctness of data format (syntactically)
Speed of response
Possibility of configuration

1.2.2.2. Test Registration Outcome

This section is based on the outcome of the CWA implementation and it can therefore not be included before CWA version 3.

1.2.3. Test Registration 2

1.2.3.1. Test Data Description

Test second test scenario will focus on the evaluation of the Terminological Resource Network (TRN) as described in part 2 of the CWA. It will perform this test by following the use case described below:

1.2.3.1.1. Precondition

It is assumed that a specific term has been typed in by a user. What is needed in order to provide a broad result set is a list of synonyms for this term. The TRN is therefore used to provide this list of synonyms. It is using the underlying structure of networked terms as described in part 2 of the CWA.

1.2.3.1.2. Testing steps

The TRN is contacted and the synonym search is invoked with term “traffic”.
In order to pass the test correctly the TRN needs to answer with a list of synonyms that have been compiled by analyzing all terms and their relationship
A possible result set might be: traffic [EN]; verkehr [DE]; verkeer [NL].

1.2.3.1.3. Evaluation criteria