Quality and usefulness evaluation


Definition of descriptors

In order to enhance the evaluation of the datasets, descriptors were identified for each dataset. The defined descriptors were chosen to reflect the categories of information needed when performing a PRA according to the EPPO Decision support scheme for PRA and thus allow the datasets to be linked to specific sections (or questions when relevant) of the scheme.

Evaluation of the datasets

Each dataset was assessed by a PRATIQUE partner or, in a few cases, by an external evaluator. The evaluation consisted of describing the content of each dataset by using descriptors and then assessing their quality and usefulness, in order to identify the most useful datasets for PRA. Excel spreadsheets were constructed to assess each dataset. Each assessor received a specific ‘package’ with links to web based data sources. Within the Excel spreadsheet, three columns were used to record the name of the source, the link to the webpage and the description as given by the person who notified PRATIQUE with respect to this source. The subsequent columns were used for the assessment of the descriptors, followed by a column in which assessors could insert their remarks and a final column expressing the classification of the set as a whole. Assessors were asked to evaluate the data sets per category descriptor as well as for the entire set by giving an appropriate quality mark, viz. A, B, C, D, or U (see definition of the scores in Table 1). The symbol X was used to reflect absence of any information with respect to a specific descriptor.


Table 1:  Scores used for the evaluation of the quality and usefulness of the datasets, for each descriptor.

Score

Definition

A

Datasets that are essential, have a high quality and are widely applicable within the PRA area (EU). These can be recommended for use with most European PRAs

B

Datasets of good quality but applicable to specific regions within the EU PRA area.

C

Datasets that have narrow or very limited usefulness or that largely overlap with the datasets of wider applicability in categories A or B.

D

Datasets that cannot be trusted and/or contain too many errors. They are not recommended for use when undertaking PRAs. Largely irrelevant datasets were also placed in this category.

U

Datasets which cannot currently be assessed due to a language barrier

The 27 descriptors used in the evaluation are presented in Table 2 and represent different questions of the EPPO scheme.

 

Table 2:  Descriptors used to describe datasets in the four different dataset categories (see the categories of datasets corresponding to each task in the text)

Descriptors

Task 1.1

Task 1.2

Task 1.3

Task 1.4

Data on entry and pathways

X

X

 

 

General information on pests

X

 

 

 

Taxonomy/Names of pests

X

 

 

 

Geographical distribution of pests

X

 

 

 

Host plants/habitats of pests

X

 

 

 

Economic and social impact

X

 

 

 

Environmental impact

X

 

 

 

Official phytosanitary measures and regulations

X

 

 

X

Pest control methods

X

 

 

X

Host Management, Husbandry & Production Methods

 

X

X

X

Crop Production Data

 

X

 

 

Export Data

 

X

 

 

Consumer Demand Data

 

X

 

 

Interception Data

 

X

 

 

Yield & Quality Loss Data

 

X

 

 

Control Costs and costs of phytosanitary measures

 

X

 

X

Pest spp./Vector spp

 

 

X

 

Host distribution – non-crop naturalised hosts

 

 

X

 

Host distribution – crops

 

 

X

 

Habitat distribution and land use

 

 

X

 

Climatic data

 

 

X

 

Soil data

 

 

X

 

Other abiotic factors

 

 

X

 

Competitors and natural enemies

 

 

X

 

Side effects of pest control and measures

 

 

 

X

Detection/early detection of pests/Monitoring

 

 

 

X

Cost/Benefits of phytosanitary and control measures

 

 

 

X

               

<< Go back