OLAC Record oai:catalogue.elra.info:ELRA-E0043

Metadata
Title:		CLEFeHealth 2014 Task 3 Evaluation Package
Access Rights:		Rights available for: evaluationUse
Date Available (W3CDTF):		2015-01-20
Date Issued (W3CDTF):		2015-01-20
Date Modified (W3CDTF):		2015-02-26
Description:		The CLEF Initiative (Conference and Labs of the Evaluation Forum) promotes the systematic evaluation of information access systems through experimentation on shared tasks, with an emphasis on multilingual and multimodal information. It is structured in two main parts: a series of Evaluation Labs for the systems devised and a peer-reviewed conference on a broad range of issues related to the project.The CLEFeHealth 2014 Task 3 Evaluation Package contains data used for the User-centred health information retrieval Shared task at the CLEFeHealth Lab conducted in 2014. Task 3 aimed at evaluating information retrieval to address questions patients may have when reading clinical reports.The package contains:•a collection of medical-related documents,•guidelines provided to the participants,•queries generated by medical professionals,•a set of manual relevance assessments,•the official results obtained by the participants,•working notes papers.The collection consists of a set of around 1 million medical-related documents, provided by the Khresmoi project. This collection contains documents covering a broad set of medical topics, and does not contain any patient information.The documents in the collection come from several online sources, including Health On the Net organization certified websites, as well as well-known medical sites and databases (e.g. Genetics Home Reference, ClinicalTrial.gov).Five sample development queries, 50 test queries and their translation in Czech, French and German, as well as result set are provided with the data set. The queries have been manually generated by medical professionals from disorders mentioned in discharge summaries used for task 2 of CLEF eHealth.The training set contains 20 topics:• 5 in English• 5 in Czech• 5 in French• 5 in GermanTopic Test SetThe official test topic and result set for Task 3 consists of 50 topics in 2013 and 200 in 2014 (50 in English, 50 in Czech, 50 in French and 50 in German) and corresponding result set generated from manual relevance assessment (by medical professionals) on a pool generated from participants runs.The test set contains 200 topics:• 50 in English• 50 in Czech• 50 in French• 50 in GermanA demo version of the package is available from http://clefpackages.elra.info/clefehealthtask3/
Identifier:		ELRA-E0043
		ISLRN: 725-020-897-275-7
Identifier (URI):		https://catalog.elra.info/en-us/repository/browse/ELRA-E0043/
Language:		English
Language (ISO639):		eng
Medium:		Not specified
Publisher:		ELRA (European Language Resources Association)
Type (DCMI):		Text
Type (OLAC):		primary_text
OLAC Info
Archive:		ELRA Catalogue of Language Resources
Description:		http://www.language-archives.org/archive/catalogue.elra.info
GetRecord:		OAI-PMH request for OLAC format
GetRecord:		Pre-generated XML file
OAI Info
OaiIdentifier:		oai:catalogue.elra.info:ELRA-E0043
DateStamp:		2015-01-20
GetRecord:		OAI-PMH request for simple DC format
Search Info
Citation:		n.a. 2015. ELRA (European Language Resources Association).
Terms:		area_Europe country_GB dcmi_Text iso639_eng olac_primary_text