OLAC Record oai:www.ldc.upenn.edu:LDC2008S05

Metadata
Title:		2005 NIST Language Recognition Evaluation
Access Rights:		Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining
Bibliographic Citation:		Le, Audrey, et al. 2005 NIST Language Recognition Evaluation LDC2008S05. Web Download. Philadelphia: Linguistic Data Consortium, 2008
Contributor:		Le, Audrey
		Martin, Alvin
		Hadfield, Hannah
		de Villiers, Jacques
		Hosom, John-Paul
		van Santen, Jan
Date (W3CDTF):		2008
Date Issued (W3CDTF):		2008-06-16
Description:		*Introduction* 2005 NIST Language Recognition Evaluation was developed by the Linguistic Data Consortium (LDC) and the National Institute of Standards and Technology (NIST). It contains 73 hours of conversational telephone speech in the following languages: English (American), English (Indian), Hindi, Japanese, Korean, Mandarin (Mainland), Mandarin (Taiwan), Spanish (Mexican), and Tamil. The goal of NIST's Language Recognition Evaluation (LRE) is to establish the baseline of current performance capability for language recognition of conversational telephone speech and to lay the groundwork for further research efforts in the field. NIST conducted two previous evaluations in 1996 and 2003. For the 2005 LRE, the emphasis was on research directed toward a general base of technology to be ported to various language recognition tasks with minimum effort and the development of the ability to make more difficult discriminations between similar languages and dialects of the same language. That focus augmented the traditional evaluation goals, those being: * to drive the technology forward * to measure the state-of-the-art * to find the most promising algorithmic approaches The task evaluated was the detection of a given target language or dialect. From a test segment of speech and a target language or dialect, the system to be evaluated determined whether the speech was from the target language or dialect. The 2005 NIST Language Recognition Evaluation Plan, which includes a description of the evaluation tasks, is included with this release. LDC released other LREs as: * 2003 NIST Language Recognition Evaluation (LDC2006S31) * 2007 NIST Language Recognition Evaluation Test Set (LDC2009S04) * 2007 NIST Language Recognition Evaluation Supplemental Training Set (LDC2009S05) * 2009 NIST Language Recognition Evaluation Test Set (LDC2014S06) * 2011 NIST Language Recognition Evaluation Test Set (LDC2018S06) *Data* Each speech file is one side of a "4-wire" telephone conversation represented as 8-bit 8-kHz mulaw data. There are 11,106 speech files in SPHERE (.sph) format for a total of 73.2 hours of speech. The speech data was compiled from LDC's CALLFRIEND corpora and from data collected by Oregon Health and Science University (OHSU), Beaverton, Oregon. Each test segment was prepared using an automatic speech activity detection algorithm to identify areas and durations of speech. The test segments were stored in SPHERE file format, one segment per file. Unlike previous evaluations, areas of silence were not removed from the segments. Segments were chosen to contain a specified approximate duration of actual speech. Auxiliary information was included in the SPHERE headers to document the source file, start time, and duration of all excerpts that were used to construct the segment. The test segments contain three nominal durations of speech: 3 seconds, 10 seconds, and 30 seconds. Actual speech durations vary, but were constrained to be within the ranges of 2-4 seconds, 7-13 seconds, and 25-35 seconds, respectively. Note that this refers to duration of actual speech contained in segments as determined by the speech activity detection algorithm; signal durations in general are longer due to areas of silence in the segments. Shorter speech duration test segments are subsets of longer speech duration test segments; i.e., each 10-second test segment is a subset of a corresponding 30-second test segment, and each 3-second test segment is a subset of a corresponding 10-second segment. Performance was evaluated separately for test segments of each duration. NIST recommends using data from the 1996 and 2003 evaluations as development data. This data may be found in 2003 NIST Language Recognition Evaluation (LDC2006S31). Because the 1996 and 2003 evaluations did not cover Indian-accented English, this release includes a development data set of Indian-accented English. *Samples* For an example of the data in this corpus, please listen to the following samples: * 3 second (WAV) * 10 second (WAV) * 30 second (WAV) *Updates* None at this time.
Extent:		Corpus size: 2097152 KB
Format:		Sampling Rate: 8000
		Sampling Format: ulaw
Identifier:		LDC2008S05
		https://catalog.ldc.upenn.edu/LDC2008S05
		ISBN: 1-58563-477-8
		ISLRN: 747-471-848-124-3
		DOI: 10.35111/1y55-wx32
Language:		Tamil
		Korean
		Japanese
		Hindi
		English
		Spanish
		Mandarin Chinese
Language (ISO639):		tam
		kor
		jpn
		hin
		eng
		spa
		cmn
License:		LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf
Medium:		Distribution: Web Download
Publisher:		Linguistic Data Consortium
Publisher (URI):		https://www.ldc.upenn.edu
Relation (URI):		https://catalog.ldc.upenn.edu/docs/LDC2008S05
Rights Holder:		Portions © 2005 Oregon Health and Science University, © 1996, 2008 Trustees of the University of Pennsylvania
Type (DCMI):		Sound
Type (OLAC):		primary_text
OLAC Info
Archive:		The LDC Corpus Catalog
Description:		http://www.language-archives.org/archive/www.ldc.upenn.edu
GetRecord:		OAI-PMH request for OLAC format
GetRecord:		Pre-generated XML file
OAI Info
OaiIdentifier:		oai:www.ldc.upenn.edu:LDC2008S05
DateStamp:		2021-09-13
GetRecord:		OAI-PMH request for simple DC format
Search Info
Citation:		Le, Audrey; Martin, Alvin; Hadfield, Hannah; de Villiers, Jacques; Hosom, John-Paul; van Santen, Jan. 2008. Linguistic Data Consortium.
Terms:		area_Asia area_Europe country_CN country_ES country_GB country_IN country_JP country_KR dcmi_Sound iso639_cmn iso639_eng iso639_hin iso639_jpn iso639_kor iso639_spa iso639_tam olac_primary_text