oai:www.ldc.upenn.edu:LDC2026T06
| |
OLAC Record oai:www.ldc.upenn.edu:LDC2026T06 |
| Metadata | ||
| Title: | LORELEI Multiway Translated Text | |
| Access Rights: | Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining | |
| Bibliographic Citation: | Tracey, Jennifer, et al. LORELEI Multiway Translated Text LDC2026T06. Web Download. Philadelphia: Linguistic Data Consortium, 2026 | |
| Contributor: | Tracey, Jennifer | |
| Strassel, Stephanie | ||
| Graff, David | ||
| Wright, Jonathan | ||
| Chen, Song | ||
| Delgado, Dana | ||
| Arrigo, Michael | ||
| Date (W3CDTF): | 2026 | |
| Date Issued (W3CDTF): | 2026-06-15 | |
| Description: | *Introduction* LORELEI Multiway Translated Text consists of a fixed set of English texts (around 100,000 words) translated into 24 languages. It was developed by the Linguistic Data Consortium (LDC) for the DARPA LORELEI Program; the translations were included in the LORELEI representative language packs created by LDC in 2016-2019. The LORELEI (Low Resource Languages for Emergent Incidents) program was concerned with building human language technology for low resource languages in the context of emergent situations like natural disasters or disease outbreaks. Linguistic resources for LORELEI include Representative Language Packs and Incident Language Packs for over two dozen low resource languages, comprising data, annotations, basic natural language processing tools, lexicons and grammatical resources. Representative languages were selected to provide broad typological coverage, while incident languages were selected to evaluate system performance on a language whose identity was disclosed at the start of the evaluation. *Data* The common set of 100,000 English words translated into each representative language was composed of English news documents (50%), LORELEI-domain English news documents (25%), and a phrasebook and elicitation corpus (25%). The phrasebook contained everyday colloquial phrases. The elicitation corpus was designed to represent linguistic structures. Texts were translated by a combination of professional translators and crowd-sourced translators. Further details on the translation process are contained in the documentation accompanying this release. Phrase-level data (elicitation and phrasebook text) is presented as tab-delimited (.tab) files. Document-level data (news text and translations) is presented as XML files. All text data is UTF-encoded. *Samples* Please view these samples: * Vietnamese CS_Trans (XML) * Elicitation English - Vietnamese (.tab) * Vietnamese Elicitation (.tab) * Vietnamese Phrasebook (.tab) * Vietnamese PSM XML * Vietnamese LTF XML *Sponsorship* This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-15-C-0123. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of DARPA. *Updates* No updates at this time. | |
| Extent: | Corpus size: 24047 KB | |
| Identifier: | LDC2026T06 | |
| https://catalog.ldc.upenn.edu/LDC2026T06 | ||
| ISLRN: 011-662-998-290-3 | ||
| DOI: 10.35111/fm0k-2a20 | ||
| Language: | Arabic | |
| Amharic | ||
| Bengali | ||
| Mandarin Chinese | ||
| English | ||
| Persian | ||
| Hausa | ||
| Hindi | ||
| Hungarian | ||
| Indonesian | ||
| Russian | ||
| Somali | ||
| Spanish | ||
| Swahili (macrolanguage); Swahili | ||
| Tamil | ||
| Tagalog | ||
| Thai | ||
| Turkish | ||
| Uzbek | ||
| Vietnamese | ||
| Gambian Wolof | ||
| Yoruba | ||
| Zulu | ||
| Akan | ||
| Language (ISO639): | ara | |
| amh | ||
| ben | ||
| cmn | ||
| eng | ||
| fas | ||
| hau | ||
| hin | ||
| hun | ||
| ind | ||
| rus | ||
| som | ||
| spa | ||
| swa | ||
| tam | ||
| tgl | ||
| tha | ||
| tur | ||
| uzb | ||
| vie | ||
| wof | ||
| yor | ||
| zul | ||
| aka | ||
| License: | LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf | |
| Medium: | Distribution: Web Download | |
| Publisher: | Linguistic Data Consortium | |
| Publisher (URI): | https://www.ldc.upenn.edu | |
| Relation (URI): | https://catalog.ldc.upenn.edu/docs/LDC2026T06 | |
| Rights Holder: | © 2002-2007, 2009-2010 Agence France Presse, © 2000 American Broadcasting Company, © 2000 Cable News Network LP, LLLP, © 2008 Central News Agency (Taiwan), © 1989 Dow Jones & Company, Inc., © 2005 Los Angeles Times - Washington Post News Service, Inc., © 2000 National Broadcasting Company, Inc., © 1999, 2005, 2006, 2010 New York Times, © 2000 Public Radio International, © 2003, 2005-2008, 2010 The Associated Press, © 2003, 2005-2008 Xinhua News Agency, © 2016-2026 Trustees of the University of Pennsylvania | |
| Subject: | English language | |
| Vietnamese language | ||
| Akan language | ||
| Amharic language | ||
| Arabic language | ||
| Bengali language | ||
| Mandarin Chinese language | ||
| Persian language | ||
| Hausa language | ||
| Hindi language | ||
| Hungarian language | ||
| Indonesian language | ||
| Russian language | ||
| Somali language | ||
| Spanish language | ||
| Swahili (macrolanguage) | ||
| Tamil language | ||
| Tagalog language | ||
| Thai language | ||
| Turkish language | ||
| Ukrainian language | ||
| Uzbek language | ||
| Wolof language | ||
| Yoruba language | ||
| Zulu language | ||
| Subject (ISO639): | eng | |
| vie | ||
| aka | ||
| amh | ||
| ara | ||
| ben | ||
| cmn | ||
| fas | ||
| hau | ||
| hin | ||
| hun | ||
| ind | ||
| rus | ||
| som | ||
| spa | ||
| swa | ||
| tam | ||
| tgl | ||
| tha | ||
| tur | ||
| ukr | ||
| uzb | ||
| wol | ||
| yor | ||
| zul | ||
| Subject (OLAC): | text_and_corpus_linguistics | |
| translating_and_interpreting | ||
| Type (DCMI): | Software | |
| Text | ||
| Type (OLAC): | primary_text | |
OLAC Info |
||
| Archive: | The LDC Corpus Catalog | |
| Description: | http://www.language-archives.org/archive/www.ldc.upenn.edu | |
| GetRecord: | OAI-PMH request for OLAC format | |
| GetRecord: | Pre-generated XML file | |
OAI Info |
||
| OaiIdentifier: | oai:www.ldc.upenn.edu:LDC2026T06 | |
| DateStamp: | 2026-06-15 | |
| GetRecord: | OAI-PMH request for simple DC format | |
Search Info | ||
| Citation: | Tracey, Jennifer; Strassel, Stephanie; Graff, David; Wright, Jonathan; Chen, Song; Delgado, Dana; Arrigo, Michael. 2026. Linguistic Data Consortium. | |
| Terms: | area_Africa area_Asia area_Europe country_BD country_CN country_ES country_ET country_GB country_GH country_GM country_HU country_ID country_IN country_NG country_PH country_RU country_SN country_SO country_TH country_TR country_UA country_VN country_ZA dcmi_Software dcmi_Text iso639_aka iso639_amh iso639_ara iso639_ben iso639_cmn iso639_eng iso639_fas iso639_hau iso639_hin iso639_hun iso639_ind iso639_rus iso639_som iso639_spa iso639_swa iso639_tam iso639_tgl iso639_tha iso639_tur iso639_ukr iso639_uzb iso639_vie iso639_wof iso639_wol iso639_yor iso639_zul olac_primary_text olac_text_and_corpus_linguistics olac_translating_and_interpreting | |
Inferred Metadata | ||
| Country: | BangladeshChinaSpainEthiopiaUnited KingdomGhanaHungaryIndonesiaIndiaNigeriaPhilippinesRussian FederationSenegalSomaliaThailandTurkeyUkraineViet NamSouth Africa | |
| Area: | AfricaAsiaEurope | |