oai:www.ldc.upenn.edu:LDC2025T17
| |
OLAC Record oai:www.ldc.upenn.edu:LDC2025T17 |
| Metadata | ||
| Title: | LORELEI Sinhala Incident Language Pack | |
| Access Rights: | Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining | |
| Bibliographic Citation: | Tracey, Jennifer, et al. LORELEI Sinhala Incident Language Pack LDC2025T17. Web Download. Philadelphia: Linguistic Data Consortium, 2025 | |
| Contributor: | Tracey, Jennifer | |
| Graff, David | ||
| Strassel, Stephanie | ||
| Wright, Jonathan | ||
| Bies, Ann | ||
| Date (W3CDTF): | 2025 | |
| Date Issued (W3CDTF): | 2025-12-15 | |
| Description: | *Introduction* LORELEI Sinhala Incident Language Pack was developed by the Linguistic Data Consortium (LDC) and consists of approximately 8.1 million words of Sinhala monolingual text, 70,000 words of English monolingual text, 6.4 million words of parallel Sinhala-English text, and 50,000 words of data annotated for Entity Discovery and Linking and Situation Frames. It contains all of the text data, annotations, supplemental resources, and related software tools for the Sinhala language used in the DARPA LORELEI / LoReHLT 2018 Evaluation. The LORELEI (Low Resource Languages for Emergent Incidents) Program was concerned with building human language technology for low resource languages in the context of emergent situations like natural disasters or disease outbreaks. Linguistic resources for LORELEI include Representative Language Packs for over two dozen low resource languages, comprising data, annotations, basic natural language processing tools, lexicons and grammatical resources. Representative languages were selected to provide broad typological coverage, while incident languages were selected to evaluate system performance on a language whose identity was disclosed at the start of the evaluation. The evaluation protocol was based on a scenario in which some unforeseen event triggered a need for humanitarian and logistical support in a region where the predominant language was one that had received little or no attention in natural language processing (NLP) research. Evaluation participants provided NLP solutions, including information extraction and machine translation, based on limited resources and with limited development time. *Data* Sinhala is spoken in Sri Lanka. Data was collected in the following genres: news, social network, weblog, newsgroup, discussion forum, and reference material. Entity discovery and linking annotation identified entities to be detected by systems for scoring purposes. Situation frame analysis was designed to extract basic information about needs and relevant issues for planning a disaster response effort. Also included in this release are lexical and grammatical resources as well as three tools: two to recreate original source data from the processed XML material and the other to condition text data users download from X/Twitter. Monolingual and parallel text are presented in XML with associated dtds. Entity discovery and linking annotation and situation frame annotation are presented as tab delimited files. All text is UTF-8 encoded. The knowledge base for entity linking annotation for this corpus and all LORELEI Representative Language and Incident Language Packs is available separately as LORELEI Entity Detection and Linking Knowledge Base (LDC2020T10). *Acknowledgement* This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-15-C-0123. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of DARPA. *Samples* Please view these samples: * English LTF XML * English PSM XML * Sinhala LTF XML * Sinhala PSM XML * Mentions Annotation TSV * Needs Annotation TSV *Updates* No updates at this time. | |
| Extent: | Corpus size: 1899731 KB | |
| Identifier: | LDC2025T17 | |
| https://catalog.ldc.upenn.edu/LDC2025T17 | ||
| ISLRN: 328-085-874-768-1 | ||
| DOI: 10.35111/45ac-6e47 | ||
| Language: | Sinhala | |
| English | ||
| Language (ISO639): | sin | |
| eng | ||
| License: | LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf | |
| Medium: | Distribution: Web Download | |
| Publisher: | Linguistic Data Consortium | |
| Publisher (URI): | https://www.ldc.upenn.edu | |
| Relation (URI): | https://catalog.ldc.upenn.edu/docs/LDC2025T17 | |
| Rights Holder: | Portions © 2017-2018 Al Jazeera Media Network, © 2016 Associated Newspapers Ltd, © 2017 Associated Newspapers of Ceylon, © 2017-2018 BBC, © 2016-2017 Cable News Network. Turner Broadcasting System, Inc., © 2017 CBS Interactive Inc., © 2017 Colombo Gazette, © 2016 EUMETSAT, © 2016 Fairfax Media, © 2017-2018 Firstpost, © 2017 Global News, a division of Corus Entertainment Inc. Corus News, © 2016- 2018 Gossip Lanka News, © 2018 Gray Television, Inc., © 2016 Guardian News and Media Limited or its affiliated companies, © 2018 HT Media Limited, © 2018 IDN-InDepthNews, © 2016, 2018 Independent.co.uk, © 2017 International Media Investments FZ LLC, © 2018 ITN News, © 2016 Lanka Business Online (Pvt) Ltd., © 2018 Lanka Lead News, © 2016-2018 Lanka News Column, © 2018 LankaPage.com (LLC), © 2018 Lanka Soka Gakkai, © 2018 Lanka Views, © 2017 Living Media India Limited, © 2011-2018 Lotus Technologies (Pvt) Ltd., © 2018 Mediacorp 2018. Mediacorp Pte Ltd., © 2016 Ministry of National Policies and Economic Affairs, © 2017-2018 MTV Channel (Pvt) Ltd, © 2016-2018 Nasdaq, Inc., © 2017 Newsweek LLC, © 2017 Northeastern University, © 2017 Office of the Cabinet of Ministers, Sri Lanka, © 2018 Philadelphia Media Network (Digital), LLC, © 2018 Printline Media Pvt. Ltd., © 2017 Ravaya Newspaper, © 2016-2018 Reuters, © 2016, 2018 Rivira Management Consultant (pvt) Ltd, © 2016 Roar Media, © 2016 SBS, © 2016 Sri Lanka Air Force Information Technology Unit, © 2018 Sri Lanka Broadcasting Corporation, © 2017 Sri Lanka Mirror, © 2014 Telegraph Media Group Limited, © 2016 The Associated Newspapers of Ceylon Ltd., © 2017-2018 The Diplomat, © 2017 The Hindu, © 2017 The Peninsula, © 2017 The Quint, © 2016 Time Inc., © 2018 TRT World, © 2018 ucanews.com, © 2018 USA TODAY, a division of Gannett Satellite Information Network, LLC, © 2018 Watch Tower Bible and Tract Society of Pennsylvania, © 2016-2018 Wijeya Newspapers Ltd, © 2018, 2025 Trustees of the University of Pennsylvania | |
| Subject: | Sinhala language | |
| Subject (ISO639): | sin | |
| Type (DCMI): | Software | |
| Text | ||
| Type (OLAC): | primary_text | |
OLAC Info |
||
| Archive: | The LDC Corpus Catalog | |
| Description: | http://www.language-archives.org/archive/www.ldc.upenn.edu | |
| GetRecord: | OAI-PMH request for OLAC format | |
| GetRecord: | Pre-generated XML file | |
OAI Info |
||
| OaiIdentifier: | oai:www.ldc.upenn.edu:LDC2025T17 | |
| DateStamp: | 2026-01-01 | |
| GetRecord: | OAI-PMH request for simple DC format | |
Search Info | ||
| Citation: | Tracey, Jennifer; Graff, David; Strassel, Stephanie; Wright, Jonathan; Bies, Ann. 2025. Linguistic Data Consortium. | |
| Terms: | area_Asia area_Europe country_GB country_LK dcmi_Software dcmi_Text iso639_eng iso639_sin olac_primary_text | |
Inferred Metadata | ||
| Country: | Sri Lanka | |
| Area: | Asia | |