跳到正文
原文
Nature 健康护理主题·· 18 小时前AI 评分30

StrokeID-NER:面向印尼患者的中风命名实体识别数据集

An annotated dataset and benchmark for stroke named entity recognition in Indonesian patient health queries

AI 导读

研究团队发布了StrokeID-NER数据集,包含1,742个非正式印尼患者查询,标注了6,765个实体,涵盖症状、诊断、时间与风险因素。使用多种系统进行基准测试,XLM-RoBERTa-large结合印尼NER训练和CRF解码器表现最佳,宏F1得分为0.792。该数据集有助于开发针对印尼患者的中风临床自然语言处理工具。

正文

Scientific Reports (2026) Cite this article

We’re sharing this article early to provide faster access to peer-reviewed, accepted research. It is citable and carries a permanent DOI. This version is subject to further edits and will be replaced automatically by the final Version of Record. All legal disclaimers apply.

Abstract

Stroke is the leading cause of death and disability in Indonesia, yet clinical NLP tools for stroke triage support remain limited by the lack of annotated resources for patient-generated health text. We introduce StrokeID-NER, a stroke-specific named entity recognition dataset of 1,742 informal Indonesian patient queries annotated with 6,765 spans across four clinically grounded entity types: Symptom, Diagnosis, Temporal and Risk Factor. Inter-annotator agreement on 103 doubly annotated queries reached an entity-level F1 of 0.78 for exact spans and 0.96 for overlapping spans. We benchmark ten systems over three random seeds with query-level bootstrap confidence intervals: monolingual and multilingual transformers with linear and CRF decoders, and GPT-5.4 with zero-shot and five-shot prompting. XLM-RoBERTa-large with additional Indonesian NER training and a CRF decoder achieves the best macro F1 (0.792 ± 0.003). CRF decoding improves every encoder, whereas multilingual pretraining alone does not outperform monolingual pretraining of the same size. Five-shot GPT-5.4 (0.724) matches a fine-tuned base-size model but remains 6.8 points below the best system, with the largest gap on informal symptom expressions. StrokeID-NER, the annotation guideline, code and predictions are released publicly at https://doi.org/10.5281/zenodo.23910283.

Acknowledgements

This work was supported by the Institute of Information & Communications Technology Planning & Evaluation (IITP) - Innovative Human Resource Development for Local Intellectualization program grant funded by the Korea government (MSIT) (IITP-2024-RS-2024-00436773).

Author information

Authors and Affiliations

  1. Department of Digital Anti-Aging Healthcare, Inje University, Gimhae-si, 50834, Republic of Korea

    S. Miseri Cordiaz, Muhammad Yaseen, Md Ariful Islam Mozumder & Hee-Cheol Kim

Authors

  1. S. Miseri Cordiaz
  2. Muhammad Yaseen
  3. Md Ariful Islam Mozumder
  4. Hee-Cheol Kim

Corresponding author

Correspondence to Hee-Cheol Kim.

Ethics declarations

Competing interests

The authors declare no competing interest.

Ethical approval

This study used the publicly available Indonesia-medical-qna dataset17 from alodokter.com. The data has no personal identifiable information. An ethical review was waived since the study only uses public, fully anonymized, third-party data. Patient queries were submitted voluntarily to a public platform. No additional consent was needed because there was no direct patient contact.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cordiaz, S.M., Yaseen, M., Mozumder, M.A.I. et al. An annotated dataset and benchmark for stroke named entity recognition in Indonesian patient health queries. Sci Rep (2026). https://doi.org/10.1038/s41598-026-81172-y

Download citation

  • Received: 26 June 2026

  • Accepted: 13 November 2026

  • Published: 20 November 2026

  • DOI: https://doi.org/10.1038/s41598-026-81172-y

来源:Nature 健康护理主题 · nature.com