Kedokteran & Kesehatan editorial
A comparative study of pre-trained language models for named entity recognition in clinical trial eligibility criteria from multiple corpora
The core problem
Innovation
The study fine-tunes six pre-trained transformer models for token classification on three clinical trial eligibility criteria corpora. The corpora are not named in the abstract but are existing datasets. The models include:
- **Domain-specific**: BioBERT, BlueBERT, PubMedBERT, SciBERT
- **General**: BERT, SpanBERT
Fine-tuning is performed with standard NER setup, and evaluation uses tenfold cross-validation. Performance is measured by -score. Data augmentation is investigated by combining training data from multiple corpora to assess feasibility of leveraging additional sources. The exact augmentation techniques (e.g., oversampling, synonym replacement) are not detailed in the abstract, but the results indicate that using extra corpora improves NER performance.
Why it matters
Who should read this
Opening member contentโฆ