Enhancing Cross-Lingual Few-Shot Named Entity Recognition by Prompt-Guiding

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

The cross-lingual named entity recognition task has attracted significant attention from researchers. Previous work has demonstrated that incorporating unlabeled data with potential entities in the target language can enhance cross-lingual model performance. However, unlabeled data for the target language is not always available, and the entity types may not share the same label space as the source language. To address this issue, we introduce a new NER task called cross-lingual few-shot NER. Distance metric learning has emerged as a popular solution for low-resource scenarios without semantic information for the target language. Inspired by few-shot metric learning and prompt learning, we propose a novel method called Cross-lingual Prompt-guiding Named Entity Recognition (CroPoNER) for this task. We use prompts from different languages to serve as 1) supervisory guidance for conveying unseen entity type information to the language model; 2) metric referents for predicting target language entity types; 3) a bridge between different languages that mitigates the language gap. Our experiments on several widely-used cross-lingual NER datasets (CoNLL, WikiAnn) in the few-shot setting demonstrate that our method outperforms state-of-the-art models by a significant margin in most cases for cross-lingual few-shot NER.

Original languageEnglish
Title of host publicationArtificial Neural Networks and Machine Learning – ICANN 2023 - 32nd International Conference on Artificial Neural Networks, Proceedings
EditorsLazaros Iliadis, Antonios Papaleonidas, Plamen Angelov, Chrisina Jayne
PublisherSpringer Science and Business Media Deutschland GmbH
Pages159-170
Number of pages12
ISBN (Print)9783031442063
DOIs
StatePublished - 2023
Event32nd International Conference on Artificial Neural Networks, ICANN 2023 - Heraklion, Greece
Duration: 26 Sep 202329 Sep 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14254 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference32nd International Conference on Artificial Neural Networks, ICANN 2023
Country/TerritoryGreece
CityHeraklion
Period26/09/2329/09/23

Keywords

  • Cross-lingual
  • Few-shot Learning
  • Metric Referent
  • Named Entity Recognition

Fingerprint

Dive into the research topics of 'Enhancing Cross-Lingual Few-Shot Named Entity Recognition by Prompt-Guiding'. Together they form a unique fingerprint.

Cite this