Skip to main navigation Skip to search Skip to main content

基于大语言模型的知识库查询风格自适应转换

Translated title of the contribution: Adapative Query Style Transfer for Large Language Models as Knowledge Bases
  • Xi'an Jiaotong University

Research output: Contribution to journal › Article › peer-review

1 Scopus citations

Abstract

The increasing capabilities of large language models (LLMs) in knowledge storage have underscored their potential utility as knowledge bases. However, it’s important to note that any given prompt can merely offer a lower-bound estimate of the knowledge encompassed by the language model. Prior prompt learning methods in the context of language models as knowledge bases (LMs-as-KBs) have overlooked the influence of query style. We have unveiled a significant revelation—there are indeed learnable preference within LLMs pertaining to query style. Leveraging this distinctive model characteristic, we introduce the adaptive query style transfer (ARES) method to improve the performance of LMs-as-KBs by adapting LLM’s preference. ARES initiates by presenting a candidate set of queries, achieved through paraphrasing to incorporate various expression styles. Subsequently, an evaluator is trained to learn and discern LLM’s preferences for query styles, ultimately evaluating the candidate set and selecting the potentially optimal query. Experiments conducted across multiple datasets have convincingly demonstrated the efficacy of our approach in enhancing question answering accuracy on LMs-as-KBs scenarios. Furthermore, incremental comparison of the original model and three baseline methods shows an average improvement of 2.26%, 1.68%, 1.19%, and 1.17%, respectively, indicating ARES can be effectively utilized in conjunction with other approaches, leading to enhanced performance and optimization across different dimensions.

Translated title of the contributionAdapative Query Style Transfer for Large Language Models as Knowledge Bases
Original languageChinese (Traditional)
Pages (from-to)2951-2961
Number of pages11
JournalJisuanji Yanjiu yu Fazhan/Computer Research and Development
Volume62
Issue number12
DOIs
StatePublished - 2025

Fingerprint

Dive into the research topics of 'Adapative Query Style Transfer for Large Language Models as Knowledge Bases'. Together they form a unique fingerprint.

Cite this