Transformer-based Hierarchical Topic-to-Essay Generation

Research output: Contribution to journalConference articlepeer-review

2 Scopus citations

Abstract

With the development of 5G network and Internet of things (IOT), a large amount of information is required. In this work, we focus on Topic-to-Essay Generation (TEG), which aims to generate the text based on the topics. Existing methods utilize the RNN-based models, and it's not so useful to capture the long dependencies in the text. The information of topics is insufficient to generate a long text and the existing methods also suffer from the problem about the topic relevance of the text. To fill these gaps, we propose a Transformer-based Hierarchical Topic-to-Essay Generation Model (THTEG), and the experimental results on a real dataset show that our model performs better than the baselines in terms of automatic evaluation and human evaluation.

Original languageEnglish
Pages (from-to)414-421
Number of pages8
JournalProcedia Computer Science
Volume202
DOIs
StatePublished - 2022
Event12th International Conference on Identification, Information and Knowledge in the internet of Things, IIKI 2021 - Hangzhou, China
Duration: 18 Dec 202118 Dec 2021

Keywords

  • Essay generation
  • Text generation
  • Transformer

Fingerprint

Dive into the research topics of 'Transformer-based Hierarchical Topic-to-Essay Generation'. Together they form a unique fingerprint.

Cite this