Loading...
Word-level Text Generation from Language Models
Author(s)
Netisopakul, Ponrudee
Taoto, Usanisa
Date Issued
January 1, 2021
Type
Conference Paper
Abstract
This research constructs and evaluates text generation models created from three different language models, n-gram, a Continuous Bag of Words (CBOW) and gated recurrent unit (GRU), using two training corpora, Berkeley Restaurant (Berkeley) and Alice's Adventures in Wonderland (Alice), and evaluated using two evaluation metrics; perplexity measure and count of grammar errors. The mean perplexities of all three models are comparable for each corpus, the N-gram model produces slightly lower values of perplexity. As for the number of grammatical errors in the Alice corpus, all three models show a slightly higher number of errors than the original corpus. In the Berkeley corpus, the n-gram model had the lowest number of errors, even lower than the original corpus, but the CBOW model had the highest number of errors and the GRU model had the highest number of errors.
Citation
2021 IEEE 11th International Conference on System Engineering and Technology Icset 2021 Proceedings, 60-65, 2021
Subjects