Penalty-based Sequence Generative Adversarial Networks with Enhanced Transformer for Text Generation
In this paper, we propose a new model to solve the problem of text generation, which is based on the concept of seqGAN, combines self-attention with modeling localness, and introduces the penalty-based objective function. This model has much better performance than the original model. In the original model, the generator's ability of the text feature extraction is insufficient. We introduce self-attention with modeling localness, which greatly enhances its ability to capture long distance and shortrange dependencies. In addition, we use the penalty-based objective function instead of the loss function of the original model to solve the problem of mode collapse. Experimental results demonstrate that our model consistently outperforms several state-of-the-art text generation methods in the quality of generated texts.
Code (0)
등록된 구현이 없습니다.
Tasks
Text GenerationSimilar Papers 제목 키워드 기반
Tdcgan: Temporal Dilated Convolutional Generative Adversarial Network for End-to-end Speech Enhancement
In this paper, in order to further deal with the performance degradation caused by ignoring the phase information in conventional speech enhancement systems, we proposed a temporal dilated convolutional generative advers…
Generative Adversarial NetworkSpeech EnhancementPenalty Gradient Normalization for Generative Adversarial Networks
In this paper, we propose a novel normalization method called penalty gradient normalization (PGN) to tackle the training instability of Generative Adversarial Networks (GANs) caused by the sharp gradient space. Unlike e…
A Residual Guided strategy with Generative Adversarial Networks in training Physics-Informed Transformer Networks
Nonlinear partial differential equations (PDEs) are pivotal in modeling complex physical systems, yet traditional Physics-Informed Neural Networks (PINNs) often struggle with unresolved residuals in critical spatiotempor…
AI-Enhanced Resilience in Power Systems: Adversarial Deep Learning for Robust Short-Term Voltage Stability Assessment under Cyber-Attacks
In the era of Industry 4.0, ensuring the resilience of cyber-physical systems against sophisticated cyber threats is increasingly critical. This study proposes a pioneering AI-based control framework that enhances short-…
Generative Adversarial NetworkGraph AttentionEnhanced Balancing GAN: Minority-class Image Generation
Generative adversarial networks (GANs) are one of the most powerful generative models, but always require a large and balanced dataset to train. Traditional GANs are not applicable to generate minority-class images in a …
Image Generation