paper-with-me

Papers

Incorporating Domain Knowledge through Task Augmentation for Front-End JavaScript Code Generation

2022-08-22 · Sijie Shen, Xiang Zhu, Yihong Dong, Qizhi Guo, Yankun Zhen, Ge Li

Code generation aims to generate a code snippet automatically from natural language descriptions. Generally, the mainstream code generation methods rely on a large amount of paired training data, including both the natural language description and the code. However, in some domain-specific scenarios, building such a large paired corpus for code generation is difficult because there is no directly available pairing data, and a lot of effort is required to manually write the code descriptions to construct a high-quality training dataset. Due to the limited training data, the generation model cannot be well trained and is likely to be overfitting, making the model's performance unsatisfactory for real-world use. To this end, in this paper, we propose a task augmentation method that incorporates domain knowledge into code generation models through auxiliary tasks and a Subtoken-TranX model by extending the original TranX model to support subtoken-level code generation. To verify our proposed approach, we collect a real-world code generation dataset and conduct experiments on it. Our experimental results demonstrate that the subtoken-level TranX model outperforms the original TranX model and the Transformer model on our dataset, and the exact match accuracy of Subtoken-TranX improves significantly by 12.75% with the help of our task augmentation method. The model performance on several code categories has satisfied the requirements for application in industrial systems. Our proposed approach has been adopted by Alibaba's BizCook platform. To the best of our knowledge, this is the first domain code generation system adopted in industrial development environments.

📄 PDF Abstract BibTeX arXiv:2208.10091

Code (0)

등록된 구현이 없습니다.

Tasks

Code Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Dr.Quad at MEDIQA 2019: Towards Textual Inference and Question Entailment using contextualized representations

2019-07-23 · WS 2019 8 · Vinayshekhar Bannihatti Kumar, Ashwin Srinivasan, Aditi Chaudhary, James Route 외

This paper presents the submissions by Team Dr.Quad to the ACL-BioNLP 2019 shared task on Textual Inference and Question Entailment in the Medical Domain. Our system is based on the prior work Liu et al. (2019) which use…

Data AugmentationNatural Language Inference

Systematic Knowledge Injection into Large Language Models via Diverse Augmentation for Domain-Specific RAG

2025-02-12 · Kushagra Bhushan, Yatin Nandwani, Dinesh Khandelwal, Sonam Gupta 외

Retrieval-Augmented Generation (RAG) has emerged as a prominent method for incorporating domain knowledge into Large Language Models (LLMs). While RAG enhances response relevance by incorporating retrieved domain knowled…

RAGRetrievalRetrieval-augmented Generation

KTCR: Improving Implicit Hate Detection with Knowledge Transfer driven Concept Refinement

2024-10-20 · Samarth Garg, Vivek Hruday Kavuri, Gargi Shroff, Rahul Mishra

The constant shifts in social and political contexts, driven by emerging social movements and political events, lead to new forms of hate content and previously unrecognized hate patterns that machine learning models may…

Data AugmentationTransfer Learning

Incorporating External Knowledge through Pre-training for Natural Language to Code Generation

2020-04-20 · ACL 2020 6 · Frank F. Xu, Zhengbao Jiang, Pengcheng Yin, Bogdan Vasilescu 외

Open-domain code generation aims to generate code in a general-purpose programming language (such as Python) from natural language (NL) intents. Motivated by the intuition that developers usually retrieve resources on th…

Code GenerationData AugmentationRetrieval

Can I Be of Further Assistance? Using Unstructured Knowledge Access to Improve Task-oriented Conversational Modeling

2021-06-16 · ACL (dialdoc) 2021 8 · Di Jin, Seokhwan Kim, Dilek Hakkani-Tur

Most prior work on task-oriented dialogue systems are restricted to limited coverage of domain APIs. However, users oftentimes have requests that are out of the scope of these APIs. This work focuses on responding to the…

Data AugmentationResponse GenerationTask-Oriented Dialogue Systems