paper-with-me

Papers

EDA Corpus: A Large Language Model Dataset for Enhanced Interaction with OpenROAD

2024-05-04 · Bing-Yue Wu, Utsav Sharma, Sai Rahul Dhanvi Kankipati, Ajay Yadav, Bintu Kappil George, Sai Ritish Guntupalli, Austin Rovinski, Vidya A. Chhabria

Large language models (LLMs) serve as powerful tools for design, providing capabilities for both task automation and design assistance. Recent advancements have shown tremendous potential for facilitating LLM integration into the chip design process; however, many of these works rely on data that are not publicly available and/or not permissively licensed for use in LLM training and distribution. In this paper, we present a solution aimed at bridging this gap by introducing an open-source dataset tailored for OpenROAD, a widely adopted open-source EDA toolchain. The dataset features over 1000 data points and is structured in two formats: (i) a pairwise set comprised of question prompts with prose answers, and (ii) a pairwise set comprised of code prompts and their corresponding OpenROAD scripts. By providing this dataset, we aim to facilitate LLM-focused research within the EDA domain. The dataset is available at https://github.com/OpenROAD-Assistant/EDA-Corpus.

📄 PDF Abstract BibTeX arXiv:2405.06676

Code (1)

openroad-assistant/eda-corpus 공식 구현

Tasks

Language ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

KEPLET: Knowledge-Enhanced Pretrained Language Model with Topic Entity Awareness

2023-05-02 · Yichuan Li, Jialong Han, Kyumin Lee, Chengyuan Ma 외

In recent years, Pre-trained Language Models (PLMs) have shown their superiority by pre-training on unstructured text corpus and then fine-tuning on downstream tasks. On entity-rich textual resources like Wikipedia, Know…

Entity LinkingLanguage ModelingLanguage ModellingRelation+2

EVA: An Open-Domain Chinese Dialogue System with Large-Scale Generative Pre-Training

2021-08-03 · Hao Zhou, Pei Ke, Zheng Zhang, Yuxian Gu 외

Although pre-trained language models have remarkably enhanced the generation ability of dialogue systems, open-domain Chinese dialogue systems are still limited by the dialogue data and the model size compared with Engli…

EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Models

2024-09-26 · Shaoxiong Ji, Zihao Li, Indraneil Paul, Jaakko Paavola 외

In this work, we introduce EMMA-500, a large-scale multilingual language model continue-trained on texts across 546 languages designed for enhanced multilingual performance, focusing on improving language coverage for lo…

Cross-Lingual TransferLanguage ModelingLanguage Modelling

Speaker Clustering in Textual Dialogue with Utterance Correlation and Cross-corpus Dialogue Act Supervision

2022-01-16 · ACL ARR January 2022 1 · Anonymous

We propose a textual dialogue speaker clustering model, which groups the utterances of a multi-party dialogue without speaker annotations, so that the real speakers are identical inside each cluster. We find that, even w…

ClusteringCross-corpusDialogue Act ClassificationLanguage Modeling+1

J-CHAT: Japanese Large-scale Spoken Dialogue Corpus for Spoken Dialogue Language Modeling

2024-07-22 · Wataru Nakata, Kentaro Seki, Hitomi Yanaka, Yuki Saito 외

Spoken dialogue plays a crucial role in human-AI interactions, necessitating dialogue-oriented spoken language models (SLMs). To develop versatile SLMs, large-scale and diverse speech datasets are essential. Additionally…

Dialogue GenerationLanguage ModelingLanguage Modelling