TextAttack: Lessons learned in designing Python frameworks for NLP
TextAttack is an open-source Python toolkit for adversarial attacks, adversarial training, and data augmentation in NLP. TextAttack unites 15+ papers from the NLP adversarial attack literature into a single framework, with many components reused across attacks. This framework allows both researchers and developers to test and study the weaknesses of their NLP models. To build such an open-source NLP toolkit requires solving some common problems: How do we enable users to supply models from different deep learning frameworks? How can we build tools to support as many different datasets as possible? We share our insights into developing a well-written, well-documented NLP Python framework in hope that they can aid future development of similar packages.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial AttackData AugmentationSimilar Papers 제목 키워드 기반
TextAttack: A Framework for Adversarial Attacks, Data Augmentation, and Adversarial Training in NLP
While there has been substantial research using adversarial attacks to analyze NLP models, each attack is implemented in its own code repository. It remains challenging to develop NLP attacks and utilize them to improve …
Adversarial AttackAdversarial TextData AugmentationLexical Entailment+2Python Bindings for a Large C++ Robotics Library: The Case of OMPL
Python bindings are a critical bridge between high-performance C++ libraries and the flexibility of Python, enabling rapid prototyping, reproducible experiments, and integration with simulation and learning frameworks in…
Motion PlanningDesigning Emergency Response Pipelines : Lessons and Challenges
Emergency response to incidents such as accidents, crimes, and fires is a major problem faced by communities. Emergency response management comprises of several stages and sub-problems like forecasting, resource allocati…
ManagementGradient boosting machines and careful pre-processing work best: ASHRAE Great Energy Predictor III lessons learned
The ASHRAE Great Energy Predictor III (GEPIII) competition was held in late 2019 as one of the largest machine learning competitions ever held focused on building performance. It was hosted on the Kaggle platform and res…
SurveyPCG-Based Game Design Patterns
People enjoy encounters with generative software, but rarely are they encouraged to interact with, understand or engage with it. In this paper we define the term 'PCG-based game', and explain how this concept follows on …
Game Design