paper-with-me

홈 › Papers

Detecting Insincere Questions from Text: A Transfer Learning Approach

2020-12-07 · Ashwin Rachha, Gaurav Vanmane

The internet today has become an unrivalled source of information where people converse on content based websites such as Quora, Reddit, StackOverflow and Twitter asking doubts and sharing knowledge with the world. A major arising problem with such websites is the proliferation of toxic comments or instances of insincerity wherein the users instead of maintaining a sincere motive indulge in spreading toxic and divisive content. The straightforward course of action in confronting this situation is detecting such content beforehand and preventing it from subsisting online. In recent times Transfer Learning in Natural Language Processing has seen an unprecedented growth. Today with the existence of transformers and various state of the art innovations, a tremendous growth has been made in various NLP domains. The introduction of BERT has caused quite a stir in the NLP community. As mentioned, when published, BERT dominated performance benchmarks and thereby inspired many other authors to experiment with it and publish similar models. This led to the development of a whole BERT-family, each member being specialized on a different task. In this paper we solve the Insincere Questions Classification problem by fine tuning four cutting age models viz BERT, RoBERTa, DistilBERT and ALBERT.

📄 PDF Abstract BibTeX arXiv:2012.07587

Code (1)

GauravVanmane/Detection-of-Insincere-Questions/blob/main/Detection%20Of%20Insincere%20Questions.ipynb 공식 구현

Tasks

Transfer Learning

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
LAMB LAMB is a a layerwise adaptive large batch optimization technique. It provides a strategy for adapting the learning rate in large batch settings. LAMB uses…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
ALBERT 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Weight Decay 설명 없음

Similar Papers 제목 키워드 기반

Detect Toxic Content to Improve Online Conversations

2019-10-29 · Deepshi Mediratta, Nikhil Oswal

Social media is filled with toxic content. The aim of this paper is to build a model that can detect insincere questions. We use the 'Quora Insincere Questions Classification' dataset for our analysis. The dataset is com…

Word Embeddings

Detecting Intentional AIS Shutdown in Open Sea Maritime Surveillance Using Self-Supervised Deep Learning

2023-10-24 · Pierre Bernabé, Arnaud Gotlieb, Bruno Legeard, Dusica Marijan 외

In maritime traffic surveillance, detecting illegal activities, such as illegal fishing or transshipment of illicit products is a crucial task of the coastal administration. In the open sea, one has to rely on Automatic …

I'm Afraid I Can't Do That: Predicting Prompt Refusal in Black-Box Generative Language Models

2023-06-06 · Max Reuter, William Schulze

Since the release of OpenAI's ChatGPT, generative language models have attracted extensive public attention. The increased usage has highlighted generative models' broad utility, but also revealed several forms of embedd…

Debate with Images: Detecting Deceptive Behaviors in Multimodal Large Language Models

2025-11-29 · Sitong Fang, Shiyi Hou, Kaile Wang, Boyuan Chen 외 arxiv

Are frontier AI systems becoming more capable? Certainly. Yet such progress is not an unalloyed blessing but rather a Trojan horse: behind their performance leaps lie more insidious and destructive safety risks, namely d…

Detecting Temporal Ambiguity in Questions

2024-09-25 · Bhawna Piryani, Abdelrahman Abdallah, Jamshid Mozafari, Adam Jatowt

Detecting and answering ambiguous questions has been a challenging task in open-domain question answering. Ambiguous questions have different answers depending on their interpretation and can take diverse forms. Temporal…

Open-Domain Question AnsweringQuestion Answering