BERT of all trades, master of some
This paper describes our results for TRAC 2020 competition held together with the conference LREC 2020. Our team name was Ms8qQxMbnjJMgYcw. The competition consisted of 2 subtasks in 3 languages (Bengali, English and Hindi) where the participants{'} task was to classify aggression in short texts from social media and decide whether it is gendered or not. We used a single BERT-based system with two outputs for all tasks simultaneously. Our model placed first in English and second in Bengali gendered text classification competition tasks with 0.87 and 0.93 in F1-score respectively.
Code (1)
Tasks
Alltext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Jack and Masters of all Trades: One-Pass Learning Sets of Model Sets From Large Pre-Trained Models
For deep learning, size is power. Massive neural nets trained on broad data for a spectrum of tasks are at the forefront of artificial intelligence. These large pre-trained models or Jacks of All Trades (JATs), when fine…
AllDeep LearningJack of All Trades, Master of Some, a Multi-Purpose Transformer Agent
The search for a general model that can operate seamlessly across multiple domains remains a key goal in machine learning research. The prevailing methodology in Reinforcement Learning (RL) typically limits models to a s…
AllDecision MakingReinforcement Learning (RL)Sequential Decision MakingMeasuring price impact and information content of trades in a time-varying setting
We propose a non-linear observation-driven version of the Hasbrouck (1991) model for dynamically estimating trades' market impact and information content. We find that market impact displays an intraday pattern superimpo…
Nonlinear price impact from linear models
The impact of trades on asset prices is a crucial aspect of market dynamics for academics, regulators and practitioners alike. Recently, universal and highly nonlinear master curves were observed for price impacts aggreg…
Universal scaling and nonlinearity of aggregate price impact in financial markets
How and why stock prices move is a centuries-old question still not answered conclusively. More recently, attention shifted to higher frequencies, where trades are processed piecewise across different timescales. Here we…
ARC