paper-with-me

홈 › Papers

Predicting and Understanding Law-Making with Word Vectors and an Ensemble Model

2016-07-07 · John J. Nay

Out of nearly 70,000 bills introduced in the U.S. Congress from 2001 to 2015, only 2,513 were enacted. We developed a machine learning approach to forecasting the probability that any bill will become law. Starting in 2001 with the 107th Congress, we trained models on data from previous Congresses, predicted all bills in the current Congress, and repeated until the 113th Congress served as the test. For prediction we scored each sentence of a bill with a language model that embeds legislative vocabulary into a high-dimensional, semantic-laden vector space. This language representation enables our investigation into which words increase the probability of enactment for any topic. To test the relative importance of text and context, we compared the text model to a context-only model that uses variables such as whether the bill's sponsor is in the majority party. To test the effect of changes to bills after their introduction on our ability to predict their final outcome, we compared using the bill text and meta-data available at the time of introduction with using the most recent data. At the time of introduction context-only predictions outperform text-only, and with the newest data text-only outperforms context-only. Combining text and context always performs best. We conducted a global sensitivity analysis on the combined model to determine important variables predicting enactment.

📄 PDF Abstract BibTeX arXiv:1607.02109

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingSentence

Similar Papers 제목 키워드 기반

Entity Type Recognition using an Ensemble of Distributional Semantic Models to Enhance Query Understanding

2016-04-04 · Walid Shalaby, Khalifeh Al Jadda, Mohammed Korayem, Trey Grainger

We present an ensemble approach for categorizing search query entities in the recruitment domain. Understanding the types of entities expressed in a search query (Company, Skill, Job Title, etc.) enables more intelligent…

Information RetrievalRetrievalWorld Knowledge

TUDA-CCL at SemEval-2021 Task 1: Using Gradient-boosted Regression Tree Ensembles Trained on a Heterogeneous Feature Set for Predicting Lexical Complexity

2021-08-01 · SEMEVAL 2021 · Sebastian Gombert, Sabine Bartsch

In this paper, we present our systems submitted to SemEval-2021 Task 1 on lexical complexity prediction.The aim of this shared task was to create systems able to predict the lexical complexity of word tokens and bigram m…

SentenceWord Embeddings

Context Vectors are Reflections of Word Vectors in Half the Dimensions

2019-02-26 · Zhenisbek Assylbekov, Rustem Takhanov

This paper takes a step towards theoretical analysis of the relationship between word embeddings and context embeddings in models such as word2vec. We start from basic probabilistic assumptions on the nature of word vect…

Text GenerationWord Embeddings

Parameter Free Hierarchical Graph-Based Clustering for Analyzing Continuous Word Embeddings

2017-08-01 · WS 2017 8 · Thomas Alex Trost, er, Dietrich Klakow

Word embeddings are high-dimensional vector representations of words and are thus difficult to interpret. In order to deal with this, we introduce an unsupervised parameter free method for creating a hierarchical graphic…

ClusteringDimensionality ReductionWord Embeddings

Fewer features perform well at Native Language Identification task

2017-09-01 · WS 2017 9 · Taraka Rama, {\c{C}}a{\u{g}}r{\i} {\c{C}}{\"o}ltekin

This paper describes our results at the NLI shared task 2017. We participated in essays, speech, and fusion task that uses text, speech, and i-vectors for the task of identifying the native language of the given input. I…

Language IdentificationNative Language Identification