Challenges in Representation Learning: A report on three machine learning contests
The ICML 2013 Workshop on Challenges in Representation Learning focused on three challenges: the black box learning challenge, the facial expression recognition challenge, and the multimodal learning challenge. We describe the datasets created for these challenges and summarize the results of the competitions. We provide suggestions for organizers of future challenges and some comments on what kind of knowledge can be gained from machine learning competitions.
Code (12)
Tasks
BIG-bench Machine LearningFacial Expression RecognitionFacial Expression Recognition (FER)Representation LearningSimilar Papers 제목 키워드 기반
Exploiting an Oracle that Reports AUC Scores in Machine Learning Contests
In machine learning contests such as the ImageNet Large Scale Visual Recognition Challenge and the KDD Cup, contestants can submit candidate solutions and receive from an oracle (typically the organizers of the competiti…
BIG-bench Machine LearningBinary ClassificationObject RecognitionA Simple Approach to Multilingual Polarity Classification in Twitter
Recently, sentiment analysis has received a lot of attention due to the interest in mining opinions of social media users. Sentiment analysis consists in determining the polarity of a given text, i.e., its degree of posi…
ClassificationGeneral ClassificationSentiment AnalysisSuccess functions in large contests
We consider contests with a large set (continuum) of participants and axiomatize contest success functions that arise when performance is composed of both effort and a random element, and when winners are those whose per…
Entry and disclosure in group contests
We study information disclosure policies for contests among groups. Each player endogenously decides whether or not to participate in competition as a member of their group. Within-group aggregation of effort is best-sho…
ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contests
With the significant progress of large reasoning models in complex coding and reasoning tasks, existing benchmarks, like LiveCodeBench and CodeElo, are insufficient to evaluate the coding capabilities of large language m…
Code Generation