On the Dataless Training of Neural Networks
This paper surveys studies on the use of neural networks for optimization in the training-data-free setting. Specifically, we examine the dataless application of neural network architectures in optimization by re-parameterizing problems using fully connected (or MLP), convolutional, graph, and quadratic neural networks. Although MLPs have been used to solve linear programs a few decades ago, this approach has recently gained increasing attention due to its promising results across diverse applications, including those based on combinatorial optimization, inverse problems, and partial differential equations. The motivation for this setting stems from two key (possibly over-lapping) factors: (i) data-driven learning approaches are still underdeveloped and have yet to demonstrate strong results, as seen in combinatorial optimization, and (ii) the availability of training data is inherently limited, such as in medical image reconstruction and other scientific applications. In this paper, we define the dataless setting and categorize it into two variants based on how a problem instance -- defined by a single datum -- is encoded onto the neural network: (i) architecture-agnostic methods and (ii) architecture-specific methods. Additionally, we discuss similarities and clarify distinctions between the dataless neural network (dNN) settings and related concepts such as zero-shot learning, one-shot learning, lifting in optimization, and over-parameterization.
Code (0)
등록된 구현이 없습니다.
Tasks
Image ReconstructionZero-Shot LearningOne-Shot LearningSimilar Papers 제목 키워드 기반
Unsupervised Label Refinement Improves Dataless Text Classification
Dataless text classification is capable of classifying documents into previously unseen labels by assigning a score to any document paired with a label description. While promising, it crucially relies on accurate descri…
ClassificationClusteringGeneral ClassificationText Classification+1Practical Dataless Text Classification Through Dense Retrieval
Dataless text classification aims to classify documents using only class descriptions without any training data. Recent research shows that pre-trained textual entailment models can achieve state-of-the-art dataless cla…
ClassificationNatural Language InferenceRetrievaltext-classification+1Exploring Description-Augmented Dataless Intent Classification
In this work, we introduce several schemes to leverage description-augmented embedding similarity for dataless intent classification using current state-of-the-art (SOTA) text embedding models. We report results of our m…
AvgClassificationintent-classificationIntent ClassificationDataless Neural Networks for Resource-Constrained Project Scheduling
Dataless neural networks represent a paradigm shift in applying neural architectures to combinatorial optimization problems, eliminating the need for training datasets by encoding problem instances directly into network …
A Pseudo Label based Dataless Naive Bayes Algorithm for Text Classification with Seed Words
Traditional supervised text classifiers require a large number of manually labeled documents, which are often expensive to obtain. Recently, dataless text classification has attracted more attention, since it only requir…
General ClassificationPseudo Labeltext-classificationText Classification