Inductive Inference in Supervised Classification
Inductive inference in supervised classification context constitutes to methods and approaches to assign some objects or items into different predefined classes using a formal rule that is derived from training data and possibly some additional auxiliary information. The optimality of such an assignment varies under different conditions due to intrinsic attributes of the objects being considered for such a task. One of these cases is when all the objects' features are discrete variables with a priori known categories. As another example, one can consider a modification of this case with a priori unknown categories. These two cases are the main focus of this thesis and based on Bayesian inductive theories, de Finetti type exchangeability is a suitable assumption that facilitates the derivation of classifiers in the former scenario. On the contrary, this type of exchangeability is not applicable in the latter case, instead, it is possible to utilise the partition exchangeability due to John Kingman. These two types of exchangeabilities are discussed and furthermore here I investigate inductive supervised classifiers based on both types of exchangeabilities. I further demonstrate that the classifiers based on de Finetti type exchangeability can optimally handle test items independently of each other in the presence of infinite amounts of training data while on the other hand, classifiers based on partition exchangeability still continue to benefit from joint labelling of all the test items. Additionally, it is shown that the inductive learning process for the simultaneous classifier saturates when the amount of test data tends to infinity.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationInductive LearningSimilar Papers 제목 키워드 기반
Variational Graph Auto-Encoder Based Inductive Learning Method for Semi-Supervised Classification
Graph representation learning is a fundamental research issue in various domains of applications, of which the inductive learning problem is particularly challenging as it requires models to generalize to unseen graph st…
Graph Representation LearningInductive LearningNode ClassificationRepresentation LearningTransductive Inference and Semi-Supervised Learning
This chapter contains sections titled: Problem Settings, Problem of Generalization in Inductive and Transductive Inference, Structure of the VC Bounds and Transductive Inference, The Symmetrization Lemma and Transductive…
LEMMAUnified Inductive Logic: From Formal Learning to Statistical Inference to Supervised Learning
While the traditional conception of inductive logic is Carnapian, I develop a Peircean alternative and use it to unify formal learning theory, statistics, and a significant part of machine learning: supervised learning. …
Learning TheoryMeta-Inductive Node Classification across Graphs
Semi-supervised node classification on graphs is an important research problem, with many real-world applications in information retrieval such as content classification on a social network and query intent classificatio…
ClassificationGeneral KnowledgeInformation Retrievalintent-classification+4Training MLPs on Graphs without Supervision
Graph Neural Networks (GNNs) have demonstrated their effectiveness in various graph learning tasks, yet their reliance on neighborhood aggregation during inference poses challenges for deployment in latency-sensitive app…
Fraud DetectionGraph ClassificationGraph LearningInductive Bias+3