paper-with-me

홈 › Papers

Heterogeneous Multi-task Metric Learning across Multiple Domains

2019-04-08 · Yong Luo, Yonggang Wen, DaCheng Tao

Distance metric learning (DML) plays a crucial role in diverse machine learning algorithms and applications. When the labeled information in target domain is limited, transfer metric learning (TML) helps to learn the metric by leveraging the sufficient information from other related domains. Multi-task metric learning (MTML), which can be regarded as a special case of TML, performs transfer across all related domains. Current TML tools usually assume that the same feature representation is exploited for different domains. However, in real-world applications, data may be drawn from heterogeneous domains. Heterogeneous transfer learning approaches can be adopted to remedy this drawback by deriving a metric from the learned transformation across different domains. But they are often limited in that only two domains can be handled. To appropriately handle multiple domains, we develop a novel heterogeneous multi-task metric learning (HMTML) framework. In HMTML, the metrics of all different domains are learned together. The transformations derived from the metrics are utilized to induce a common subspace, and the high-order covariance among the predictive structures of these domains is maximized in this subspace. There do exist a few heterogeneous transfer learning approaches that deal with multiple domains, but the high-order statistics (correlation information), which can only be exploited by simultaneously examining all domains, is ignored in these approaches. Compared with them, the proposed HMTML can effectively explore such high-order information, thus obtaining more reliable feature transformations and metrics. Effectiveness of our method is validated by the extensive and intensive experiments on text categorization, scene classification, and social image annotation.

📄 PDF Abstract BibTeX arXiv:1904.04081

Code (0)

등록된 구현이 없습니다.

Tasks

Metric LearningScene ClassificationText CategorizationTransfer Learning

Similar Papers 제목 키워드 기반

Multiplex Heterogeneous Graph Convolutional Network

2022-08-12 · Pengyang Yu, Chaofan Fu, Yanwei Yu, Chao Huang 외

Heterogeneous graph convolutional networks have gained great popularity in tackling various network analytical tasks on heterogeneous network data, ranging from link prediction to node classification. However, most exist…

AttributeLink PredictionNetwork EmbeddingNode Classification+1

Efficient Heterogeneous Treatment Effect Estimation With Multiple Experiments and Multiple Outcomes

2022-06-10 · Leon Yao, Caroline Lo, Israel Nir, Sarah Tan 외

Learning heterogeneous treatment effects (HTEs) is an important problem across many fields. Most existing methods consider the setting with a single treatment arm and a single outcome metric. However, in many real world …

Heterogeneous Treatment Effect Estimation

Rethinking Parameter Sharing for LLM Fine-Tuning with Multiple LoRAs

2025-09-29 · Hao Ban, Kaiyi Ji arxiv

Large language models are often adapted using parameter-efficient techniques such as Low-Rank Adaptation (LoRA), formulated as $y = W_0x + BAx$, where $W_0$ is the pre-trained parameters and $x$ is the input to the adapt…

Late Fusion Multi-task Learning for Semiparametric Inference with Nuisance Parameters

2025-07-10 · Sohom Bhattacharya, Yongzhuo Chen, Muxuan Liang arxiv

In the age of large and heterogeneous datasets, the integration of information from diverse sources is essential to improve parameter estimation. Multi-task learning offers a powerful approach by enabling simultaneous le…

Heterogeneous Treatment Effect EstimationMulti-Task Learning

Joint Learning-based Heterogeneous Graph Attention Network for Timeline Summarization

2022-07-01 · NAACL 2022 7 · Jingyi You, Dongyuan Li, Hidetaka Kamigaito, Kotaro Funakoshi 외

Previous studies on the timeline summarization (TLS) task ignored the information interaction between sentences and dates, and adopted pre-defined unlearnable representations for them. They also considered date selection…

Event DetectionGraph AttentionTimeline Summarization