paper-with-me

홈 › Papers

From Word2Vec to Transformers: Text-Derived Composition Embeddings for Filtering Combinatorial Electrocatalysts

2026-03-09 · Lei Zhang, Markus Stricker arxiv

Compositionally complex solid solution electrocatalysts span vast composition spaces, and even one materials system can contain more candidate compositions than can be measured exhaustively. Here we evaluate a label-free screening strategy that represents each composition using embeddings derived from scientific texts and prioritizes candidates based on similarity to two property concepts. We compare a corpus-trained Word2Vec baseline with transformer-based embeddings, where compositions are encoded either by linear element-wise mixing or by short composition prompts. Similarities to `concept directions', the terms conductivity and dielectric, define a 2-dimensional descriptor space, and a symmetric Pareto-front selection is used to filter candidate subsets without using electrochemical labels. Performance is assessed on 15 materials libraries including noble metal alloys and multicomponent oxides. In this setting, the lightweight Word2Vec baseline, which uses a simple linear combination of element embeddings, often achieves the highest number of reductions of possible candidate compositions while staying close to the best measured performance.

📄 PDF Abstract BibTeX arXiv:2603.08881

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Compositional Demographic Word Embeddings

2020-10-06 · EMNLP 2020 11 · Charles Welch, Jonathan K. Kummerfeld, Verónica Pérez-Rosas, Rada Mihalcea

Word embeddings are usually derived from corpora containing text from many individuals, thus leading to general purpose representations rather than individually personalized representations. While personalized embeddings…

Language ModelingLanguage ModellingWord Embeddings

Character and Subword-Based Word Representation for Neural Language Modeling Prediction

2017-09-01 · WS 2017 9 · Matthieu Labeau, Alex Allauzen, re

Most of neural language models use different kinds of embeddings for word prediction. While word embeddings can be associated to each word in the vocabulary or derived from characters as well as factored morphological de…

Language ModelingLanguage ModellingMachine TranslationSpeech Recognition+1

PolyU CBS-Comp at SemEval-2021 Task 1: Lexical Complexity Prediction (LCP)

2021-08-01 · SEMEVAL 2021 · Rong Xiang, Jinghang Gu, Emmanuele Chersoni, Wenjie Li 외

In this contribution, we describe the system presented by the PolyU CBS-Comp Team at the Task 1 of SemEval 2021, where the goal was the estimation of the complexity of words in a given sentence context. Our top system, b…

Lexical Complexity PredictionSentenceWord Embeddings

Learning Character-level Compositionality with Visual Features

2017-04-17 · ACL 2017 7 · Frederick Liu, Han Lu, Chieh Lo, Graham Neubig

Previous work has modeled the compositionality of words by creating character-level models of meaning, reducing problems of sparsity for rare words. However, in many writing systems compositionality has an effect even on…

text-classificationText Classification

Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Features

2017-03-07 · NAACL 2018 6 · Matteo Pagliardini, Prakhar Gupta, Martin Jaggi

The recent tremendous success of unsupervised word embeddings in a multitude of applications raises the obvious question if similar methods could be derived to improve embeddings (i.e. semantic representations) of word s…

SentenceSentence EmbeddingsWord Embeddings