Set-to-Sequence Methods in Machine Learning: a Review
Machine learning on sets towards sequential output is an important and ubiquitous task, with applications ranging from language modeling and meta-learning to multi-agent strategy games and power grid optimization. Combining elements of representation learning and structured prediction, its two primary challenges include obtaining a meaningful, permutation invariant set representation and subsequently utilizing this representation to output a complex target permutation. This paper provides a comprehensive introduction to the field as well as an overview of important machine learning methods tackling both of these key challenges, with a detailed qualitative comparison of selected model architectures.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningLanguage ModelingLanguage ModellingMeta-LearningRepresentation LearningStructured PredictionSimilar Papers 제목 키워드 기반
Protein sequence design with deep generative models
Protein engineering seeks to identify protein sequences with optimized properties. When guided by machine learning, protein sequence generation methods can draw on prior knowledge and experimental efforts to improve this…
BIG-bench Machine LearningMachine learning methods to study sequence-ensemble-function relationships in disordered proteins
Recent years have seen tremendous developments in the use of machine learning models to link amino acid sequence, structure and function of folded proteins. These methods are, however, rarely applicable to the wide range…
Machine Learning for Spatiotemporal Sequence Forecasting: A Survey
Spatiotemporal systems are common in the real-world. Forecasting the multi-step future of these spatiotemporal systems based on the past observations, or, Spatiotemporal Sequence Forecasting (STSF), is a significant and …
BIG-bench Machine LearningSurveyTrajectory ForecastingAdaptive machine learning for protein engineering
Machine-learning models that learn from data to predict how protein sequence encodes function are emerging as a useful protein engineering tool. However, when using these models to suggest new protein designs, one must d…
BIG-bench Machine LearningThe Progression of Transformers from Language to Vision to MOT: A Literature Review on Multi-Object Tracking with Transformers
The transformer neural network architecture allows for autoregressive sequence-to-sequence modeling through the use of attention layers. It was originally created with the application of machine translation but has revol…
Machine TranslationMulti-Object TrackingObject TrackingTranslation