NovoBench: Benchmarking Deep Learning-based De Novo Peptide Sequencing Methods in Proteomics
Tandem mass spectrometry has played a pivotal role in advancing proteomics, enabling the high-throughput analysis of protein composition in biological tissues. Many deep learning methods have been developed for \emph{de novo} peptide sequencing task, i.e., predicting the peptide sequence for the observed mass spectrum. However, two key challenges seriously hinder the further advancement of this important task. Firstly, since there is no consensus for the evaluation datasets, the empirical results in different research papers are often not comparable, leading to unfair comparison. Secondly, the current methods are usually limited to amino acid-level or peptide-level precision and recall metrics. In this work, we present the first unified benchmark NovoBench for \emph{de novo} peptide sequencing, which comprises diverse mass spectrum data, integrated models, and comprehensive evaluation metrics. Recent impressive methods, including DeepNovo, PointNovo, Casanovo, InstaNovo, AdaNovo and $\pi$-HelixNovo are integrated into our framework. In addition to amino acid-level and peptide-level precision and recall, we evaluate the models' performance in terms of identifying post-tranlational modifications (PTMs), efficiency and robustness to peptide length, noise peaks and missing fragment ratio, which are important influencing factors while seldom be considered. Leveraging this benchmark, we conduct a large-scale study of current methods, report many insightful findings that open up new possibilities for future development.
Code (0)
등록된 구현이 없습니다.
Tasks
Benchmarkingde novo peptide sequencingSimilar Papers 제목 키워드 기반
PGPointNovo: an efficient neural network-based tool for parallel de novo peptide sequencing
De novo peptide sequencing for tandem mass spectrometry data is not only a key technology for novel peptide identification, but also a precedent task for many downstream tasks, such as vaccine and antibody studies. In re…
de novo peptide sequencingEfficient Neural NetworkComputationally instrument-resolution-independent de novo peptide sequencing for high-resolution devices
De novo peptide sequencing is the key technology for finding novel peptides from mass spectra. The overall quality of sequencing results depends on the de novo peptide sequencing algorithm as well as the quality of mass …
de novo peptide sequencingIntroducing π-HelixNovo for practical large-scale de novo peptide sequencing
De novo peptide sequencing is a promising approach for novel peptide discovery. We use a novel concept of complementary spectra to enhance ion information and propose a de novo sequencing model π-HelixNovo based on Trans…
de novo peptide sequencingMitigating the missing-fragmentation problem in de novo peptide sequencing with a two-stage graph-based deep learning model
Novel protein discovery and immunopeptidomics depend on highly sensitive de novo peptide sequencing with tandem mass spectrometry. Despite notable improvement using deep learning models, the missing-fragmentation problem…
de novo peptide sequencingGraph Neural NetworkDePS: An improved deep learning model for de novo peptide sequencing
De novo peptide sequencing from mass spectrometry data is an important method for protein identification. Recently, various deep learning approaches were applied for de novo peptide sequencing and DeepNovoV2 is one of th…
de novo peptide sequencing