CARGO: Effective format-free compressed storage of genomic information
The recent super-exponential growth in the amount of sequencing data generated worldwide has put techniques for compressed storage into the focus. Most available solutions, however, are strictly tied to specific bioinformatics formats, sometimes inheriting from them suboptimal design choices; this hinders flexible and effective data sharing. Here we present CARGO (Compressed ARchiving for GenOmics), a high-level framework to automatically generate software systems optimized for the compressed storage of arbitrary types of large genomic data collections. Straightforward applications of our approach to FASTQ and SAM archives require a few lines of code, produce solutions that match and sometimes outperform specialized format-tailored compressors, and scale well to multi-TB datasets.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
CARGO: Carbon-Aware Gossip Orchestration in Smart Shipping
Smart shipping operations increasingly depend on collaborative AI, yet the underlying data are generated across vessels with uneven connectivity, limited backhaul, and clear commercial sensitivity. In such settings, serv…
Programmable magnetic soft robots with controlled locomotion and directional liquid cargo release
Magnetically programmable soft elastomers enable complex shape morphing and locomotion dynamics in small scale soft robots under external magnetic fields. Benefiting from their programmed deformation and wireless actuati…
Sharing the Load: Autonomous Multi-Rover Cargo Transport
A future lunar habitat, as part of the Artemis program, will require a significant amount of logistics infrastructure. Cargo that is transported to the Moon will need to be moved from a landing site to other key location…
AiSAQ: All-in-Storage ANNS with Product Quantization for DRAM-free Information Retrieval
Graph-based approximate nearest neighbor search (ANNS) algorithms work effectively against large-scale vector retrieval. Among such methods, DiskANN achieves good recall-speed tradeoffs using both DRAM and storage. DiskA…
AllInformation RetrievalQuantizationRAG+2Predicting the Directional Transport of Multivalent Cargo from Position Dependent Binding and Unbinding Rates
Multivalent cargo that can interact with substrates via multiple interaction sites exhibit shared characteristics despite being found in different systems at different length-scales. Here, a general analytical model has …
Position