Winnowing: Local Algorithms for Document Fingerprinting
Digital content is for copying: quotation, revision, plagiarism, and file sharing all create copies. Document fingerprinting is concerned with accurately identifying copying, including small partial copies, within large sets of documents. We introduce the class of local document fingerprinting algorithms, which seems to capture an essential property of any fingerprinting technique guaranteed to detect copies. We prove a novel lower bound on the performance of any local algorithm. We also develop winnowing, an efficient local fingerprinting algorithm, and show that winnowing’s performance is within 33% of the lower bound. Finally, we also give experimental results on Web data, and report experience with MOSS, a widely-used plagiarism detection service.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Efficient and Scalable Provenance Tracking for LLM-Generated Code Snippets
Large language models (LLMs) for code completion and generation are increasingly used in software development, yet they may reproduce training examples verbatim and without authorship attribution, raising legal and ethic…
Code CompletionSeparate the Wheat from the Chaff: Winnowing Down Divergent Views in Retrieval Augmented Generation
Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge sources to address their limitations in accessing up-to-date or specialized information. A natural strategy to …
A Taxonomy of Weeds: A Field Guide for Corpus Curators to Winnowing the Parallel Text Harvest
Database Assisted Nonlinear Least Squares Algorithm for Visible Light Positioning in NLOS Environments
We propose an indoor localization algorithm for visible light systems by considering effects of non-line-of-sight (NLOS) propagation. The proposed algorithm, named database assisted nonlinear least squares (DA-NLS), util…
Indoor LocalizationPositionFLAME: A Federated Learning Approach for Multi-Modal RF Fingerprinting
Authorization systems are increasingly relying on processing radio frequency (RF) waveforms at receivers to fingerprint (i.e., determine the identity) of the corresponding transmitter. Federated learning (FL) has emerged…
Federated Learning