CORTEXA
← Browse
arxivcs.AI2026-07-02

SemHash-LLM: A Multi-Granularity Semantic Hashing Framework for Document Deduplication

Xinyi Fang, Kejian Tong, Jiabei Liu, Tao Ning, Yuhang He

Large scale document deduplication must preserve semantic equivalence while remaining efficient over massive corpora. We present SemHash LLM, a multi granularity framework that unifies semantic projection hashing, attention weighted MinHash, contrastive boundary learning, and selective LLM based adjudication. The method combines character, token, and document level signals through gated fusion, then applies a cascaded filtering pipeline for efficient candidate reduction. Semantic projection hashing learns compact binary codes in distilled LLM embedding space, while attention weighted Min- Hash suppresses boilerplate and emphasizes informative content. Adaptive decision boundaries and uncertainty estimation further improve robustness across template pollution, short text perturbation, containment, and viral fragments. Experiments show that SemHash LLM achieves strong duplicate detection quality with less than one percent neural verification cost.

View free PDFSource page

Related papers

arxivcs.SIcs.AI2026-07-31

Multi-Granularity Position Embedding of Graphs via Granular-Ball for Link Prediction

Sen Zhao, Cheng Liu, Shuyin Xia, Zhiyuan Liu, Yi Liu, Yi Wang, et al.

Link prediction aims to identify potential or future connections within a given graph structure. Position information is essential for link prediction, as it distinguishes homogeneous nodes through their relative relationships, facilitating the accurate capture of structural patt…

View free PDFSource page
arxivcs.DLcs.AI2026-07-23

From Static Bibliometrics to Dynamic Knowledge Graphs: An LLM-Powered Framework for Modernizing Science, Technology, and Innovation (STI) Analytics

Muhsen Hammoud

Bibliometric indicators - citation counts, h-indexes, co-authorship networks - have long anchored science, technology, and innovation (STI) analytics, yet suffer from temporal lag, semantic shallowness, and an inability to capture the non-linear dynamics of contemporary knowledge…

View free PDFSource page
arxivcs.AIstat.ME2026-07-23

Detecting LLM-Generated Tokens in Human--LLM Coauthored Text

Yangjun Lu, Hongyi Zhou, Fabian Spill, Kai Ye, Chengchun Shi, Jin Zhu

The rise of human-AI collaborative writing has created a growing need for fine-grained detection methods that support localizing likely LLM-generated content in mixed-authorship documents. Existing methods for detecting LLM-generated text mainly focus on document-level classifica…

View free PDFSource page
arxivcs.AI2026-07-23

Reexamining zero-shot summarization: Empirical investigation of trustworthiness of LLM-summarizers

Vasudha Bhatnagar, Purnima Bindal, Vikas Kumar, Raj Kumari Bahl

Zero-shot summarization using Large Language Models (LLMs) has significantly advanced the abstractive summarization task by producing coherent and fluent summaries. However, underlying stochasticity of the large language models raises concerns about the stability and trustworthin…

View free PDFSource page
arxivcs.AI2026-07-23

MSBraM: A Multi-scale Self-supervised Brain Foundation Model for Hierarchical EEG Dynamics Learning

Tao Zhou, Jing Han, Lingyu Shu, Zixing Zhang

Self-supervised foundation models have recently shown strong potential for electroencephalogram (EEG)-based analysis. However, existing approaches struggle to capture the inherently multi-scale temporal structure of EEG signals, where local neural patterns and long-range dependen…

View free PDFSource page