How POQD Revolutionizes Multi-Vector Retrieval with Intelligent Query Decomposition

2 days ago 高效码农

POQD: A Revolutionary Framework for Optimizing Multi-Vector Retrieval Performance Introduction: The Critical Need for Query Decomposition Optimization In modern information retrieval systems, Multi-Vector Retrieval (MVR) has emerged as a cornerstone technology for enhancing search accuracy. Traditional approaches like ColBERT face inherent limitations through their rigid token-level decomposition strategy. Our analysis reveals a critical insight: Overly granular query splitting can distort semantic meaning. A striking example shows how decomposing “Hong Kong” into individual tokens led to irrelevant image retrieval of Singapore’s former Prime Minister Lee Kuan Yew – simply because black image patches coincidentally matched the “Kong” (King Kong) association. This …