Recent advancements in large language model-based recommendation systems often represent items as text or semantic IDs and generate recommendations in an auto-regressive manner. However, due to the left-to-right greedy decoding strategy and the unidirectional logical flow, such methods often fail to produce globally optimal recommendations. In contrast, human reasoning does not follow a rigid left-to-right sequence. Instead, it often begins with keywords or intuitive insights, which are then refined and expanded. Inspired by this fact, we propose MindRec, a diffusion-driven coarse-to-fine generative paradigm that emulates human thought processes. Built upon a diffusion language model, MindRec departs from auto-regressive generation by leveraging a masked diffusion process to reconstruct items in a flexible, non-sequential manner. Particularly, our method first generates key tokens that reflect user preferences, and then expands them into the complete item, enabling adaptive and human-like generation. To further emulate the structured nature of human decision-making, we organize items into a hierarchical category tree. This structure guides the model to first produce the coarse-grained category and then progressively refine its selection through finer-grained subcategories before generating the specific item. To mitigate the local optimum problem inherent in greedy decoding, we design a novel beam search algorithm, Diffusion Beam Search, tailored for our mind-inspired generation paradigm. Experimental results demonstrate that MindRec yields a 9.5\% average improvement in top-1 accuracy over state-of-the-art methods, highlighting its potential to enhance recommendation performance. The implementation is available via https://github.com/Mr-Peach0301/MindRec.
翻译:近期基于大语言模型的推荐系统通常将物品表示为文本或语义ID,并以自回归方式生成推荐。然而,由于从左到右的贪心解码策略和单向逻辑流,此类方法往往无法产生全局最优的推荐。相比之下,人类推理并不遵循严格的从左到右顺序,而是常从关键词或直觉洞察开始,随后进行细化和扩展。受此启发,我们提出MindRec,一种模拟人类思维过程的扩散驱动从粗到细生成范式。基于扩散语言模型构建,MindRec摒弃自回归生成方式,利用掩码扩散过程以灵活、非顺序的方式重构物品。具体而言,我们的方法首先生成反映用户偏好的关键令牌,随后将其扩展为完整物品,实现自适应且类人的生成过程。为进一步模拟人类决策的结构化特性,我们将物品组织为分层类别树。该结构引导模型先生成粗粒度类别,随后通过更细粒度的子类别逐步细化选择,最终生成具体物品。为缓解贪心解码固有的局部最优问题,我们设计了一种新颖的束搜索算法——扩散束搜索,专门适配于这种思维启发的生成范式。实验结果表明,MindRec在top-1准确率上相较最先进方法平均提升9.5%,彰显了其提升推荐性能的潜力。实现代码可通过https://github.com/Mr-Peach0301/MindRec获取。