Finding relevant products given a user query plays a pivotal role in an e-commerce platform, as it can spark shopping behaviors and result in revenue gains. The challenge lies in accurately predicting the correlation between queries and products. Recently, mining the cross-features between queries and products based on the commonsense reasoning capacity of Large Language Models (LLMs) has shown promising performance. However, such methods suffer from high costs due to intensive real-time LLM inference during serving, as well as human annotations and potential Supervised Fine Tuning (SFT). To boost efficiency while leveraging the commonsense reasoning capacity of LLMs for various e-commerce tasks, we propose the Efficient Commonsense-Augmented Recommendation Enhancer (E-CARE). During inference, models augmented with E-CARE can access commonsense reasoning with only a single LLM forward pass per query by utilizing a commonsense reasoning factor graph that encodes most of the reasoning schema from powerful LLMs. The experiments on 2 downstream tasks show an improvement of up to 12.1% on precision@5.
翻译:在电子商务平台中,根据用户查询找到相关商品扮演着关键角色,因为它能激发购物行为并带来收入增长。核心挑战在于准确预测查询与商品之间的关联性。近期,基于大型语言模型(LLMs)的常识推理能力挖掘查询与商品间的交叉特征已展现出良好性能。然而,此类方法因在服务过程中需进行密集的实时LLM推理,以及依赖人工标注和潜在的监督微调(SFT),导致成本高昂。为在提升效率的同时利用LLMs的常识推理能力服务于多样化的电子商务任务,我们提出了高效常识增强推荐增强器(E-CARE)。在推理阶段,通过采用编码了强大LLMs大部分推理模式的常识推理因子图,经E-CARE增强的模型仅需对每个查询执行一次LLM前向传播即可获取常识推理能力。在两个下游任务上的实验表明,其在精确率@5指标上最高提升了12.1%。