ReflectRec: Cycle-Consistency Preference Verification for LLM-based Recommendation
Abstract
CoT-style LLM recommenders generate a natural-language preference note as a chain-of-thought prefix to ranking, but the note is trusted without verification, and the ranker never consults behaviorally similar users. We propose ReflectRec, organized around a preference-to-history round-trip verifier whose recall score serves as an operational signal of preference-to-history recoverability, enabling conditional regeneration for low-recoverability preferences and selection among regeneration attempts. Around this verifier, we wire a semantic Stage-1 prompt, conditional regeneration, and Forward-Look retrieval that injects future watches of behaviorally similar users as a collaborative hint. On MovieLens-100K and MovieLens-1M, the full pipeline outperforms CoT4Rec-ICL by +16.25 / +4.46 pp Hit@10, with positive gains across all ValScore buckets and three LLM backbones (Qwen3-30B, Qwen2.5-72B, and Llama-3.3-70B). We also observe a similar verifier-guided regeneration pattern on Amazon Electronics.
- Comment
- 15 pages. Published in the Proceedings of EMNLP 2026 (Main Conference)
- Journal ref
- Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing (EMNLP 2026), pages 36183-36197, Budapest, Hungary
- DOI
- 10.18653/2026.emnlp-main.1591