CS Paper Radar

Supporting The Many Lives of Personal Data with Rebite: LLM-Powered Goal-Directed Framing in Food Journaling

Weijun Li, Daniel A. Epstein

cs.HC ·submitted 2026-08-21 16:48 UTC · v1
top venue

Abstract

People's health and tracking goals frequently change, but most personal informatics systems struggle to adapt, leading people to abandon their data and start over. We propose goal-directed framing, an approach that repositions goals within personal informatics systems. Instead of fixing the meaning of data at capture time, the approach frames the collected data through the current goal and reframes it whenever the goal changes. We realize this in Rebite, a photo-based food journaling system that uses LLMs to read unstructured meal photos and produce goal-directed feedback. In a one-week deployment with 21 participants managing multiple dietary goals, we find that goal-directed framing shaped how participants engaged with their goals. Translating a goal into metrics helped them see what it meant in practice, confirming existing priorities, surfacing what they overlooked, and revealing where the metrics fell short. When goals changed, seeing past meals reframed under the new goal exposed overlaps and conflicts, prompting participants to negotiate trade-offs and refine priorities. We discuss how goal-directed framing both supports and complicates reflection as goals change, and offer design implications for personal informatics systems to support evolving goals.

Comment
To appear at UIST 2026 (The 39th Annual ACM Symposium on User Interface Software and Technology), Detroit, MI, USA. 14 pages, 6 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Toward Low-Burden Image-Based Dietary Assessment Through Human-AI Collaborative Correction

cs.HC ·2026-10-30 ·Darren Liu, Andrew Lu, Zhiyuan "Ryan" Wang, Hanqi Luo, Xiao Hu +1 more
similarity 0.65
Abstract · 28 pages, 5 figures, 5 tables. Includes appendices

Image-based dietary assessment can automate initial food logging, but meal photographs often leave food identity, hidden ingredients, preparation, and portion uncertain, making correction a recurring part of use. We introduce Human-AI Collaborative Correction, which reframes correction as communicate intent $\rightarrow$ regenerate $\rightarrow$ verify: users express what should change through text, voice, or guided clarification, the AI regenerates the linked dietary record, and users verify the result. In a within-participant study with 30 participants, compared with conventional Manual Search-and-Edit Correction, collaborative correction was associated with lower workload (Raw TLX: 35.83 vs. 55.00; p < .001), 21.0% lower recorded usage time, 51.1% fewer recorded clicks, and more favorable user-experience ratings; 90.0% preferred it overall. An exploratory nutrient analysis also found lower energy MAE. These findings support intent-driven regeneration as a promising interaction pattern for reducing correction burden while preserving user verification and making image-based dietary tracking easier to sustain.

0.20

Supporting Habit Formation in Pre-Meal Photo Capture: A Longitudinal Study of Behavior Change Techniques

cs.HC ·2026-11-02 ·Jun Fang, Yueying Suo, Yuntao Wang, Susu Wang, Xiaoyu Yang +3 more
similarity 0.61
Abstract

Pre-meal photo capture is lightweight only with a smartphone, yet habit formation requires repeatedly initiating and completing the action within the narrow window before the first bite. We examine how supports based on behavior change techniques can shape capture adherence, perceived habit, and support needs over time. Using a participant-informed selection process, we implemented three smartphone supports targeting Prompts/cues, Focus on past success, and Social support. We evaluated them in a five-week field study with 54 participants, spanning support, withdrawal, and reinstatement, followed by interviews and a three-week follow-up. Across 4,945 main meals, 63.9\% were confirmed pre-meal captures, and adherence was broadly maintained across phases. Perceived automaticity and spontaneous remembering improved mainly during initial support. As capture became more familiar, participants combined spontaneous remembering with deliberate strategies, reduced active feature use while continuing to value support availability, and carried the practice forward through accumulated records, familiar tools, and chosen relationships. These findings frame BCT support for pre-meal photo capture as a configurable arrangement. Systems should preserve a predictable capture pathway while adapting when, how, and through whom support remains available.

0.18

Can Personal Requirements Become Supervision for Planning?

cs.AI cs.LG ·2026-10-29 ·Junwei Wu, Runze Yan, Yuzhang Xie, Hanqi Luo, Ziwei Dong +3 more
similarity 0.60
Abstract

Managing multiple chronic conditions through diet requires satisfying disease- and medication-specific requirements jointly across meals and days while preserving established eating habits. These requirements are public in clinical guidelines and drug labels, yet turning them into a feasible plan for one person remains difficult for language-model agents. In our dietitian-approved weekly planning evaluation built from NHANES, thirteen models, from medically fine-tuned 8B models to GPT-6.1 Sol, pass fewer than 3% of complete plans through direct generation. Explicit rules, higher reasoning effort, or model-directed tools leave GPT-6.1 Sol at no more than 8%. We present Noura, which pairs LLM planning with executable personal specifications instantiated from public clinical guidance and individual health and dietary profiles. During planning, the specification grounds foods, optimizes portions, checks the complete multi-day plan, and guides revision. Our key insight is that a specification that rejects a plan can also determine what to learn from it. Noura turns executed plans and contextually credited revisions into supervision for compact models, recovering targets even from trajectories that never achieve complete success. The same specification supplies supervised targets, preferences, and rewards for post-training. On 4,993 held-out participants, Noura-SFT raises Qwen3-14B's complete-plan pass rate from 24.0% to 72.5% within the same execution loop, cuts rule violations by 97.5% with no observed critical failures, and improves dietary quality. The locally hosted 14B planner incurs fewer rule violations than its GPT-6 Luna teacher. A matched comparison shows that executed targets reduce rule violations by 41% over model-written proposals. Across four Qwen, Phi, and Llama backbones, self-training alone reduces rule violations by 41-61% on a 1,249-person population subset.

0.23

How Well Do Benchmarks Evaluate LLMs' Use for Personal Health Informatics?

cs.HC ·2026-11-10 ·Fatemeh Mirhosseini, Yasaman S. Sefidgar
benchmark similarity 0.58
Abstract

Benchmarking is a valuable technique for advancing the capabilities of Large Language Models (LLMs), including in personal health informatics. There are growing efforts on benchmark creation for personal health data activities. However, it is unclear whether and how well these efforts align with needs and considerations of personal health informatics process. Addressing this need, we first analyzed 53,587 tasks across eight benchmarks related to personal health informatics and characterized the space of benchmark design. We then contrasted our observations of design choices with personal informatics theories and empirical knowledge. We find significant mismatches between existing benchmark design and domain guidelines and understanding. This lack of alignment limits the utility of the evidence current benchmarks offer about LLM capabilities. We use domain knowledge to highlight capabilities benchmarks should include and discuss opportunities our work enables for taking a human-centered and domain-driven approach to benchmark design.

0.39

NutriBench-Kitchen: Benchmarking Embodied AI for Nutrition Management

cs.CV ·2026-09-07 ·Yulin Wei, Xiangchen Wang, Jianhui Pan, Jinyu Xiao, Zheng Tan +3 more
top venuebenchmarkcode/data similarity 0.58
Abstract · 17 pages, 4 figures, ECCV

An embodied kitchen assistant must do more than recognize food in isolated frames. It must track ingredient states over time and integrate visual observations with recipe and nutritional knowledge to support constraint-aware decision-making. We formalize this capability as \emph{Embodied Nutrition Management}: perceiving nutrition-relevant events, maintaining a persistent food state, and using it for knowledge-grounded planning. Existing benchmarks evaluate static food understanding or embodied cooking actions, but do not measure whether an agent can continuously update and use nutrition-relevant states in dynamic kitchens. To fill this gap, we introduce \textbf{NutriBench-Kitchen}, a benchmark containing 1,500 manually verified question--answer pairs from 160 cooking videos. It covers five task families: Ingredient Entry, Memory Management, Recipe Query, Long-Term Planning, and Short-Term Planning, spanning food-state construction, maintenance, knowledge retrieval, and decision-making across different planning horizons. Evaluations of proprietary and open-source large vision-language models reveal a substantial gap from human performance, particularly in quantitative ingredient estimation, long-term state tracking, and reasoning under interacting constraints. We further introduce \textbf{Nutri-Vgent}, a diagnostic long-video agent with separate episodic, food-state, and recipe memories. Its consistent improvements demonstrate the value of explicit state representations and structured memory for nutrition management. Together, NutriBench-Kitchen and Nutri-Vgent provide a testbed for studying persistent state tracking and knowledge-grounded reasoning in dynamic kitchens. Code is available at https://github.com/V1ol1n/NutriBench-Kitchen.

0.54

Profile-Aware Trustworthy Recipe Generation with Planner-Critic Agentic Remediation

eess.SY cs.ET ·2026-10-02 ·Shanhong Liu, Pai Chet Ng, Konstantinos N. Plataniotis
benchmarkcode/data similarity 0.57
Abstract

Recipe generation from food images has practical value for intelligent cooking assistance, but traditional one-pass generation often overlooks user-specific safety requirements such as allergies, dietary restrictions, and preparation constraints. We propose PCAR, a Planner-Critic Agentic Remediation framework for trustworthy recipe generation. PCAR separates recipe planning from safety verification: a Planner Agent extracts ingredients and generates recipe drafts conditioned on the user profile, while a Safety Critic Agent audits each draft and provides structured feedback for remediation when violations are detected. This remediation loop enables unsafe recipes to be revised rather than directly returned or discarded. We evaluate PCAR on real food images with 100 benchmark user profiles across four backbone models, including proprietary and locally served open-source models. Results show that PCAR achieves strong safety and generation performance with capable backbone models, while preserving practical recipe quality.

0.30

Personalized Image Generation with Reasoning and Reflection

cs.CV cs.AI ·2026-09-30 ·Bo Ni, Ngoc N. Tran, Qinwen Ge, Franck Dernoncourt, Seunghyun Yoon +8 more
benchmark similarity 0.56
Abstract

Personalized image generation has remained narrowly focused on conditional synthesis from curated visual exemplars, rather than capturing who a user is. In practice, however, a user's personal context is much richer, comprising reviews, posts, images, captions, and metadata accumulated over time. A truly personalized generator should leverage this history to produce images aligned with the user's lifestyle and aesthetic preferences. To this end, we introduce the first unified benchmark for personalized image generation from user histories. The benchmark comprises two complementary tasks and a multi-axis evaluation protocol that assesses target fidelity, visual quality, user distinguishability, semantic alignment with the user's history, and task-specific utility. Grounded in real-world e-commerce and social media settings, the benchmark includes: (1) Personalized Scene Generation, which places a given object in a scene that reflects a user's preferences and lifestyle, motivated by personalized product presentation; and (2) Personalized Creative Generation, which generates a novel image on a specified topic that is faithful to a user's aesthetic and visual identity, motivated by social media content creation. We further propose PEARL, which couples a multimodal reasoner with a frozen image generator in an interleaved reason-reflect loop optimized with differential data reward. Across both tasks, PEARL outperforms strong baselines, achieving an average improvement of 15% across personalization metrics.

0.23

When Ubiquitous Health Data Stops Helping: Patients' Experience of Breakdowns in the Data-Interpretation-Action Loop at the End of Life

cs.HC ·2026-10-16 ·Yibo Meng, Xinru Wang, Zhuoyan Li, Chengxi Zang, Zhuoran Lu +1 more
published similarity 0.56
Abstract · Accepted to Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Vol. 10, No. 4, 2026

Ubiquitous computing systems in healthcare often assume that greater data visibility improves awareness, interpretation, and action. In end-of-life care, however, this assumption warrants scrutiny. Through semi-structured interviews with 25 terminal-stage patients as primary informants and 8 clinicians as supplementary informants, we examine patients' descriptions of how they encountered, interpreted, acted on, and disengaged from state signals, trajectories, algorithmic outputs, and behavioral audits. Our analysis identifies three recurrent patterns in these descriptions. First, participants described repeated and unresolved sensemaking when visible data lacked explanatory pathways. Second, they described outputs they could understand but whose suggested actions did not fit their changing bodily capacities, care goals, or decision-making roles. Third, they described difficulty disengaging when data remained embedded across care environments. Rather than rejecting data altogether, patients called for less data exposure and a reorientation toward existential support. Based on this analysis, we situate data exposure as a central interaction problem in end-of-life ubiquitous computing and derive design implications for interpretive stability, care-context alignment, and existential support.

0.64