CS Paper Radar

The Interface of Theseus: The Rise of Just-In-Time Interfaces

Michael S. Bernstein

cs.HC ·submitted 2026-09-06 18:23 UTC · v1
top venue

Abstract

Our community creates interfaces---pre-constructed, static artifacts. These interfaces are effortful to create, so we invest great effort and care into each of them. Yet the equilibrium is shifting: we can now construct nearly any software, bespoke, within moments. When construction is cheap, we may soon live in a future in which interfaces are constructed in real time. This is a world of just-in-time interfaces: rapid, discardable, on-demand interfaces tailored to our needs in the moment. Will our community still create traditional interactive systems in this world? Or will we create interface generators, ``interface.md'' guides for AI consumption? I argue that we ought to lean into a future of rapid, bespoke, on-demand interfaces.

Comment
UIST Visions 2026
DOI
10.1145/3830397.3841887

Closest papers

Nearest neighbours by meaning across the whole index.

Evolving Agent Interfaces

cs.AI ·2026-10-20 ·Saaket Agashe, Yuzhe Yang, Gonzalo Gonzalez-Pumariega, Bhuvan Chandra Koduru, Chih-Lun Li +3 more
positioncode/datacommunity pick similarity 0.58
Abstract

Computer-use agents are limited by the interfaces humans give them. An agent may type a spreadsheet cell by cell when a single line of code would do, or print all two thousand lines of a file through a shell to find one function. Both the interfaces and the knowledge of when to use each are built by hand, which cannot keep pace with new applications, workflows, and models. We argue that interface design should itself be an agent capability. We introduce Agent S4, an autonomous computer-use scientist that builds Evolving Agent Interfaces from task experience. A meta-agent examines task agents' trajectories on synthetic training tasks, without success labels, and constructs and revises interfaces and usage knowledge in a repository. Population-based evolution then selects which repositories to develop further by their performance on validation tasks the meta-agent never sees, favoring changes that generalize beyond the seen tasks. On OSWorld V2, Agent S4, with Qwen3.8-27B and the evolved repository of interfaces, sets a new state of the art in open-source computer-use agents, reaching 21.3% binary score, 3.8 times the same model with fixed interfaces. This is above both GPT-5.5 (13.0%) and Claude Opus 4.8 (20.6%), at about 4.3% and 1.5% of their respective costs. On ScienceBoard, the evolved interfaces improve the success rate from 41.4% to 58.6% with the same model. These results suggest that useful interfaces can be evolved from experience, making autonomous interface design a source of improvement complementary to advances in models and harnesses. We open-source our code at https://github.com/simular-ai/agent-s.

0.60

Too cheap to matter: over abundant microchips, and what we can learn from them

cs.CY ·2026-08-18 ·Adrian Friday, Fieke Jansen, Gauthier Roussilhe, Srinjoy Mitra
published similarity 0.56
Abstract · 5 pages, 10 figures. Accepted at the 2nd International Workshop on Low Carbon Computing (LOCO 2026), Lancaster University, United Kingdom, 1…

Ultra-cheap microchips (<$1) are so abundant they've become a 'smart material' integrated and disposable in everyday things. Hidden in our everyday products, we have entirely lost sight of them, yet they account for the vast majority of the >400 billion pieces sold each year. As new technology nodes are released, older ones (from as far back as the 1980s) continue to be produced. These microchips do not exist on their own; they are packaged into every possible item to bring 'smartness', necessary or not; this simultaneously increases their obsolescence. While the latest ICs power our data centres and AI revolution that draws our attention, what about technology so disposable that it has become entirely invisible? We report on our workshop at ICT4S exploring these devices' true costs, and pose challenges to the LOCO community to push back on this system, and develop the skills necessary to create lasting technology and avoid further e-Waste.

0.40

Intelligent Interaction Techniques (IIxT) - Proposal

cs.HC cs.AI ·2026-09-14 ·Brad A. Myers
similarity 0.55
Abstract

Interaction techniques (IxTs) are the low-level, reusable components out of which user interfaces are designed, including menus, scroll bars, text input fields, and also copy-paste, text-entry, and selecting objects. The IxTs for graphical user interfaces (GUIs) were well established in the 1980s, with relatively minor additions and tweaks for smartphones in the 2000s. Most of today's AI user interfaces involve a chat window, which is an excellent interaction for some tasks, but is generally considered separate from the GUI IxTs. I argue for making the IxTs themselves more intelligent, so users can freely mix modalities, even within the same interaction. This will require research into new IxTs, and also into the infrastructure that will enable these intelligent IxTs (IIxTs) to be built. There are also significant security, privacy and economic implications to this vision.

0.24

Automating the Application of HCI Principles: Skills for On-Demand UI Construction, the Human-AI Space to Think, and the Future of HCI

cs.HC cs.AI ·2026-10-01 ·Nathan Conklin, Miranda Capra, Chris North
similarity 0.55
Abstract

Human-computer interaction (HCI) is in the middle of a transition: large language models can now generate functional user interfaces (UIs) on demand from natural-language task descriptions. A user explains what they are trying to accomplish, and the system materializes a working interface to support it. This capability already exists in systems such as Claude and ChatGPT and continues to grow in fidelity as the underlying models improve. The next step along this trajectory is to move from interfaces that are merely generated to interfaces that are generated well. We propose a framework in which the dialogue between user and artificial intelligence (AI) becomes a Space to Think: a shared, structured cognitive workspace in which task decomposition produces an on-demand user interface as an extension of the user's thinking rather than as a separate artifact. Within this paradigm, classical HCI design knowledge (Nielsen's heuristics, Norman's affordance prescriptions, Web Content Accessibility Guidelines (WCAG) success criteria, cognitive-load constraints, and mixed-initiative principles) is encoded as skills: machine-readable skill.md files that the generating agent loads at runtime as software engineering tools. Skills turn HCI design knowledge into declarative, inspectable, version-controlled, and editable artifacts owned by the HCI community itself so that accessibility, learnability, and consistency become properties of a generative process rather than properties of a finished product. We outline a research agenda depicting a future where the HCI field transitions from today's design and knowledge heuristic checklist towards a future where the craft becomes machine-readable, executable, and open.

0.13

A-JIT: Agentic Just-In-Time Software Construction

cs.SE cs.AI ·2026-09-09 ·Mark Marron, Earl T. Barr
similarity 0.55
Abstract · Technical report for presentation at VMIL 2026

Traditional software delivery assumes a static paradigm: code is constructed prior to execution and deployed as a fixed artifact. We present Agentic Just-In-Time Software Construction (A-JIT), a paradigm that replaces static binaries with dynamic, software systems that can perpetually evolve to meet changing demands. In A-JIT, an application is an integrated assembly comprising code, a runtime harness, and an embedded AI agent that continuously observes system usage and live execution traces. Much like a traditional JIT compiler specializes machine code to runtime execution paths, A-JIT specializes software logic, workflows, and tool interfaces to meet the specific needs of the end-user. By integrating synthesis directly into the ambient application lifecycle, A-JIT enables applications to dynamically construct missing implementations, generate new capabilities on the fly, and continuously adapt to end-user behavior. We demonstrate how this model supports trace-driven human-AI co-construction and opens a new design space for adaptive, self-evolving software.

0.07

Bring Buttons Back: Physical Interfaces for the Age of Automation

cs.HC ·2026-09-13 ·David Goedicke, Donald Degraen, Tom Igoe, David Sirkin, Wendy Ju +1 more
similarity 0.51
Abstract · 6 Pages, 7 figures, article

As AI starts to permeate everyday life, deployment focuses on embedding intelligence in the background, abstracting away controls, and leaving automated decision-making opaque, with few obvious opportunities for human intervention. Where interfaces remain, design has drifted toward abstract, screen-based control, replacing material interaction with menu navigation. These shifts weaken the coupling between human action and system state, eroding operators' ability to understand, anticipate, and intervene in automated systems. We introduce Physically Stateful Interfaces (PSIs), a design concept that re-imagines traditional controls, such as buttons, switches, and knobs, as actuated, bidirectional interface elements. Three foundational behaviors, Self/Reset, Resist/Hide, and Assert/Unhide, unify affordance, feedforward, and feedback into a single interaction point. Rather than static inputs whose impact and consequences must be read elsewhere on a screen, PSIs position physical controls as shared mediators between automated systems and human operators. As automated systems become increasingly capable, their interfaces need to be deliberately designed to center human agency, supporting deliberate choice while keeping automation legible, contestable, and overrideable.

0.24

The Systems Paper is Dead. Long Live the Systems Paper

cs.HC ·2026-08-25 ·Bjoern Hartmann
top venueunusual similarity 0.51
Abstract · Extended abstract for the UIST 2026 vision talk of the same title

The way we structure, conduct, and write up interactive systems research in UIST papers rests on assumptions about constraints that may no longer hold today. What should an impactful UIST paper look like when building working systems is no longer hard? I argue that it should look different, and that we should ask more of our papers once implementation stops being a bottleneck.

0.68

Designing UIs with GenAI: Understanding the Use, Benefits, and Limitations of Prompt-to-Design Generators

cs.HC ·2026-11-09 ·Jingzhou Ye, Yao Li, Xueqiang Wang
similarity 0.51
Abstract

The integration of generative AI (GenAI) into user interface (UI) design has led to prompt-to-design generators (P2dGens), tools that enable designers to create UI prototypes from textual prompts efficiently. Despite their growing adoption, little is known about how designers use these tools in everyday practice, their benefits, and limitations. We conducted semi-structured interviews with 17 UI designers to investigate P2dGens use, focusing on workflow integration, attitudes toward generator-assisted design, and the organizational climate. Findings show that designers primarily use P2dGens as ideation accelerators rather than end-to-end solutions, and they adopt a variety of individual and collaborative prompting strategies. Designers expressed complex attitudes, noting gains in efficiency and inspiration while also highlighting concerns about loss of personal creativity and design quality. We also observed emerging governance practices and varying attitudes within organizations toward P2dGens. These insights illuminate how P2dGens reshape UI design workflows and contribute to understanding human-AI collaboration in UI design.

0.27