Skip to main navigation Skip to search Skip to main content

Developer Interaction Patterns with Proactive AI: A Five-Day Field Study

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

7 Downloads (Pure)

Abstract

Current in-IDE AI coding tools typically rely on time-consuming manual prompting and context management, whereas proactive alternatives that anticipate developer needs without explicit invocation remain underexplored. Understanding when humans are receptive to such proactive AI assistance during their daily work remains an open question in human-AI interaction research. We address this gap through a field study of proactive AI assistance in professional developer workflows. We present a five-day in-the-wild study with 15 developers who interacted with a proactive feature of an AI assistant integrated into a production-grade IDE that offers code quality suggestions based on in-IDE developer activity. We examined 229 AI interventions across 5,732 interaction points to understand how proactive suggestions are received across workflow stages, how developers experience them, and their perceived impact. Our findings reveal systematic patterns in human receptivity to proactive suggestions: interventions at workflow boundaries (e.g., post-commit) achieved 52% engagement rates, while mid-task interventions (e.g., on declined edit) were dismissed 62% of the time. Notably, well-timed proactive suggestions required significantly less interpretation time than reactive suggestions (45.4s versus 101.4s, W = 109.00, r = 0.533, p = 0.0016), indicating enhanced cognitive alignment. This study provides actionable implications for designing proactive coding assistants, including how to time interventions, align them with developer context, and strike a balance between AI agency and user control in production IDEs.
Original languageEnglish
Title of host publicationIUI 2026 - Proceedings of the 2026 Conference on Intelligent User Interfaces
EditorsTsvi Kuflik, Styliani Kleanthous, Li Chen, Giulio Jaccuci, Alison Renner
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery (ACM)
Pages349-362
Number of pages14
ISBN (Electronic)9798400719844
DOIs
Publication statusPublished - 2026
Event2026 ACM International Conference on Intelligent User Interfaces, IUI 2026 - Paphos, Cyprus
Duration: 23 Mar 202626 Mar 2026

Conference

Conference2026 ACM International Conference on Intelligent User Interfaces, IUI 2026
Country/TerritoryCyprus
CityPaphos
Period23/03/2626/03/26

Keywords

  • Field Study
  • Human-AI Interaction
  • Intelligent User Interfaces
  • Large Language Models
  • Proactive Assistance
  • Software Development

Fingerprint

Dive into the research topics of 'Developer Interaction Patterns with Proactive AI: A Five-Day Field Study'. Together they form a unique fingerprint.

Cite this