CORTEXA
← Browse
arxivcs.HCcs.CY2026-07-20

Informal Learning Emerges in Everyday Human-LLM Interaction

Zixin Chen, Haotian Li, Ziang Xiao, Huamin Qu, Xing Xie

As LLMs become increasingly capable of completing tasks for users, a central concern is that everyday AI use may become primarily cognitive offloading, eroding the opportunities through which people develop their own capabilities. We analyse large-scale human--LLM conversations to ask whether informal learning behaviors also emerge in this setting: whether users engage in exchanges in ways that preserve opportunities to learn. Across 128,569 naturalistic conversations, we translated learning-science constructs into turn-level behavioural signatures. Cognitive engagement, users' cognitive effort as reflected in the exchange, appeared in 31.9% of 491,685 user turns, whereas constructive engagement, the deepest observable form of learning-oriented engagement, appeared in 4.9%, showing that deeper sense-making was recurrent but selective. Our study further identifies factors associated with these forms of engagement. Scaffolded assistant support consistently marked richer constructive participation, with associations varying by user framing, task ecology, support form, timing and prior user state. Together, these findings show that everyday human--LLM interaction is not only answer delivery or cognitive offloading; it also contains measurable, selective and conditionally organized behavioural signatures of informal learning. They shift AI evaluation from answer-delivery efficiency toward the preservation of cognitive opportunities for users to reason, test ideas and construct understanding in the course of everyday problem-solving.

View free PDFSource page

Related papers

arxivcs.HCcs.CY2026-07-02

Doom Researching: A Conceptual Framework for Repetitive AI-Assisted Information Seeking, Cognitive Offloading, and the Illusion of Knowing

Santosh Premi Adhikari

Generative artificial intelligence (GenAI) systems such as ChatGPT, Claude, and Gemini have made information seeking faster, more conversational, and more cognitively comfortable. These affordances can support learning and productivity, but they can also encourage a repetitive pa…

View free PDFSource page
arxivcs.HCcs.AIcs.CY2026-06-28

LLMography: Transforming Human-AI Conversations into Traceability, Oversight, and Auditability Indicators

Mohammed Bousmah

The growing use of Large Language Models (LLMs) in education, software engineering, academic writing, and technical documentation raises a key question: how can we evaluate not only AI-assisted outputs, but also the interaction process that produced them? Current debates often fo…

View free PDFSource page
arxivcs.SEcs.AIcs.CYcs.HC2026-07-07

Agents That Teach: Towards Designing Incidental Learning Back into AI-Assisted Software Development

Rohit Mehra, Samdyuti Suri, Prithviraj K Tagadinamani, Kapil Singi, Vikrant Kaulgud, Adam P. Burden

AI coding agents are rapidly reshaping how software is built, with developers increasingly delegating substantial coding tasks to autonomous agents in pursuit of higher productivity. While these gains are real, they come at the cost of incidental learning. Developers historically…

View free PDFSource page
arxivcs.SEcs.AIcs.CYcs.HC2026-07-07

Prompt Coach: An Empirical Evaluation of an Agentic Tutor for Learning Prompt Engineering in Software Development

Rohit Mehra, Kapil Singi, Vikrant Kaulgud, Vibhu Saujanya Sharma, Swapnajeet Gon Choudhury, Swati Sharma, et al.

Prompt engineering has emerged as a critical yet undertaught skill for software developers, one that traditional learning approaches are ill-equipped to support given its evolving, interactive, and context-dependent nature. In this paper, we introduce Prompt Coach (PC), an agenti…

View free PDFSource page
arxivcs.HCcs.AIcs.CY2026-06-26

Generative AI Literacy Training Improves Intelligence Analysts' Discrimination of Real and AI-Generated Images

Negar Kamali, Candice Rockell Gerstner, Jessica Hullman, Matthew Groh

Across social and online platforms, people are increasingly exposed to AI-generated images. As a consequence, the task of distinguishing AI-generated from authentic images is becoming a central challenge for information ecosystems. While humans perform better than chance, accurac…

View free PDFSource page
arxivcs.CLcs.CYcs.HC2026-07-06

Rating the Pitch, Not the Product: User Evaluations of LLMs Reflect Expectations More Than Performance

Robert Morabito, Tyler McDonald, Charitra Viswanath, Angel Hsing-Chi Hwang, Susanne Gaube, Jad Kabbara, et al.

Imagine two users interact with the same LLM. One has been told it is the cutting-edge flagship model; the other, an older, weaker model. They walk away with markedly different ratings of its usefulness and intelligence, yet they used the same model. In a controlled study, 162 pa…

View free PDFSource page