CORTEXA
← Browse
arxivcs.AIstat.ME2026-07-17

Nonuniformity Principle in Human-AI Coworking

An Luo, Jie Ding

As generative AI is increasingly applied to automate multi-step and high-stake workflows, human judgment and involvement remain essential for ensuring the quality of AI-generated outputs. In practice, while it is desirable for human experts to provide oversight on AI regularly, often by reviewing intermediate outputs, giving feedback, making corrections, and steering subsequent steps, such oversight is constrained by the time and resources that humans can afford. This creates a tension between the need for human oversight and AI's efficiency in delivering more output with less intervention. An important but underexplored question, then, is how to optimally engage humans in human-AI coworking. This work was originally motivated by our empirical observation that in long AI workflows, human oversight often improves user satisfaction while reducing unnecessary rework and token consumption. From there, we formulate the problem of where to place oversight stages in human-AI coworking. Under reasonable assumptions, we then develop the nonuniformity principle, which states that the optimal schedule places oversight stages with non-decreasing gaps along the workflow. We empirically validate this principle in two common AI agent workflows: writing literature reviews and constructing websites.

View free PDFSource page

Related papers

arxivcs.AIstat.ME2026-07-23

Detecting LLM-Generated Tokens in Human--LLM Coauthored Text

Yangjun Lu, Hongyi Zhou, Fabian Spill, Kai Ye, Chengchun Shi, Jin Zhu

The rise of human-AI collaborative writing has created a growing need for fine-grained detection methods that support localizing likely LLM-generated content in mixed-authorship documents. Existing methods for detecting LLM-generated text mainly focus on document-level classifica…

View free PDFSource page
arxivstat.MEcs.AIecon.EM2026-06-29

HERO: Improving the Reliability and Sensitivity of Generative Model Evaluation Using Historical Data

Xinrui Ruan, Zhenyu Zhao, Waverly Wei, Yueshan Zhang, Zeyu Zheng, Sui Huang, et al.

Reliable generative AI models critically rely on expert human annotations to evaluate output quality, yet these "gold" labels are expensive to collect and limited in quantity. Organizations thus often turn to collecting vast but noisy "silver" labels from crowdsourced workers or…

View free PDFSource page
arxivstat.MEcs.AIcs.LGstat.ML2026-07-15

Verifying formulas for interventional distributions

Francesco Freni, Leonard Henckel, Sebastian Weichwald

We formalize verification in causal graphical models: deciding whether a given observational formula identifies a target interventional distribution. This opens a problem complementary to identification, asking not whether any identifying formula exists, but whether the given for…

View free PDFSource page
arxivcs.CLcs.AIquant-phstat.ME2026-07-19

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat

Pilsung Kang

Human survey respondents exhibit question-order effects that satisfy the QQ (quantum question) equality, an a priori, parameter-free prediction of the projective quantum question-order model. We develop the QQ equality into an audit criterion for sequential judgments of autoregre…

View free PDFSource page
arxivstat.MEcs.AImath.ST2026-07-10

Geometric mean-based pairwise comparison method with the reference values -- statistical approach

Konrad Kułakowski, Jacek Szybowski

For many years, the pairwise comparison method has been widely used for decision-making involving experts. The best-known example of this method is the Analytic Hierarchy Process (AHP). In this now classic approach, the weights of alternatives are calculated using the principal e…

View free PDFSource page