CORTEXA
← Browse
arxivcs.AI2026-06-27

Agent Safety Is Action Alignment

Shawn Li, Yue Zhao

Large language models increasingly act as agents: they call tools, move money, delete records, and send messages on a user's behalf. To keep them safe, practitioners imported the chatbot-era recipe (train the model to refuse unsafe inputs) into the agentic setting, and treat the resulting capability loss as a manageable ``alignment tax.'' We argue this is a \emph{category error}. Refusal is a primitive for \emph{content safety}, where the harm is in the model's output and is therefore a learnable function of it. Agentic harm is different in kind: it lies not in any output but in the relation between the authority an action exercises and the authority the user granted, which is absent from the text the model sees. Importing content-safety methods into this regime does not trade capability for safety; it pays capability and buys negative security. We support this with three lines of evidence spanning the autonomy spectrum: defense-trained models learn surface patterns rather than intent; the same training collapses multi-step agents before any threat appears while leaving them exploitable; and even undefended frontier models exceed granted authority under ordinary use. We conclude that action safety cannot be installed in weights. It must be expressed as \emph{least privilege}, enforced \emph{outside} the model at the action boundary, and evaluated as \emph{action alignment} (a relational, deployment-conditioned property) rather than a refusal score.

View free PDFSource page

Related papers

arxivcs.AIcs.CLcs.CR2026-07-22

JANUS: Foreseeing Latent Risk for Long-Horizon Agent Safety

Yuan Xiong, Linji Hao, Shizhu He, Yequan Wang, Lijun Li

Agent safety is moving from content moderation toward preventing operational failures before tool-using agents act. We propose Janus, a foresight-oriented framework for long-horizon agent safety that trains guards to anticipate delayed risks from partial trajectories. Janus synth…

View free PDFSource page
arxivcs.AIcs.CRcs.MA2026-07-08

Operational Reframing and Approval-Framed Delegation in Multi-Agent LLM Safety

Lifei Liu, Haoran Yu, Xiaochong Jiang, Su Wang, Pin Qian, Yihang Chen

Safety evaluations of multi-agent LLM systems often compare a direct prompt with a planner-executor pipeline and report the difference as a single "pipeline effect." We argue that this aggregate is difficult to interpret because it conflates three mechanisms: harmful intent may b…

View free PDFSource page
arxivcs.AIcs.CR2026-07-01

HARC: Coupling Harmfulness and Refusal Directions for Robust Safety Alignment

Shei Pern Chua, Hao Wu, Qianli Ma, Fangzhao Wu

Understanding how aligned LLMs internally represent safety is critical for diagnosing alignment vulnerabilities, as it explains why jailbreaks succeed and informs the design of robust alignment strategies. Prior work shows that aligned LLMs encode harmfulness and refusal as separ…

View free PDFSource page
arxivcs.CVcs.AIcs.LG2026-07-01

The Illusion of High Utility in Safety Alignment of Text-to-Image Diffusion Models

Adeel Yousaf, Soumik Ghosh, James Beetham, Amrit Singh Bedi, Mubarak Shah

Safety alignment of text-to-image (T2I) diffusion models aims to suppress harmful generations while preserving utility on benign prompts. Recent methods often appear to deliver high safety with high utility, but this conclusion rests largely on coarse global utility metrics (e.g.…

View free PDFSource page
arxivcs.AIcs.CV2026-07-07

Bridging Physical Reasoning and Task Generalization via Visual Action Outcome Reasoning Alignment

Han-Jun Ko, Jr-Jen Chen, Haobo Yuan, Hsin-Ying Lee, Tiancheng Shen, Ming-Hsuan Yang, et al.

Vision-language models (VLMs) struggle to generalize in interactive physical reasoning, particularly under unseen tasks and environments. Two key failure modes are prominent: hallucinated chain-of-thought (CoT) reasoning that contradicts physical reality, and misalignment between…

View free PDFSource page
arxivcs.AIcs.HCcs.LG2026-07-08

Feedback Manipulation Regularization: Enabling Offline Agent Alignment for Imitation Learning

Benjamin Poole, Minwoo Lee

Reinforcement learning (RL) research has increasingly shifted focus towards alignment, ensuring agents learn behaviors adhering to human values. While human demonstrations and feedback have proven crucial for alignment, existing approaches predominantly combine these signals usin…

View free PDFSource page