Papers
arxiv:2606.23991

Critique of Agent Model

Published on Jun 22
ยท Submitted by
Mingkai Deng
on Jun 24
Authors:
,
,

Abstract

True artificial agency requires internalized structures for goals, identity, decision-making, self-regulation, and learning, distinguishing autonomous systems from task-specific ones.

What is an agent? What constitutes agency? With the rise of Large Language Model (LLM) systems marketed as ``coding agents'', ``AI co-scientists'', and other ``agentic" tools that promise to drive up productivity, and at the same time, ``existential" concerns such as AI escaping human control with destructive power under a speculative ``machine agency" against humans, it has become essential to clarify where automation ends and agency begins, both for building capable systems and for understanding whether and what to fear. Drawing on Descartes' grounding of agency in independent thought, and on portrayals of autonomous beings in science fiction, we survey the current landscape of AI agents, and analyze agent architectures along five dimensions: goal, identity, decision-making, self-regulation, and learning. Specifically, we argue that genuine agency requires these structures to be internalized within the system itself rather than assembled through external scaffolding. This distinction between agentic systems, whose competence resides in engineered workflows, and agentive systems, whose capabilities (including social interaction) arise endogenously, defines the boundary between systems designed for prescribed tasks, and those capable of operating in the open world with true autonomy. Building on this analysis, we propose the Goal-Identity-Configurator (GIC) architecture for a general-purpose agent model, combining hierarchical goal decomposition, identity evolution, simulative reasoning grounded in a separately trained world model, learned self-regulation, and self-directed learning from both real and simulated experience. Furthermore, we share insight on the auditability, controllability, and safety of agentive systems that possess greater autonomy and ``agency", but remain under human oversight.

Community

Paper submitter

Fable 5 and the upcoming GPT-5.6 promise exceptional "agentic" capabilities in software engineering and scientific research. Companies like Figure AI are racing towards humanoid robots.

We study a related but deeper question: what is the remaining ๐—ด๐—ฎ๐—ฝ between current systems and fully autonomous agents?

We formally analyze today's AI agents along five axes: ๐—ด๐—ผ๐—ฎ๐—น, ๐—ถ๐—ฑ๐—ฒ๐—ป๐˜๐—ถ๐˜๐˜†, ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป-๐—บ๐—ฎ๐—ธ๐—ถ๐—ป๐—ด, ๐˜€๐—ฒ๐—น๐—ณ-๐—ฟ๐—ฒ๐—ด๐˜‚๐—น๐—ฎ๐˜๐—ถ๐—ผ๐—ป, and ๐—น๐—ฒ๐—ฎ๐—ฟ๐—ป๐—ถ๐—ป๐—ด. We find that what separates these "agentic" systems from natural agents like you and me is whether capabilities arise from ๐—ฒ๐˜…๐˜๐—ฒ๐—ฟ๐—ป๐—ฎ๐—น ๐˜€๐—ฐ๐—ฎ๐—ณ๐—ณ๐—ผ๐—น๐—ฑ๐—ถ๐—ป๐—ด or ๐—ถ๐—ป๐˜๐—ฒ๐—ฟ๐—ป๐—ฎ๐—น ๐—ถ๐—ป๐—ถ๐˜๐—ถ๐—ฎ๐˜๐—ถ๐˜ƒ๐—ฒ, a distinction we formalize as ๐—ฎ๐—ด๐—ฒ๐—ป๐˜๐—ถ๐—ฐ vs. ๐—ฎ๐—ด๐—ฒ๐—ป๐˜๐—ถ๐˜ƒ๐—ฒ.

We propose the ๐—š๐—ผ๐—ฎ๐—น-๐—œ๐—ฑ๐—ฒ๐—ป๐˜๐—ถ๐˜๐˜†-๐—–๐—ผ๐—ป๐—ณ๐—ถ๐—ด๐˜‚๐—ฟ๐—ฎ๐˜๐—ผ๐—ฟ (๐—š๐—œ๐—–) architecture for general-purpose agent models that internalize all of the following: hierarchical goals, evolving identity, simulative reasoning via a separate world model, a learned configurator for self-regulation, and self-directed learning from real + simulated experience.

Better agents don't come from better harnesses; they come from models that can harness themselves.

Paper: https://arxiv.org/abs/2606.23991

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2606.23991
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2606.23991 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2606.23991 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2606.23991 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.