RedAct: Redacting Agent Capability Traces for Procedural Skill Protection
Abstract
Users rely on execution traces to observe agent behavior, diagnose failures, and ensure accountability. These traces contain rich procedural detail, including tool invocations, intermediate decisions, and error-recovery logic. Yet this detail can expose private procedural skills, allowing downstream methods to recover key formulas, thresholds, and strategies without access to model weights or skill files. To quantify this risk and evaluate protection, we construct CapTraceBench, a benchmark of 75 specialized long-horizon tasks and 154 curated skills across seven domains. We also introduce RedAct https://github.com/XuShuwenn/RedAct, a protected trace release framework that localizes protected key information, rewrites traces while preserving verifier-critical evidence, and embeds behavioral watermarks for downstream provenance analysis. Across representative trace reuse methods, RedAct reduces normalized skill transfer (NST) from 44.7--67.1\% on raw traces to below the no-skill baseline, while preserving audit evidence. Its standalone behavioral watermarks reach 93.6--100.0\% true detection with a false alarm rate of at most 1.9\%. These results frame public agent traces as security interfaces and show that selective redaction can reduce procedural capability leakage without removing audit evidence.
Community
π‘οΈ RedAct: Protecting agent traces from procedural skill leakage
What if the traces released for transparency and debugging also become tutorials for copying an agentβs private skills? π
Agent traces can reveal formulas, thresholds, tool choices, validation routines, and recovery strategies β enough for downstream agents to reconstruct reusable procedures.
To study this risk, we introduce CapTraceBench:
π§© 75 long-horizon tasks
π οΈ 154 curated skills
π 7 professional domains
π€ Multiple agent backends and trace-reuse attacks
We then propose RedAct, a protected trace-release framework that:
π locates sensitive procedural details
βοΈ selectively rewrites them
β
preserves audit-critical evidence
𧬠embeds behavioral watermarks for provenance
Across multiple reuse settings, raw traces yield 44.7β67.1% normalized skill transfer. RedAct pushes it below the no-skill baseline, while preserving 91.0β96.6% of audit evidence.
Its standalone watermarks further achieve 93.6β100.0% detection with at most 1.9% false alarms. π
Agent traces are not just logs β they are security interfaces.
π Project: https://xushuwenn.github.io/RedAct_Website/
π» Code: https://github.com/XuShuwenn/RedAct
π Paper: https://arxiv.org/abs/2606.10813
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper