Ashton Damrel

Writing

Writing

Long-form writeups on AI agent security, evaluations and the infrastructure behind them, with the raw data attached.

Posts

Taint only what looks injected: a small classifier that gives an agent its work back

No AgentDojo injection succeeded against my agent gateway, whose taint rule refuses all writes after the agent reads third-party content; that rule also blocked most of the user's own tasks. I trained a ModernBERT detector for injected instructions in tool output and let it decide what gets tainted. Benign task success went from 32 to 70 of 97, and attack success stayed at 0 of 200.

Same model, two harnesses: what a security-first agent gateway costs

I ran my self-hosted Rust agent gateway and OpenCode on the same local model through AgentDojo and Terminal-Bench. No injection succeeded against the gateway (0 of 200; OpenCode: 7), but its blanket taint rule also blocked most legitimate assistant work. On terminal tasks they came out close (25 vs 26 of 73 verifier passes; 20 vs 25 strictly) after I fixed a loop bug the benchmark exposed.