realigned

PRESENTATIONS

D Niu Robert Yuen D Niu Robert Yuen

Detection in 2026 and beyond: Profiling Coding Agent Trajectories for Early Detection

A coding agent's final code tells you almost nothing about how it got there. Two agents can complete the same task with identical, review-passing output, while one of them quietly creates artifacts nobody can see and takes destructive actions along the way. The difference lives in the trajectory, not the final artifacts, like code diffs.

This talk argues that defenders should be profiling agent behavior rather than trying to build a perfect box around it, and walks through what happened when we tried to do this. We'll cover why every model needs its own behavioral baseline (there is no generic "coding agent" due to significant differences in models), why "bad" is irreducibly contextual, and the fake company we built- eight employees, a SaaS product, a year of history- to generate replayable trajectories.

The core question: how much lead time do you get before a coding agent session goes wrong? We'll share preliminary results pitting unsupervised anomaly detection against LLM-as-a-judge and rule-based engines, and be honest about what we still can't measure.

Read More