make sure to check back in 3 months!
I have found unexpected shortcuts in my never-read-code-codebases. Like, 99 times out of 100, the agents follow rules in training, in system prompts, in user prompts. Enough to convince me that I don't have to watch closely
I gave it secret stores, and used harnesses with secure secret handling. But one day, I lost my own keys and the agent found the keys for me, hard-coded inside a little helper script it had written to make things more efficient for itself. A virtual equivalent of writing a password on a Post-It and pasting it to the back of the monitor
I don't know what the right lesson is. We can't hold on to the reins forever
The post this replies to
Terminus needs JavaScript to show replies and pictures.