28 Ways I Review Agents
Using the same approach as specification and verification I looked at how I review agents, i.e. what I comment on after they share an output. This page features the 28 review techniques I use. Some interesting ones: Show your style: I tell it why it doesn’t sound like me, and how I would have written it. Real example: “Still not in my style - revise more in line with these principles.” Pause and resume: Tell it not to exceed the usage limits. Real example: “We are at 96% usage of the 5h limit - so pause now and we can resume in a few hours.” More like this: Tell it what you liked and go in that direction. Real example: “Looks good. Give me 10 more.” Take the best of each: Give it other models’ output and pick the best from each. Real example: “Here is ChatGPT’s response. Take what’s better, drop what’s worse, follow up on new ideas this gives you, and revise your response.” Say “I meant…”: Clarify your real intent. “Sorry, I meant round off the 95% activity window in EACH namespace.” These are based on ~6.7K real responses. Skim through them and if you spot something interesting, test it out. If it works for you, share it with others.