DATONG AI大同

Can one AI agent check another agent's work?

Yes, but don't simply let two AIs read and critique each other's work. A test system works better: whatever rules can check, rules check; wherever business judgement is needed, the people who do the work every day set the standard. Then you improve the agent based on the test results.

Deutsch 中文

A question from a training session

Recently DATONG AI ran a training session at a company on moving from using AI in a chat window to letting an agent do the work directly. After the hands-on part, a participant from the sales team asked: can a second agent check what the first one did?

It is the right question. In day-to-day work, whatever an agent delivers has to be checked, by a person or by a fixed mechanism. What matters is how.

Why not just let one AI review the other?

When one agent reads another agent's views, strategy, code or judgement, one of two things tends to happen. The reviewer nitpicks: it always finds something, even when there is no real problem. Or the agent under review adds more and more safeguards to protect itself, and its output becomes more and more cautious.

On top of that, some mistakes are caught instantly by a simple rule, such as whether a number or a format is right. Handing that to an expensive model to “think about” is a waste. A thermometer tells you whether someone has a fever; you don't need a panel of three specialists. In our own projects we have found that letting agents review each other mostly just burns tokens.

Option A: AIs review each otherAgent 1Agent 2always finds something, even with no real problemthe reviewed agent grows ever more cautiousan expensive model “thinks” about rule errorsOption B: test first, then improveAgent delivers a result1Rules check: automatic, every time2Checklist: the team sets the standard3Test results as evidenceAdjust instructions, test again
Two ways to check: mutual review goes in circles, tests give evidence you can act on.

Example: emails to customers

The participant was thinking about customer emails. In the training we break it down together:

  • What rules can check: Are the customer's name and company right? Do prices and delivery dates match the quote? Is the attachment there? In German, is the formal “Sie” used where it should be? These become check rules that run on every email automatically, with no model needed to judge.
  • What needs business judgement: Is the tone right? Does it sound like our company? Will the customer understand the wording? Does it promise too much? Only people who write to customers every day can judge this. So participants take emails they wrote themselves and consider good, and turn “good” into a few points that can be ticked off.
  • Then the agent writes for a set of real situations, and the results are checked point by point. Where problems keep recurring, the agent's instructions are adjusted.

A second AI can help here, but as someone ticking off the sales team's checklist, not as a free-ranging critic. For more demanding roles and tasks, testing is done in layers: format and facts first, then business judgement, and finally the effect in the real workflow.

1Format and factsrulesname, price, delivery date, attachmentwritten as rules, checked on every email2Business judgementteam's standardtone, style, wording, no overpromisingchecklist from sales; AI only ticks it off3Real workfloweffectrun it in daily work for a whilelook at the effect, then fix what matters
Customer emails as an example: test in three layers, cheapest and most certain first.

Why the people doing the work set the standard

Whether an agent is too cautious, or has drifted away from the actual business goal, can only be judged by the people who do the work every day. Outside consultants, IT, even management do not necessarily know better what a good follow-up email looks like. The logic is not hard to learn; many people simply don't think of it at first because they have never programmed and have little experience with AI. That is why, in DATONG AI's training, participants work out this step themselves: what to test and how.

When it is not worth it

For one-off work that never leaves the company, such as your own meeting notes, a quick look is enough. A test system pays off for work that repeats daily or weekly and where a mistake affects customers or money.

DATONG AI is a team in Germany that builds and runs AI-powered automation for small and mid-sized companies and trains their staff. Contact