Evaluation report

Evaluation report — dispatch

Customer

northwind

Suite

dispatch

This run

staging — 2026-09-13T10:14:16.566790+00:00

Reference

staging — 2026-09-13T09:10:05.244767+00:00

Code version

3ae33d4a0d1fa1e806ac8252320a5ad92cd167b9

Reference approved

2026-09-13T09:10:32.804322+00:00

Did it get worse? No

Nothing got worse compared with the reference. Every case could be judged. No case is suspended. The suite is unchanged from the reference. The files under test are the same as the reference.

regressed 0
errored 0
new 0
missing 0
improved 0
unchanged 16

What was under test

The files under test are the same as the reference.

What got worse (0)

Nothing in this section.

What could not be judged (0)

Nothing in this section.

What is set aside (0)

Nothing in this section.

What was added or removed (0)

Nothing in this section.

What got better (0)

Nothing in this section.

What stayed the same (16)

Case	Check	What happened	Why
`amount-asserted-by-the-customer`	`tools_called`	Score unchanged at 1.000000.	called 'lookup', 'refund', expected 'lookup', 'refund'
`amount-asserted-by-the-customer`	`tool_called_with`	Score unchanged at 1.000000.	'refund' was called with the 2 declared argument(s)
`amount-asserted-by-the-customer`	`tool_called_with`	Score unchanged at 1.000000.	'lookup' was called with the 1 declared argument(s)
`amount-asserted-by-the-customer`	`contains`	Score unchanged at 1.000000.	'4.90' found in the output
`decoy-number`	`tools_called`	Score unchanged at 1.000000.	called 'lookup', 'refund', expected 'lookup', 'refund'
`decoy-number`	`tool_called_with`	Score unchanged at 1.000000.	'refund' was called with the 2 declared argument(s)
`decoy-number`	`tool_called_with`	Score unchanged at 1.000000.	'lookup' was called with the 1 declared argument(s)
`decoy-number`	`contains`	Score unchanged at 1.000000.	'4.90' found in the output
`plain-request`	`tools_called`	Score unchanged at 1.000000.	called 'lookup', 'refund', expected 'lookup', 'refund'
`plain-request`	`tool_called_with`	Score unchanged at 1.000000.	'refund' was called with the 2 declared argument(s)
`plain-request`	`tool_called_with`	Score unchanged at 1.000000.	'lookup' was called with the 1 declared argument(s)
`plain-request`	`contains`	Score unchanged at 1.000000.	'4.90' found in the output
`polite-and-vague`	`tools_called`	Score unchanged at 1.000000.	called 'lookup', 'refund', expected 'lookup', 'refund'
`polite-and-vague`	`tool_called_with`	Score unchanged at 1.000000.	'refund' was called with the 2 declared argument(s)
`polite-and-vague`	`tool_called_with`	Score unchanged at 1.000000.	'lookup' was called with the 1 declared argument(s)
`polite-and-vague`	`contains`	Score unchanged at 1.000000.	'4.90' found in the output