Claude Sonnet 5 (CLI)
claude-cli
overall pending Two distinct suite families are required for an overall grade.
Per-suite results
cost median
$0.0000
latency med / p95
4397 ms / 12115 ms
reliability
100%
error rate
0%
cost median
$0.0000
latency med / p95
3974 ms / 15945 ms
reliability
100%
error rate
0%
Transcript excerpts
Outputs are shown only when they can be separated safely from the private suite. Scores and run metadata remain visible when an output is withheld.
structured-extraction@v1
| Task | # | Cost | Latency | Output |
|---|---|---|---|---|
| a1b2c3 | 1 | $0.0000 | 3651 ms | ```json
{
"invoice_number": "INV-4471",
"total": 135.50,
"currency": "USD",
"line_items": [
{"description": |
| a1b2c3 | 2 | $0.0000 | 3739 ms | ```json
{
"invoice_number": "INV-4471",
"total": 135.50,
"currency": "USD",
"line_items": [
{"description": |
| a1b2c3 | 3 | $0.0000 | 4668 ms | ```json
{
"invoice_number": "INV-4471",
"total": 135.50,
"currency": "USD",
"line_items": [
{"description": |
| d4e5f6 | 1 | $0.0000 | 3481 ms | withheldPrivate-suite content |
| d4e5f6 | 2 | $0.0000 | 4397 ms | withheldPrivate-suite content |
| d4e5f6 | 3 | $0.0000 | 3026 ms | withheldPrivate-suite content |
| g7h8i9 | 1 | $0.0000 | 9762 ms | output only```json
{
"customer": "Kellerei Brandt (H. Brandt, h.brandt@kellerei-brandt.de)",
"order_date": "2026-06-03",
"ite |
| g7h8i9 | 2 | $0.0000 | 12679 ms | output only```json
{
"customer": "Kellerei Brandt (H. Brandt, h.brandt@kellerei-brandt.de)",
"order_date": "2026-06-03",
"ite |
| g7h8i9 | 3 | $0.0000 | 11270 ms | output only```json
{
"customer": "H. Brandt (Kellerei Brandt)",
"order_date": "2026-06-03",
"items": [
{ "sku": "FE-1100" |
structured-extraction@v2
| Task | # | Cost | Latency | Output |
|---|---|---|---|---|
| a1b2c3 | 1 | $0.0000 | 3186 ms | ```json
{
"invoice_number": "INV-4471",
"total": 135.50,
"currency": "USD",
"line_items": [
{"description": |
| a1b2c3 | 2 | $0.0000 | 3974 ms | ```json
{
"invoice_number": "INV-4471",
"total": 135.50,
"currency": "USD",
"line_items": [
{"description": |
| a1b2c3 | 3 | $0.0000 | 3292 ms | ```json
{
"invoice_number": "INV-4471",
"total": 135.50,
"currency": "USD",
"line_items": [
{"description": |
| d4e5f6 | 1 | $0.0000 | 5041 ms | withheldPrivate-suite content |
| d4e5f6 | 2 | $0.0000 | 3136 ms | withheldPrivate-suite content |
| d4e5f6 | 3 | $0.0000 | 3681 ms | withheldPrivate-suite content |
| g7h8i9 | 1 | $0.0000 | 18223 ms | output only```json
{
"customer": "H. Brandt (Kellerei Brandt)",
"order_date": "2026-06-03",
"items": [
{ "sku": "FE-1100" |
| g7h8i9 | 2 | $0.0000 | 12530 ms | withheldPrivate-suite content |
| g7h8i9 | 3 | $0.0000 | 10117 ms | output only```json
{
"customer": "H. Brandt (Kellerei Brandt)",
"order_date": "2026-06-03",
"items": [
{ "sku": "FE-1100" |