[gdnoff1-short] rep0 c= 1 ok=1/1 degen=0 per-stream=130.5 tok/s agg=130.5 wall-agg=123.6 chunkTPOT=31.62ms accept=0.623 ttft=117ms prefill=1145tok/s prompt=134 tokens=256 chunks=63
[gdnoff1-short] rep1 c= 1 ok=1/1 degen=0 per-stream=84.0 tok/s agg=84.0 wall-agg=81.3 chunkTPOT=31.68ms accept=0.338 ttft=112ms prefill=804tok/s prompt=90 tokens=256 chunks=97
[gdnoff1-short] rep2 c= 1 ok=1/1 degen=0 per-stream=108.0 tok/s agg=108.0 wall-agg=103.3 chunkTPOT=31.45ms accept=0.480 ttft=117ms prefill=744tok/s prompt=87 tokens=256 chunks=76
[gdnoff1-short] rep3 c= 1 ok=1/1 degen=0 per-stream=85.6 tok/s agg=85.6 wall-agg=82.9 chunkTPOT=31.40ms accept=0.341 ttft=110ms prefill=794tok/s prompt=87 tokens=256 chunks=96
[gdnoff1-short] SUMMARY {"1": {"per_stream": 102.02750251907926, "agg": 102.02750251907926, "accept": 0.4452833191850594, "ttft_ms": 113.86158849927597, "prefill_tok_s": 871.8178853593556, "degenerate": 0}}
Traceback (most recent call last):
  File "/workspace/tools/bench/bench_http.py", line 233, in <module>
    asyncio.run(main())
  File "/usr/lib/python3.12/asyncio/runners.py", line 194, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/asyncio/base_events.py", line 687, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/workspace/tools/bench/bench_http.py", line 229, in main
    Path(a.out).write_text(json.dumps(payload, indent=1))
  File "/usr/lib/python3.12/pathlib.py", line 1049, in write_text
    with self.open(mode='w', encoding=encoding, errors=errors, newline=newline) as f:
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/pathlib.py", line 1015, in open
    return io.open(self, mode, buffering, encoding, errors, newline)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
PermissionError: [Errno 13] Permission denied: '/tmp/gdnoff1-short.json'
