== Target ============================================================
  endpoint               http://127.0.0.1:8080
  target                 local (llama.cpp rig)
  auth                   none

== Health ============================================================
  GET /health            200 OK in 0 ms
  body                   {"status":"ok"}

== Model =============================================================
  served                 /home/xbill/models/gemma-4-E2B-it-qat-q4_0/gemma-4-E2B_q4_0-it.gguf (context 8192 tokens)
  using                  /home/xbill/models/gemma-4-E2B-it-qat-q4_0/gemma-4-E2B_q4_0-it.gguf (first model the server lists)

== Request ===========================================================
  POST                   http://127.0.0.1:8080/v1/chat/completions
  prompt                 In one sentence, what is a TPU?
  max_tokens             1024

== Answer ============================================================
  A TPU (Tensor Processing Unit) is a specialized hardware accelerator designed by Google specifically to speed up the computationally intensive matrix operations required for training and running machine learning models.

== Reasoning =========================================================
  length                 1327 chars
  1.  **Identify the core concept:** The user wants a one-sentence definition of a TPU (Tensor Processing Unit).
  ...

== Stats =============================================================
  finish_reason          stop
  prompt_tokens          25
  cached_tokens          7
  completion_tokens      330
  total_tokens           355
  latency (client)       4786 ms
  tokens/s (client)      69.0  (completion tokens / latency; includes network and prefill)

== Server timings (llama.cpp) ========================================
  predicted_ms           4615.20
  predicted_n            330
  predicted_per_second   71.29
  prompt_ms              147.38
  prompt_n               18
  ...

== Response ==========================================================
  id                     chatcmpl-rTO4HJkYHsrE4WisG2mileq6Jmxn0R4f
  model                  /home/xbill/models/gemma-4-E2B-it-qat-q4_0/gemma-4-E2B_q4_0-it.gguf
  system_fingerprint     b1-95ef7fc