Concurrent requests: 5
Avg. Input token length: 550
Avg. Output token length: 150
Avg. First-Time-To-Token: 5505.33ms
Avg. Thorughput: 132.8 tokens/sec
Avg. Latency: 23.46ms/token