Model loading took 9.8 GiB memory and 157.183441 seconds
GPU KV cache size: 315,974 tokens, Maximum concurrency for 16,384 tokens per request: 19.29x