InferScale-Sim / examples /validation_cases.schema.json
ArchitSharma's picture
Deepen InferScale simulation research workflow
ce2d64b
Raw
History Blame Contribute Delete
544 Bytes
{
"cases": [
{
"name": "replace-with-a-real-measured-case",
"config": {
"model": "Qwen2.5-3B",
"accelerator": "L4",
"quantization": "int8",
"request_rate_rps": 4,
"duration_s": 30,
"prompt_tokens_mean": 512,
"output_tokens_mean": 64
},
"measured": {
"p95_ttft_ms": 0,
"p95_e2e_ms": 0,
"goodput_rps": 0
}
}
],
"note": "Template only. Zero placeholders are not benchmark measurements and should be replaced before use."
}