22.6 kB
philippyt's picture
updated CostPanel to include new hints for FLOPs, prefill, and memory breakdown. added calculations for weights, KV cache, and activations memory usage. set temperature state in RunPanel to 0 for reproducibility. new finding in README.
b52940c