Safetensors
English
Russian
llama
vladislavkruglikov commited on
Commit
c422b67
·
verified ·
1 Parent(s): 0110619
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -50,9 +50,9 @@ We report our results on in-house dataset, representing LLM queries inside our c
50
 
51
  * Using 2x H100 80GB HBM in tensor parallel regime.
52
  * temperature equals 1.
53
- * speculative num steps parameter equals 4.
54
  * speculative Eagle topk parameter equals 1.
55
- * speculative num draft tokens parameter equals 5.
56
 
57
  | bs | tps w/o Eagle | tps w Eagle | Eagle acc len | Speedup |
58
  |----|---------------|-------------|---------------|----------|
 
50
 
51
  * Using 2x H100 80GB HBM in tensor parallel regime.
52
  * temperature equals 1.
53
+ * speculative num steps parameter equals 3.
54
  * speculative Eagle topk parameter equals 1.
55
+ * speculative num draft tokens parameter equals 4.
56
 
57
  | bs | tps w/o Eagle | tps w Eagle | Eagle acc len | Speedup |
58
  |----|---------------|-------------|---------------|----------|