README: add real end-to-end inference speed comparison (llama-cli, 3.3K-token prompt)

README.md

@@ -1,12 +1,3 @@
----
-library_name: llama.cpp
-tags:
-- llama.cpp
-- openpangu
-- gguf
-- moe
----
-
 # openPangu-2.0-Flash support for llama.cpp v0.7.0
 
 This repository contains a patch that adds support for **openPangu-2.0-Flash**
@@ -204,6 +195,25 @@ Reading these numbers:
   ~16 GiB of extra RAM, so `-nr` is usually the better choice.
 - The host is shared and measurements vary between runs (see the ±).
 
+### Real inference (llama-cli end-to-end)
+
+Actual generation with a real prompt (3,271 tokens of English text),
+`llama-cli -c 8192 -n 128 -t 16 --no-warmup -st`, two runs each
+(prompt eval / generation speed as reported by llama-cli):
+
+| configuration | prompt eval | generation |
+|---------------|------------:|-----------:|
+| original fork, `-nr` | 29.7 / 28.9 t/s | 6.1 / 6.1 t/s |
+| this port, `-nr` | 41.0 / 41.0 t/s | 6.0 / 6.0 t/s |
+| this port, default (AMX repack) | 37.7 / 38.1 t/s | 5.6 / 5.5 t/s |
+
+- real prompt processing is ~**+40 %** faster than the original fork
+  (+29 % in the default AMX repack configuration)
+- generation with a ~3K-token context is ~6 t/s in all configurations
+  (the DSA indexer adds per-token work over the cached context, so this is
+  lower than the tg128 llama-bench numbers on a fresh 128-token run)
+- run-to-run variance on this host is small for these end-to-end runs
+
 ### MTP (self-speculative decoding)
 
 Same prompt, `llama-cli -n 128 -nr`: