latent_dense_q8.bin / latent_dense_q4.bin re-uploaded — the previous D/U pair misbehaved in agent workloads

#3
by bupalinyu - opened
Edge0 org

We have replaced the latent D/U projections in both 120B repositories. If you pulled the pack before
today, please re-download the two files below.

What was wrong. The previous latent_dense_q8.bin / latent_dense_q4.bin pair had a defect that
only showed up in agent workloads — long multi-turn sessions with tool calls. Short chat looked fine,
which is why it went unnoticed at release. The routed experts were correct; the problem was in the
projections that map between the hidden space and the latent space.

What changed. Both files are rebuilt from the current agent-training step (step 6000). Nothing else
in the pack changed: same format, same size, same experts.bin, same skeleton and MTP. It is a drop-in
replacement, no config change.

file size sha256
latent_dense_q8.bin 2,673,868,800 1e82f0e02545734f…
latent_dense_q4.bin 1,415,577,600 9ec1974b83bd4bcf…

Both repositories (Edge0-120B-NVFP4 and Edge0-120B-q3k) now carry the same new pair.

How to update. The Hub keeps the same file names, so a cached copy will not refresh by itself —
delete the two files first, then download:

rm -f latent_dense_q8.bin latent_dense_q4.bin
huggingface-cli download Edge0/Edge0-120B-NVFP4 --include "latent_dense_*" --local-dir .
wanglamao pinned discussion

Sign up or log in to comment