Configuration Parsing Warning:In config.json: "quantization_config.bits" must be an integer

EXL3 quant of Nex-N2-Pro 397B.

 -- A perplexity:  3.27265013
 -- B perplexity:  3.30910204
 -- A label in top-K:
      K = 1: 0.7131
      K = 2: 0.8115
      K = 3: 0.8530
      K = 4: 0.8766
      K = 5: 0.8923
 -- B label in top-K:
      K = 1: 0.7104
      K = 2: 0.8096
      K = 3: 0.8523
      K = 4: 0.8758
      K = 5: 0.8923
 -- Top-K agreement, A vs B:
      K = 1: 0.9429
      K = 2: 0.7775
      K = 3: 0.5781
      K = 4: 0.4015
      K = 5: 0.2652
 -- KL divergence (A, B):  0.03947007
 -- KL divergence (B, A):  0.03772779
Downloads last month
52
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for cpral/nex-mix-13

Quantized
(29)
this model