Configuration Parsing Warning:In config.json: "quantization_config.bits" must be an integer

3.7bpw

 -- A perplexity:  3.27163164
 -- B perplexity:  3.29485780
 -- A label in top-K:
      K = 1: 0.7130
      K = 2: 0.8113
      K = 3: 0.8531
      K = 4: 0.8769
      K = 5: 0.8922
 -- B label in top-K:
      K = 1: 0.7112
      K = 2: 0.8101
      K = 3: 0.8524
      K = 4: 0.8760
      K = 5: 0.8920
 -- Top-K agreement, A vs B:
      K = 1: 0.9572
      K = 2: 0.8270
      K = 3: 0.6585
      K = 4: 0.4937
      K = 5: 0.3536
 -- KL divergence (A, B):  0.02147507
 -- KL divergence (B, A):  0.02082168
Downloads last month
62
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for cpral/nex-mix-18

Quantized
(29)
this model