bmah-dmx commited on
Commit
fd5ad20
·
verified ·
1 Parent(s): 7dc5a29

Delete README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -50
README.md DELETED
@@ -1,50 +0,0 @@
1
- ---
2
- model-index:
3
- - name: opt-125m
4
- results:
5
- - task:
6
- type: text-generation
7
- dataset:
8
- name: Wikitext
9
- type: wikitext
10
- metrics:
11
- - type: perplexity (BASELINE)
12
- value: 31.94644314710864
13
- - type: perplexity (BASIC)
14
- value: 32.05778110592746
15
- ---
16
- This is a d-Matrix functional reference of the OPT-125M model.
17
- The reference provides the following functional *configurations*:
18
- Configuration | Explanation
19
- :-- | :--
20
- **`BASELINE`** | a reference functionally equivalent to the original model
21
- **`BASIC`** | all linear algebraic operands quantized to `BFP16-64`, and all other operations transformed to approximated kernel simulations
22
-
23
-
24
- ### Usage
25
-
26
- Install d-Matrix [Dmx_Compressor](https://github.com/d-matrix-ai/dmx-compressor) first.
27
- ```sh
28
- pip install dmx_compressor
29
- ```
30
-
31
- The following is an example model and its evaluation.
32
-
33
- ```sh
34
- pip install lm-eval
35
- ```
36
-
37
- ```python
38
- from dmx.compressor import config_rules
39
- from dmx.compressor.modeling import DmxModel
40
- import lm_eval
41
-
42
- model_args = f"pretrained="d-matrix/opt-125m",trust_remote_code=True"
43
-
44
- lm = lm_eval.api.registry.get_model("hf").create_from_arg_string(model_args, {"batch_size": 1})
45
-
46
- # Transform the model with DMX
47
- lm._model = DmxModel.from_torch(lm._model).to_basic_model() # Using BASIC configuration
48
-
49
- evaluation_results = lm_eval.evaluate(lm, lm_eval.tasks.get_task_dict([task_name]) # Assign desired task to task_name, i.e. "wikitext"
50
- ```