MhaWay commited on
Commit
adf74d4
·
verified ·
1 Parent(s): bff0ad9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -41,6 +41,13 @@ model-index:
41
 
42
  ## Installation
43
 
 
 
 
 
 
 
 
44
  | Source | Share | Link |
45
  |--------|-------|------|
46
  | FinePDFs‑1B | 50% | https://huggingface.co/datasets/codelion/finepdfs-1B |
@@ -53,13 +60,6 @@ Notes
53
 
54
  Total tokens target (example): ~60B. The composition balances semantic density (FinePDFs) and generality (DCLM) per codelion’s guidance.
55
 
56
- ```bash
57
- pip install -e .
58
- from veronica import VeronicaConfig, VeronicaForCausalLM
59
- cfg = VeronicaConfig(n_layer=24, num_funcs=3) # base polymorphic setup
60
- model = VeronicaForCausalLM(cfg)
61
- ```
62
-
63
  Generation example:
64
  ```python
65
  from transformers import AutoTokenizer
 
41
 
42
  ## Installation
43
 
44
+ ```bash
45
+ pip install -e .
46
+ from veronica import VeronicaConfig, VeronicaForCausalLM
47
+ cfg = VeronicaConfig(n_layer=24, num_funcs=3) # base polymorphic setup
48
+ model = VeronicaForCausalLM(cfg)
49
+ ```
50
+
51
  | Source | Share | Link |
52
  |--------|-------|------|
53
  | FinePDFs‑1B | 50% | https://huggingface.co/datasets/codelion/finepdfs-1B |
 
60
 
61
  Total tokens target (example): ~60B. The composition balances semantic density (FinePDFs) and generality (DCLM) per codelion’s guidance.
62
 
 
 
 
 
 
 
 
63
  Generation example:
64
  ```python
65
  from transformers import AutoTokenizer