Clemylia commited on
Commit
12ca8a4
·
verified ·
1 Parent(s): a0f6431

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -49
README.md CHANGED
@@ -1,54 +1,17 @@
1
  ---
2
  library_name: transformers
3
  tags:
4
- - generated_from_trainer
 
 
 
 
5
  model-index:
6
- - name: Tiny-gemma
7
  results: []
8
- ---
9
-
10
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
- should probably proofread and complete it, then remove this comment. -->
12
-
13
- # Tiny-gemma
14
-
15
- This model is a fine-tuned version of [](https://huggingface.co/) on the None dataset.
16
-
17
- ## Model description
18
-
19
- More information needed
20
-
21
- ## Intended uses & limitations
22
-
23
- More information needed
24
-
25
- ## Training and evaluation data
26
-
27
- More information needed
28
-
29
- ## Training procedure
30
-
31
- ### Training hyperparameters
32
-
33
- The following hyperparameters were used during training:
34
- - learning_rate: 0.0005
35
- - train_batch_size: 8
36
- - eval_batch_size: 8
37
- - seed: 42
38
- - gradient_accumulation_steps: 4
39
- - total_train_batch_size: 32
40
- - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
41
- - lr_scheduler_type: linear
42
- - num_epochs: 4
43
- - mixed_precision_training: Native AMP
44
-
45
- ### Training results
46
-
47
-
48
-
49
- ### Framework versions
50
-
51
- - Transformers 4.57.6
52
- - Pytorch 2.9.0+cu126
53
- - Datasets 4.0.0
54
- - Tokenizers 0.22.2
 
1
  ---
2
  library_name: transformers
3
  tags:
4
+ - SLM
5
+ - french
6
+ - english
7
+ - Nacid
8
+ - Tiny-lamina
9
  model-index:
10
+ - name: SMCLEM
11
  results: []
12
+ license: other
13
+ language:
14
+ - fr
15
+ - en
16
+ pipeline_tag: text-generation
17
+ ---