mgv99 commited on
Commit
775d3ed
·
verified ·
1 Parent(s): 0487ef1

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +1 -61
README.md CHANGED
@@ -1,64 +1,4 @@
1
  ---
2
  {}
3
  ---
4
- ---
5
- license:
6
- base_model:
7
- - psmathur/orca_mini_v3_13b
8
- - WizardLM/WizardLM-13B-V1.2
9
- - garage-bAInd/Platypus2-13B
10
- tags:
11
- - merge
12
- - mergekit
13
- - lazymergekit
14
- - psmathur/orca_mini_v3_13b
15
- - WizardLM/WizardLM-13B-V1.2
16
- - garage-bAInd/Platypus2-13B
17
- ---
18
-
19
- # holaa
20
-
21
- holaa is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
22
- * [psmathur/orca_mini_v3_13b](https://huggingface.co/psmathur/orca_mini_v3_13b)
23
- * [WizardLM/WizardLM-13B-V1.2](https://huggingface.co/WizardLM/WizardLM-13B-V1.2)
24
- * [garage-bAInd/Platypus2-13B](https://huggingface.co/garage-bAInd/Platypus2-13B)
25
-
26
- ## 🧩 Configuration
27
-
28
- ```yamlmodels:
29
- - model: psmathur/orca_mini_v3_13b
30
- parameters:
31
- weight: 1.0
32
- - model: WizardLM/WizardLM-13B-V1.2
33
- parameters:
34
- weight: 0.3
35
- - model: garage-bAInd/Platypus2-13B
36
- parameters:
37
- weight: 0.5
38
- merge_method: linear
39
- dtype: float16```
40
-
41
- ## 💻 Usage
42
-
43
- ```python
44
- !pip install -qU transformers accelerate
45
-
46
- from transformers import AutoTokenizer
47
- import transformers
48
- import torch
49
-
50
- model = "mgv99/holaa"
51
- messages = [{"role": "user", "content": "What is a large language model?"}]
52
-
53
- tokenizer = AutoTokenizer.from_pretrained(model)
54
- prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
55
- pipeline = transformers.pipeline(
56
- "text-generation",
57
- model=model,
58
- torch_dtype=torch.float16,
59
- device_map="auto",
60
- )
61
-
62
- outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
63
- print(outputs[0]["generated_text"])
64
- ```
 
1
  ---
2
  {}
3
  ---
4
+ aaaaaaa