Qarvexium commited on
Commit
3c1b20a
·
verified ·
1 Parent(s): 28498d7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +91 -0
README.md CHANGED
@@ -1,3 +1,94 @@
1
  ---
 
 
 
 
 
 
 
 
 
 
 
2
  license: mit
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+
3
+ language:
4
+ - en
5
+ pipeline_tag: text-generation
6
+ library_name: pytorch
7
+ tags:
8
+ - chatbot
9
+ - text-generation
10
+ - causal-lm
11
+ - pytorch
12
+ - sentencepiece
13
  license: mit
14
+
15
  ---
16
+
17
+ # qWisp-base-v1 (70M)
18
+
19
+ qWisp-base-v1 is a lightweight language model built for fast local inference, experimentation, and integration into Python applications.
20
+
21
+ ## Features
22
+
23
+ * Lightweight and fast
24
+ * Local inference (no internet required)
25
+ * CPU, CUDA, and Apple Silicon (MPS) support
26
+ * SentencePiece tokenizer
27
+ * Simple Python API
28
+
29
+ ## Installation
30
+
31
+ Clone or download the repository, then install the required dependencies:
32
+
33
+ ```bash
34
+ pip install torch sentencepiece
35
+ ```
36
+
37
+ ## Quick Start
38
+
39
+ ```python
40
+ from qwisp import Wisp
41
+
42
+ w = Wisp().load()
43
+
44
+ print(w("Hello!"))
45
+ ```
46
+
47
+ ## Custom Generation
48
+
49
+ ```python
50
+ response = w(
51
+ "Write a short poem about the ocean.",
52
+ temperature=0.7,
53
+ top_k=40,
54
+ max_new_tokens=200,
55
+ )
56
+
57
+ print(response)
58
+ ```
59
+
60
+ You can also call `generate()` directly:
61
+
62
+ ```python
63
+ response = w.generate(
64
+ "Your prompt here",
65
+ temperature=0.8,
66
+ top_k=50,
67
+ max_new_tokens=200,
68
+ )
69
+ ```
70
+
71
+ ## Utility Methods
72
+
73
+ ```python
74
+ w.encode("Hello world")
75
+
76
+ w.decode(token_ids)
77
+
78
+ w.unload()
79
+ ```
80
+
81
+ ## Requirements
82
+
83
+ * Python 3.10+
84
+ * PyTorch
85
+ * SentencePiece
86
+
87
+ ## Notes
88
+
89
+ * The default model and tokenizer are automatically loaded from the package directory.
90
+ * The model is intended for research, experimentation, and general-purpose text generation.
91
+
92
+ ## License
93
+
94
+ MIT License