| --- |
| |
| language: |
| - en |
| pipeline_tag: text-generation |
| library_name: pytorch |
| tags: |
| - chatbot |
| - text-generation |
| - causal-lm |
| - pytorch |
| - sentencepiece |
| license: mit |
|
|
| --- |
| |
| # qWisp-base-v1 (70M) |
|
|
| qWisp-base-v1 is a lightweight language model built for fast local inference, experimentation, and integration into Python applications. |
|
|
| ## Features |
|
|
| * Lightweight and fast |
| * Local inference (no internet required) |
| * CPU, CUDA, and Apple Silicon (MPS) support |
| * SentencePiece tokenizer |
| * Simple Python API |
|
|
| ## Installation |
|
|
| Clone or download the repository, then install the required dependencies: |
|
|
| ```bash |
| pip install torch sentencepiece |
| ``` |
|
|
| ## Quick Start |
|
|
| ```python |
| from qwisp import Wisp |
| |
| w = Wisp().load() |
| |
| print(w("Hello!")) |
| ``` |
|
|
| ## Custom Generation |
|
|
| ```python |
| response = w( |
| "Write a short poem about the ocean.", |
| temperature=0.7, |
| top_k=40, |
| max_new_tokens=200, |
| ) |
| |
| print(response) |
| ``` |
|
|
| You can also call `generate()` directly: |
|
|
| ```python |
| response = w.generate( |
| "Your prompt here", |
| temperature=0.8, |
| top_k=50, |
| max_new_tokens=200, |
| ) |
| ``` |
|
|
| ## Utility Methods |
|
|
| ```python |
| w.encode("Hello world") |
| |
| w.decode(token_ids) |
| |
| w.unload() |
| ``` |
|
|
| ## Requirements |
|
|
| * Python 3.10+ |
| * PyTorch |
| * SentencePiece |
|
|
| ## Notes |
|
|
| * The default model and tokenizer are automatically loaded from the package directory. |
| * The model is intended for research, experimentation, and general-purpose text generation. |
|
|
| ## License |
|
|
| MIT License |
