| | --- |
| | license: mit |
| | tags: |
| | - nlp |
| | - text-generation |
| | - bitnet |
| | - pytorch |
| | - tensorflow |
| | pipeline_tag: text-generation |
| | --- |
| | |
| | # PlayWeBit (BitNet b1.58-2B-4T) |
| |
|
| | This is an implementation of the `microsoft/bitnet-b1.58-2B-4T` model, optimized for text generation. It supports PyTorch and TensorFlow and can run on CPU or GPU. A custom model class (`custom_bitnet.py`) is included for compatibility with the official Hugging Face `transformers` library. |
| |
|
| | ## Model Description |
| | - **Architecture**: BitNet b1.58-2B with 4-bit quantization |
| | - **Parameters**: 2 billion |
| | - **Training Data**: Not disclosed (refer to original Microsoft repository) |
| | - **Intended Use**: Text generation, chat applications |
| |
|
| | ## Installation |
| | Install the Hugging Face `transformers` library: |
| | ```bash |
| | pip install transformers |
