jeffasante commited on
Commit
2020639
·
verified ·
1 Parent(s): b5498bd

Delete README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +0 -38
README.md DELETED
@@ -1,38 +0,0 @@
1
- ---
2
- library_name: cellm
3
- tags:
4
- - mobile
5
- - rust
6
- - memory-efficient
7
- - quantized
8
- ---
9
-
10
- # Cellm Models Hub
11
-
12
- This repository contains a collection of optimized Large Language Models (LLMs) in the `.cellm` format. These models are specifically tuned for high-performance inference using the [Cellm](https://github.com/jeffasante/cellm) engine, featuring Metal-accelerated kernels and memory-mapped efficiency.
13
-
14
- ## Models
15
-
16
- ### Gemma 3 1B IT (Int8)
17
- - **Path**: `gemma-3-1b-it-int8/gemma-3-1b-it-int8.cellmd`
18
- - **Size**: 1.3 GB
19
- - **Type**: Quantized Int8 (Symmetric Weight-Only)
20
-
21
- ### Gemma 4 2.3B IT (LiteRT)
22
- - **Path**: `gemma-4-2p3b-it-litert/gemma-4-2p3b-it-litert.cellm`
23
- - **Size**: 2.4 GB
24
- - **Type**: LiteRT-optimized for Cellm
25
-
26
- ## Usage
27
-
28
- You can use these models directly with the Cellm CLI or in your applications:
29
-
30
- ```bash
31
- cellm run --model-path jeffasante/cellm-models/gemma-4-2p3b-it-litert/gemma-4-2p3b-it-litert.cellm
32
- ```
33
-
34
- ## About Cellm
35
- Cellm is a high-performance inference engine for local LLMs, written in Rust with a focus on Metal GPU acceleration and minimal memory overhead.
36
-
37
- ## License
38
- This model is subject to the **Gemma Terms of Use**. By downloading or using these weights, you agree to the terms listed at [ai.google.dev/gemma/terms](https://ai.google.dev/gemma/terms).