shintaro-29 commited on
Commit
69d4c84
·
0 Parent(s):

initial commit

Browse files
.assets/lightning-logo2.svg ADDED
.assets/lightning.svg ADDED
.assets/preview.gif ADDED

Git LFS Details

  • SHA256: fa69bd8db85ed98fc16a885e93a38c0ca750bf7a6ef9ff7ca7913dd136bb6ab2
  • Pointer size: 132 Bytes
  • Size of remote file: 1.1 MB
.gitattributes ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ unsloth.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
+ unsloth.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
38
+ unsloth.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ *.gguf filter=lfs diff=lfs merge=lfs -text
40
+ *.gif filter=lfs diff=lfs merge=lfs -text
.ipynb_checkpoints/README-checkpoint.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ base_model:
6
+ - Qwen/Qwen3-4B-Thinking-2507
7
+ pipeline_tag: text-generation
8
+ library_name: transformers
9
+ ---
10
+ # Lightning-4b - Your Local data analysis agent
11
+
12
+ [![GitHub](https://img.shields.io/badge/GitHub-Repository-blue?logo=github)](https://github.com/quelmap-inc/quelmap)
13
+ [![License](https://img.shields.io/badge/License-Apache%202.0-yellow)](https://opensource.org/licenses/Apache-2.0)
14
+
15
+ ![image/svg](assets/lightning-logo2.svg)
16
+
17
+ ## Overview
18
+ Lightning-4b is a language model specifically designed and trained for data analysis tasks on local devices. With just a laptop (fully tested on an M4 MacBook Air with 16GB RAM), you can process data without ever sending it to major LLM provider.
19
+ ### What it can do
20
+ - Data visualization
21
+ - Table joins
22
+ - t-tests
23
+ - Unlimited rows, 30+ tables analyzed simultaneously
24
+ ### What it cannot do
25
+ - Business reasoning or management decision-making advice
26
+ - Multi-turn analysis
27
+
28
+ To use this model, install [quelmap](https://github.com/quelmap-inc/quelmap) on your device.
29
+ Quelmap is an open-source data analysis assistant with every essential features like data upload and an built-in python sandbox.
30
+ For installation instructions, see the [Quick Start](https://github.com/quelmap-inc/quelmap).
31
+ ![image/gif](.assets/preview.gif)
32
+ ### Performance
33
+ This model was trained specifically for use with [quelmap](https://github.com/quelmap-inc/quelmap).
34
+ It was evaluated using a sample database and 122 analysis queries, and achieved performance surpassing models with **50x more parameters**.
35
+
36
+ For details about the model and its training process, see the [Lightning-4b Details](https://quelmap.com/lightinig-4b) page.
37
+
38
+ ![image/svg](.assets/lightning.svg)
39
+
40
+ ### Running Model on your machine
41
+ You can easily install Lightning-4b and quelmap by following the [Quick Start](https://github.com/quelmap-inc/quelmap).
42
+
43
+ Lightning-4b has multiple quantization versions depending on your hardware.
44
+ It runs smoothly on laptops, and on higher-spec machines it can handle more tables (30+ tables) and longer chat histories.
45
+
46
+ Example Specs and Model Versions
47
+ - Laptop (e.g. mac book air 16GB) - 4bit Quantization + 10,240 Context Window
48
+ ```
49
+ ollama pull hf.co/quelmap/Lightning-4b-GGUF-short-ctx:Q4_K_M
50
+ ```
51
+ - Gaming Laptop - 4bit Quantization + 40,960 Context Window
52
+ ```
53
+ ollama pull hf.co/quelmap/Lightning-4b-GGUF:Q4_K_M
54
+ ```
55
+ - Powerful PC with GPU - No Quantization + 40,960 Context Window
56
+ ```
57
+ ollama pull hf.co/quelmap/Lightning-4b-GGUF:F16
58
+ ```
59
+
60
+ For more details, please refer to the [Lightning-4b Details](https://quelmap.com/lightinig-4b) page.
.ipynb_checkpoints/params-checkpoint ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "temperature": 0.2,
3
+ "min_p" : 0.00,
4
+ "top_k" : 20,
5
+ "top_p" : 0.95,
6
+ "num_ctx" : 40960
7
+ }
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ base_model:
6
+ - Qwen/Qwen3-4B-Thinking-2507
7
+ pipeline_tag: text-generation
8
+ library_name: transformers
9
+ ---
10
+ # Lightning-4b - Your Local data analysis agent
11
+
12
+ [![GitHub](https://img.shields.io/badge/GitHub-Repository-blue?logo=github)](https://github.com/quelmap-inc/quelmap)
13
+ [![License](https://img.shields.io/badge/License-Apache%202.0-yellow)](https://opensource.org/licenses/Apache-2.0)
14
+
15
+ ![image/svg](assets/lightning-logo2.svg)
16
+
17
+ ## Overview
18
+ Lightning-4b is a language model specifically designed and trained for data analysis tasks on local devices. With just a laptop (fully tested on an M4 MacBook Air with 16GB RAM), you can process data without ever sending it to major LLM provider.
19
+ ### What it can do
20
+ - Data visualization
21
+ - Table joins
22
+ - t-tests
23
+ - Unlimited rows, 30+ tables analyzed simultaneously
24
+ ### What it cannot do
25
+ - Business reasoning or management decision-making advice
26
+ - Multi-turn analysis
27
+
28
+ To use this model, install [quelmap](https://github.com/quelmap-inc/quelmap) on your device.
29
+ Quelmap is an open-source data analysis assistant with every essential features like data upload and an built-in python sandbox.
30
+ For installation instructions, see the [Quick Start](https://github.com/quelmap-inc/quelmap).
31
+ ![image/gif](.assets/preview.gif)
32
+ ### Performance
33
+ This model was trained specifically for use with [quelmap](https://github.com/quelmap-inc/quelmap).
34
+ It was evaluated using a sample database and 122 analysis queries, and achieved performance surpassing models with **50x more parameters**.
35
+
36
+ For details about the model and its training process, see the [Lightning-4b Details](https://quelmap.com/lightinig-4b) page.
37
+
38
+ ![image/svg](.assets/lightning.svg)
39
+
40
+ ### Running Model on your machine
41
+ You can easily install Lightning-4b and quelmap by following the [Quick Start](https://github.com/quelmap-inc/quelmap).
42
+
43
+ Lightning-4b has multiple quantization versions depending on your hardware.
44
+ It runs smoothly on laptops, and on higher-spec machines it can handle more tables (30+ tables) and longer chat histories.
45
+
46
+ Example Specs and Model Versions
47
+ - Laptop (e.g. mac book air 16GB) - 4bit Quantization + 10,240 Context Window
48
+ ```
49
+ ollama pull hf.co/quelmap/Lightning-4b-GGUF-short-ctx:Q4_K_M
50
+ ```
51
+ - Gaming Laptop - 4bit Quantization + 40,960 Context Window
52
+ ```
53
+ ollama pull hf.co/quelmap/Lightning-4b-GGUF:Q4_K_M
54
+ ```
55
+ - Powerful PC with GPU - No Quantization + 40,960 Context Window
56
+ ```
57
+ ollama pull hf.co/quelmap/Lightning-4b-GGUF:F16
58
+ ```
59
+
60
+ For more details, please refer to the [Lightning-4b Details](https://quelmap.com/lightinig-4b) page.
config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ {
2
+ "model_type": "qwen3"
3
+ }
params ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "temperature": 0.2,
3
+ "min_p" : 0.00,
4
+ "top_k" : 20,
5
+ "top_p" : 0.95,
6
+ "num_ctx" : 40960
7
+ }
unsloth.F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ec638e136b9ac2730a1776df2ddd2a79850a1955aa3997cac6ac40610f1305b
3
+ size 8051284864
unsloth.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9fb43673a90816c39c9a16a23f017d067d3ebf1025a35dff851dea369bbb03bc
3
+ size 2497280384
unsloth.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ac19c2cc7376ddf8c836066f9fc40e59080784956a843531e14ccacbb71d61a
3
+ size 2889513344
unsloth.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4dac98a1fb41c19128f26006538adec2398ed552f5fd8baf83b339f5c48ff58
3
+ size 4280404864