DebMukherjee commited on
Commit
07e4b33
·
verified ·
1 Parent(s): 06f14ee

Smolify: Intelligence Distilled.

Browse files
Files changed (1) hide show
  1. README.md +60 -12
README.md CHANGED
@@ -1,21 +1,69 @@
1
  ---
2
- base_model: unsloth/gemma-3-270m-it
3
- tags:
4
- - text-generation-inference
5
- - transformers
6
- - unsloth
7
- - gemma3_text
8
  license: apache-2.0
9
  language:
10
  - en
 
 
 
 
 
 
 
 
 
 
 
11
  ---
12
 
13
- # Uploaded finetuned model
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
 
15
- - **Developed by:** DebMukherjee
16
- - **License:** apache-2.0
17
- - **Finetuned from model :** unsloth/gemma-3-270m-it
 
 
 
 
 
18
 
19
- This gemma3_text model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
 
20
 
21
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
1
  ---
 
 
 
 
 
 
2
  license: apache-2.0
3
  language:
4
  - en
5
+ tags:
6
+ - text-generation-inference
7
+ - transformers
8
+ - smolify
9
+ - dslm
10
+ pipeline_tag: text-generation
11
+ inference:
12
+ parameters:
13
+ temperature: 1
14
+ top_p: 0.95
15
+ top_k: 64
16
  ---
17
 
18
+ # 🤏 smolified-iot-controller
19
+
20
+ > **Intelligence, Distilled.**
21
+
22
+ This is a **Domain Specific Language Model (DSLM)** generated by the **Smolify Foundry**.
23
+
24
+ It has been synthetically distilled from SOTA reasoning engines into a high-efficiency architecture, optimized for deployment on edge hardware (CPU/NPU) or low-VRAM environments.
25
+
26
+ ## 📦 Asset Details
27
+ - **Origin:** Smolify Foundry (Job ID: `b8144b78`)
28
+ - **Architecture:** gemma-3-270m
29
+ - **Training Method:** Proprietary Neural Distillation
30
+ - **Optimization:** 4-bit Quantized / FP16 Mixed
31
+ - **Dataset:** [Link to Dataset](https://huggingface.co/datasets/DebMukherjee/smolified-iot-controller)
32
+
33
+ ## 🚀 Usage (Inference)
34
+ This model is compatible with standard inference backends like vLLM, and Hugging Face Transformers.
35
+
36
+ ```python
37
+ # Example: Running your Sovereign Model
38
+ from transformers import AutoModelForCausalLM, AutoTokenizer
39
+
40
+ model_id = "DebMukherjee/smolified-iot-controller"
41
+ tokenizer = AutoTokenizer.from_pretrained(model_id)
42
+ model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto")
43
+
44
+ messages = [
45
+ {"role": "system", "content": '''You are an IoT intent parser. Map user commands to valid JSON actions: {"device": string, "state": 0 or 1}. available_devices: [kitchen_light, bedroom_fan, garage_door, ac_unit].'''},
46
+ {"role": "user", "content": '''It is freezing, initiate the heating in the ac_unit'''}
47
+ ]
48
+ text = tokenizer.apply_chat_template(
49
+ messages,
50
+ tokenize = False,
51
+ add_generation_prompt = True,
52
+ )
53
+ if "gemma-3-270m" == "gemma-3-270m":
54
+ text = text.removeprefix('<bos>')
55
 
56
+ from transformers import TextStreamer
57
+ _ = model.generate(
58
+ **tokenizer(text, return_tensors = "pt").to(model.device),
59
+ max_new_tokens = 1000,
60
+ temperature = 1.0, top_p = 0.95, top_k = 64,
61
+ streamer = TextStreamer(tokenizer, skip_prompt = True),
62
+ )
63
+ ```
64
 
65
+ ## ⚖️ License & Ownership
66
+ This model weights are a sovereign asset owned by **DebMukherjee**.
67
+ Generated via [Smolify.ai](https://smolify.ai).
68
 
69
+ [<img src="https://smolify.ai/smolify.gif" width="100"/>](https://smolify.ai)