Update README.md
Browse files
README.md
CHANGED
|
@@ -21,63 +21,42 @@ library_name: transformers
|
|
| 21 |
pipeline_tag: text-generation
|
| 22 |
---
|
| 23 |
|
| 24 |
-
# Arete OSS 3B
|
| 25 |
|
| 26 |
-
|
| 27 |
|
| 28 |
-
Built by **[Iseer & Co.](https://iseer.co)** -
|
| 29 |
|
| 30 |
-
##
|
| 31 |
|
| 32 |
-
|
| 33 |
-
- **Fine-tuning:** QLoRA (4-bit quantization) using Unsloth
|
| 34 |
-
- **Training Duration:** ~7 hours
|
| 35 |
-
- **Dataset:** ~30,000 examples across 4 domains
|
| 36 |
-
- **Languages:** English, Bengali (বাংলা), with code-switching support
|
| 37 |
|
| 38 |
-
|
|
|
|
|
|
|
|
|
|
| 39 |
|
| 40 |
-
|
| 41 |
-
✅ **Bilingual Support**: Natural conversation in English and Bengali
|
| 42 |
-
✅ **Crisis Awareness**: Recognizes distress signals and responds supportively
|
| 43 |
-
✅ **Cultural Sensitivity**: Understands Bengali cultural context
|
| 44 |
-
✅ **Empathetic Responses**: Non-judgmental, validating communication style
|
| 45 |
|
| 46 |
-
##
|
| 47 |
|
| 48 |
```python
|
| 49 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 50 |
-
import torch
|
| 51 |
|
| 52 |
-
|
| 53 |
-
model = AutoModelForCausalLM.from_pretrained(
|
| 54 |
-
"inanxr/Arete-OSS-3B",
|
| 55 |
-
torch_dtype=torch.float16,
|
| 56 |
-
device_map="auto"
|
| 57 |
-
)
|
| 58 |
tokenizer = AutoTokenizer.from_pretrained("inanxr/Arete-OSS-3B")
|
| 59 |
|
| 60 |
-
# Format prompt (Alpaca style)
|
| 61 |
prompt = """Below is an instruction that describes a task. Write a response that appropriately completes the request.
|
| 62 |
|
| 63 |
### Instruction:
|
| 64 |
Respond with empathy and understanding to the following message.
|
| 65 |
|
| 66 |
### Input:
|
| 67 |
-
I'm feeling
|
| 68 |
|
| 69 |
### Response:
|
| 70 |
"""
|
| 71 |
|
| 72 |
-
|
| 73 |
-
|
| 74 |
-
outputs =
|
| 75 |
-
**inputs,
|
| 76 |
-
max_new_tokens=256,
|
| 77 |
-
temperature=0.7,
|
| 78 |
-
top_p=0.9,
|
| 79 |
-
do_sample=True
|
| 80 |
-
)
|
| 81 |
-
|
| 82 |
-
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
|
| 83 |
-
print(response.split("### Response:")[-1].strip())
|
|
|
|
| 21 |
pipeline_tag: text-generation
|
| 22 |
---
|
| 23 |
|
| 24 |
+
# Arete OSS 3B 🧠❤️
|
| 25 |
|
| 26 |
+
An emotionally intelligent AI that actually listens.
|
| 27 |
|
| 28 |
+
Built by **[Iseer & Co.](https://iseer.co)** - Making AI that understands humans, not just language.
|
| 29 |
|
| 30 |
+
## What makes Arete different?
|
| 31 |
|
| 32 |
+
Most AI assistants optimize for being "smart." Arete optimizes for being **empathetic**.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
|
| 34 |
+
- 🇧🇩 Speaks **English and Bengali** fluently
|
| 35 |
+
- 💬 Trained on real emotional support conversations
|
| 36 |
+
- 🎯 Recognizes when you're struggling and responds with care
|
| 37 |
+
- 🌍 Understands cultural context (especially South Asian family dynamics)
|
| 38 |
|
| 39 |
+
**3 billion parameters. Infinite empathy.**
|
|
|
|
|
|
|
|
|
|
|
|
|
| 40 |
|
| 41 |
+
## Try it
|
| 42 |
|
| 43 |
```python
|
| 44 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
|
|
| 45 |
|
| 46 |
+
model = AutoModelForCausalLM.from_pretrained("inanxr/Arete-OSS-3B")
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 47 |
tokenizer = AutoTokenizer.from_pretrained("inanxr/Arete-OSS-3B")
|
| 48 |
|
|
|
|
| 49 |
prompt = """Below is an instruction that describes a task. Write a response that appropriately completes the request.
|
| 50 |
|
| 51 |
### Instruction:
|
| 52 |
Respond with empathy and understanding to the following message.
|
| 53 |
|
| 54 |
### Input:
|
| 55 |
+
I'm feeling overwhelmed and don't know what to do.
|
| 56 |
|
| 57 |
### Response:
|
| 58 |
"""
|
| 59 |
|
| 60 |
+
inputs = tokenizer(prompt, return_tensors="pt")
|
| 61 |
+
outputs = model.generate(**inputs, max_new_tokens=200, temperature=0.7)
|
| 62 |
+
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|