Hugging Face's logo

finnianx
/
SmolLM3-Merged

Text Generation
Transformers
Safetensors
smollm3
mergekit
Merge
Model card Files
xet
 Community
How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="finnianx/SmolLM3-Merged")
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("finnianx/SmolLM3-Merged")
model = AutoModelForCausalLM.from_pretrained("finnianx/SmolLM3-Merged")
Quick Links

finnianx/SmolLM3-Merged

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Passthrough merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

Warning

This model is not ready for any application, it outputs complete gibbberish! Continued pretraining and finetuning is necessary.

merge_method: passthrough
dtype: bfloat16

slices:
  - sources:
      - model: HuggingFaceTB/SmolLM3-3B-Base
        layer_range: [0, 36]
  - sources:
      - model: HuggingFaceTB/SmolLM3-3B-Base
        layer_range: [0, 36]
Downloads last month
18
Safetensors
Model size
6B params
Tensor type
BF16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for finnianx/SmolLM3-Merged

Base model

HuggingFaceTB/SmolLM3-3B-Base
Finetuned
(97)
this model