Instructions to use Web4/LS-W4-Mini-SM-Post-Relevance-270M-it-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Local Apps Settings
- Unsloth Studio
How to use Web4/LS-W4-Mini-SM-Post-Relevance-270M-it-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Web4/LS-W4-Mini-SM-Post-Relevance-270M-it-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Web4/LS-W4-Mini-SM-Post-Relevance-270M-it-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Web4/LS-W4-Mini-SM-Post-Relevance-270M-it-GGUF to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="Web4/LS-W4-Mini-SM-Post-Relevance-270M-it-GGUF", max_seq_length=2048, )
Web4/LS-W4-Mini-SM-Post-Relevance-270M-it-GGUF
Model Description
This model is a fine-tuned version of Google's gemma-3-270m-it specifically adapted to generate relevant social media posts in Italian. Given a topic or a search query, the model generates a short-form text post that is contextually relevant, complete with typical social media elements like hashtags.
The model was efficiently fine-tuned using the Unsloth library with LoRA (Low-Rank Adaptation) on a subset of the Social Media Post Relevance dataset.
This repository contains the GGUF quantized version of the LoRA adapters, making it suitable for fast inference on CPUs and compatible with tools like llama.cpp.
Intended Use
The primary use case for this model is to automate or assist in the creation of social media content. It can be used by content creators, social media managers, or developers building applications that require topic-based text generation.