Text Generation
GGUF
English
Italian
question-answering
articles
change management
qwen3.5
cpu-compatible
local-inference
faiss
qdrant
conversational
knowledge-base
Instructions to use robertolofaro/articles-model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use robertolofaro/articles-model with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="robertolofaro/articles-model", filename="articles-Q4_K_M.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use robertolofaro/articles-model with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf robertolofaro/articles-model:Q4_K_M # Run inference directly in the terminal: llama-cli -hf robertolofaro/articles-model:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf robertolofaro/articles-model:Q4_K_M # Run inference directly in the terminal: llama-cli -hf robertolofaro/articles-model:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf robertolofaro/articles-model:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf robertolofaro/articles-model:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf robertolofaro/articles-model:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf robertolofaro/articles-model:Q4_K_M
Use Docker
docker model run hf.co/robertolofaro/articles-model:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use robertolofaro/articles-model with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "robertolofaro/articles-model" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "robertolofaro/articles-model", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/robertolofaro/articles-model:Q4_K_M
- Ollama
How to use robertolofaro/articles-model with Ollama:
ollama run hf.co/robertolofaro/articles-model:Q4_K_M
- Unsloth Studio new
How to use robertolofaro/articles-model with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for robertolofaro/articles-model to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for robertolofaro/articles-model to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for robertolofaro/articles-model to start chatting
- Pi new
How to use robertolofaro/articles-model with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf robertolofaro/articles-model:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "robertolofaro/articles-model:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use robertolofaro/articles-model with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf robertolofaro/articles-model:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default robertolofaro/articles-model:Q4_K_M
Run Hermes
hermes
- Docker Model Runner
How to use robertolofaro/articles-model with Docker Model Runner:
docker model run hf.co/robertolofaro/articles-model:Q4_K_M
- Lemonade
How to use robertolofaro/articles-model with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull robertolofaro/articles-model:Q4_K_M
Run and chat with the model
lemonade run user.articles-model-Q4_K_M
List all available models
lemonade list
Update README.md
Browse files
README.md
CHANGED
|
@@ -101,6 +101,33 @@ Italy is described as a country with unique cultural and historical assets that
|
|
| 101 |
- Digital infrastructure gaps (e.g., internet access, data standards) hinder innovation ecosystems and remote work opportunities.
|
| 102 |
- Cultural promotion beyond tourism should include soft-power initiatives that highlight Italy’s roles as a mediator of global ideas (science, art, philosophy).
|
| 103 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 104 |
Therefore, consider the "demo" just as a demo- if you want to use the model to brainstorm, I suggest that you download the model and create your own script.
|
| 105 |
|
| 106 |
You can actually look at an example of the system prompt below.
|
|
|
|
| 101 |
- Digital infrastructure gaps (e.g., internet access, data standards) hinder innovation ecosystems and remote work opportunities.
|
| 102 |
- Cultural promotion beyond tourism should include soft-power initiatives that highlight Italy’s roles as a mediator of global ideas (science, art, philosophy).
|
| 103 |
|
| 104 |
+
#### Case 3: selecting a specific category (e.g. "diritto di voto") and ask a question about the category
|
| 105 |
+
|
| 106 |
+
The question: **within the articles in the selected category, what are the key issues identified for Italy?**
|
| 107 |
+
|
| 108 |
+
### Executive Summary
|
| 109 |
+
The articles identify critical structural issues in Italy regarding cultural and political industrialization, focusing on administrative inefficiency, transparency gaps, and the lack of systemic change. Key concerns include institutional inertia, corruption risks due to fragmented oversight, and the failure to implement necessary reforms despite external pressure from EU compliance requirements.
|
| 110 |
+
|
| 111 |
+
### Guidelines & Hints
|
| 112 |
+
- **Industrial Culture vs. Political Reality**: Italy's industrial culture lacks alignment with political reality; decisions are often delayed by bureaucratic processes rather than being made based on market needs or strategic planning.
|
| 113 |
+
|
| 114 |
+
- **Administrative Efficiency**: Administrative bodies suffer from excessive complexity, lack of clarity in procedures, and poor coordination across departments.
|
| 115 |
+
|
| 116 |
+
- **Transparency and Accountability**: There is a systemic weakness in transparency mechanisms and accountability frameworks, leading to corruption risks and reduced public trust.
|
| 117 |
+
|
| 118 |
+
- **EU Compliance vs. Local Reality**: While Italy faces pressure from the EU to adopt compliance measures (e.g., VAT directives), there is resistance or failure to implement these changes due to local cultural inertia and lack of political will.
|
| 119 |
+
|
| 120 |
+
- **"Self-Payment" Culture**: A persistent mindset where individuals assume personal responsibility for collective outcomes ("I paid the bills") without considering systemic solutions or broader implications.
|
| 121 |
+
|
| 122 |
+
- **Collaboration vs. Competition**: Administrative processes often prioritize competition over collaboration, hindering cross-functional teamwork and reducing overall efficiency.
|
| 123 |
+
|
| 124 |
+
- **"Wolf to Wolf" Dynamics**: Decision-making cycles are driven by short-term political maneuvering rather than long-term strategic planning, leading to inconsistent policies and fragmented outcomes.
|
| 125 |
+
|
| 126 |
+
- **"Grass Filings" (Fili d'erba)**: Initiatives often start small but require continuous support and integration into broader systems; without this continuity, they fail at scale.
|
| 127 |
+
|
| 128 |
+
- **Political Industrialization**: Political decisions are treated as isolated events rather than part of a larger industrial or economic strategy, leading to fragmented implementation efforts.
|
| 129 |
+
|
| 130 |
+
|
| 131 |
Therefore, consider the "demo" just as a demo- if you want to use the model to brainstorm, I suggest that you download the model and create your own script.
|
| 132 |
|
| 133 |
You can actually look at an example of the system prompt below.
|