GGUF models from xllama’s catalogue, my independent research project for local LLM inference on an Xbox Series S.
Gianluca Mazza PRO
gianlucamazza
AI & ML interests
LLM systems in production, agent state and recovery, evaluation, inference cost
Recent Activity
liked a dataset about 9 hours ago
TIGER-Lab/MMLU-Pro liked a dataset about 9 hours ago
mlabonne/FineTome-100k liked a dataset about 9 hours ago
HuggingFaceTB/smoltalkOrganizations
Upstream models my open-source projects run or my articles discuss. Each note says where, and whether it is real use or an example.
-
thenlper/gte-small
Sentence Similarity • 33.4M • Updated • 1.01M • • 194 -
HuggingFaceTB/SmolLM2-360M-Instruct
Text Generation • 0.4B • Updated • 245k • 228 -
cross-encoder/ms-marco-MiniLM-L6-v2
Text Ranking • 22.7M • Updated • 80.4M • 362 -
BAAI/bge-large-en-v1.5
Feature Extraction • 0.3B • Updated • 10M • • 751
GGUF models from xllama’s catalogue, my independent research project for local LLM inference on an Xbox Series S.
Upstream models my open-source projects run or my articles discuss. Each note says where, and whether it is real use or an example.
-
thenlper/gte-small
Sentence Similarity • 33.4M • Updated • 1.01M • • 194 -
HuggingFaceTB/SmolLM2-360M-Instruct
Text Generation • 0.4B • Updated • 245k • 228 -
cross-encoder/ms-marco-MiniLM-L6-v2
Text Ranking • 22.7M • Updated • 80.4M • 362 -
BAAI/bge-large-en-v1.5
Feature Extraction • 0.3B • Updated • 10M • • 751
Agent memory and local inference experiments by Gianluca Mazza. Each card states what it is for and where it stops working. gianlucamazza.it