Instructions to use ukung/collections_model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use ukung/collections_model with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf ukung/collections_model
# Run inference directly in the terminal:
llama cli -hf ukung/collections_model

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf ukung/collections_model
# Run inference directly in the terminal:
llama cli -hf ukung/collections_model

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf ukung/collections_model
# Run inference directly in the terminal:
./llama-cli -hf ukung/collections_model

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf ukung/collections_model
# Run inference directly in the terminal:
./build/bin/llama-cli -hf ukung/collections_model

Use Docker

docker model run hf.co/ukung/collections_model

LM Studio
Jan
Ollama
How to use ukung/collections_model with Ollama:
```
ollama run hf.co/ukung/collections_model
```
Unsloth Desktop

How to use ukung/collections_model with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf ukung/collections_model

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "ukung/collections_model"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use ukung/collections_model with Docker Model Runner:
```
docker model run hf.co/ukung/collections_model
```

Lemonade

How to use ukung/collections_model with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull ukung/collections_model

Run and chat with the model

lemonade run user.collections_model-{{QUANT_TAG}}

List all available models

lemonade list

Hermes Agent

How to use ukung/collections_model with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf ukung/collections_model

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default ukung/collections_model

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use ukung/collections_model with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf ukung/collections_model

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "ukung/collections_model" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

ukung commited on Jun 9

Commit

7f7a338

verified ·

1 Parent(s): 5dc1495

Upload folder using huggingface_hub

Browse files

Files changed (6) hide show

whisper-tiny/added_tokens.json +108 -0
whisper-tiny/merges.txt +0 -0
whisper-tiny/onnx/decoder_model_merged_q4.onnx +3 -0
whisper-tiny/onnx/encoder_model_q4.onnx +3 -0
whisper-tiny/support-lang.json +101 -0
whisper-tiny/vocab.json +0 -0

whisper-tiny/added_tokens.json ADDED Viewed

	@@ -0,0 +1,108 @@

+{
+  "<|af|>": 50327,
+  "<|am|>": 50334,
+  "<|ar|>": 50272,
+  "<|as|>": 50350,
+  "<|az|>": 50304,
+  "<|ba|>": 50355,
+  "<|be|>": 50330,
+  "<|bg|>": 50292,
+  "<|bn|>": 50302,
+  "<|bo|>": 50347,
+  "<|br|>": 50309,
+  "<|bs|>": 50315,
+  "<|ca|>": 50270,
+  "<|cs|>": 50283,
+  "<|cy|>": 50297,
+  "<|da|>": 50285,
+  "<|de|>": 50261,
+  "<|el|>": 50281,
+  "<|en|>": 50259,
+  "<|es|>": 50262,
+  "<|et|>": 50307,
+  "<|eu|>": 50310,
+  "<|fa|>": 50300,
+  "<|fi|>": 50277,
+  "<|fo|>": 50338,
+  "<|fr|>": 50265,
+  "<|gl|>": 50319,
+  "<|gu|>": 50333,
+  "<|haw|>": 50352,
+  "<|ha|>": 50354,
+  "<|he|>": 50279,
+  "<|hi|>": 50276,
+  "<|hr|>": 50291,
+  "<|ht|>": 50339,
+  "<|hu|>": 50286,
+  "<|hy|>": 50312,
+  "<|id|>": 50275,
+  "<|is|>": 50311,
+  "<|it|>": 50274,
+  "<|ja|>": 50266,
+  "<|jw|>": 50356,
+  "<|ka|>": 50329,
+  "<|kk|>": 50316,
+  "<|km|>": 50323,
+  "<|kn|>": 50306,
+  "<|ko|>": 50264,
+  "<|la|>": 50294,
+  "<|lb|>": 50345,
+  "<|ln|>": 50353,
+  "<|lo|>": 50336,
+  "<|lt|>": 50293,
+  "<|lv|>": 50301,
+  "<|mg|>": 50349,
+  "<|mi|>": 50295,
+  "<|mk|>": 50308,
+  "<|ml|>": 50296,
+  "<|mn|>": 50314,
+  "<|mr|>": 50320,
+  "<|ms|>": 50282,
+  "<|mt|>": 50343,
+  "<|my|>": 50346,
+  "<|ne|>": 50313,
+  "<|nl|>": 50271,
+  "<|nn|>": 50342,
+  "<|nocaptions|>": 50362,
+  "<|notimestamps|>": 50363,
+  "<|no|>": 50288,
+  "<|oc|>": 50328,
+  "<|pa|>": 50321,
+  "<|pl|>": 50269,
+  "<|ps|>": 50340,
+  "<|pt|>": 50267,
+  "<|ro|>": 50284,
+  "<|ru|>": 50263,
+  "<|sa|>": 50344,
+  "<|sd|>": 50332,
+  "<|si|>": 50322,
+  "<|sk|>": 50298,
+  "<|sl|>": 50305,
+  "<|sn|>": 50324,
+  "<|so|>": 50326,
+  "<|sq|>": 50317,
+  "<|sr|>": 50303,
+  "<|startoflm|>": 50360,
+  "<|startofprev|>": 50361,
+  "<|startoftranscript|>": 50258,
+  "<|su|>": 50357,
+  "<|sv|>": 50273,
+  "<|sw|>": 50318,
+  "<|ta|>": 50287,
+  "<|te|>": 50299,
+  "<|tg|>": 50331,
+  "<|th|>": 50289,
+  "<|tk|>": 50341,
+  "<|tl|>": 50348,
+  "<|transcribe|>": 50359,
+  "<|translate|>": 50358,
+  "<|tr|>": 50268,
+  "<|tt|>": 50351,
+  "<|uk|>": 50280,
+  "<|ur|>": 50290,
+  "<|uz|>": 50337,
+  "<|vi|>": 50278,
+  "<|yi|>": 50335,
+  "<|yo|>": 50325,
+  "<|zh|>": 50260
+}

whisper-tiny/merges.txt ADDED Viewed

The diff for this file is too large to render. See raw diff

whisper-tiny/onnx/decoder_model_merged_q4.onnx ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:462a65ea8459402cded5e6f22a378ac410ec7e0aad9367ebb08431906c237660
+size 86739474

whisper-tiny/onnx/encoder_model_q4.onnx ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f895af36f57fec9cbeac8d29a982ae47b2e81e461d98320fbd30c47d01a6a13f
+size 9006044

whisper-tiny/support-lang.json ADDED Viewed

	@@ -0,0 +1,101 @@

+[
+  { "af": "Afrikaans" },
+  { "am": "Amharic" },
+  { "ar": "Arabic" },
+  { "as": "Assamese" },
+  { "az": "Azerbaijani" },
+  { "ba": "Bashkir" },
+  { "be": "Belarusian" },
+  { "bg": "Bulgarian" },
+  { "bn": "Bengali" },
+  { "bo": "Tibetan" },
+  { "br": "Breton" },
+  { "bs": "Bosnian" },
+  { "ca": "Catalan" },
+  { "cs": "Czech" },
+  { "cy": "Welsh" },
+  { "da": "Danish" },
+  { "de": "German" },
+  { "el": "Greek" },
+  { "en": "English" },
+  { "es": "Spanish" },
+  { "et": "Estonian" },
+  { "eu": "Basque" },
+  { "fa": "Persian" },
+  { "fi": "Finnish" },
+  { "fo": "Faroese" },
+  { "fr": "French" },
+  { "gl": "Galician" },
+  { "gu": "Gujarati" },
+  { "haw": "Hawaiian" },
+  { "ha": "Hausa" },
+  { "he": "Hebrew" },
+  { "hi": "Hindi" },
+  { "hr": "Croatian" },
+  { "ht": "Haitian Creole" },
+  { "hu": "Hungarian" },
+  { "hy": "Armenian" },
+  { "id": "Indonesian" },
+  { "is": "Icelandic" },
+  { "it": "Italian" },
+  { "ja": "Japanese" },
+  { "jw": "Javanese" },
+  { "ka": "Georgian" },
+  { "kk": "Kazakh" },
+  { "km": "Khmer" },
+  { "kn": "Kannada" },
+  { "ko": "Korean" },
+  { "la": "Latin" },
+  { "lb": "Luxembourgish" },
+  { "ln": "Lingala" },
+  { "lo": "Lao" },
+  { "lt": "Lithuanian" },
+  { "lv": "Latvian" },
+  { "mg": "Malagasy" },
+  { "mi": "Māori" },
+  { "mk": "Macedonian" },
+  { "ml": "Malayalam" },
+  { "mn": "Mongolian" },
+  { "mr": "Marathi" },
+  { "ms": "Malay" },
+  { "mt": "Maltese" },
+  { "my": "Myanmar (Burmese)" },
+  { "ne": "Nepali" },
+  { "nl": "Dutch" },
+  { "nn": "Norwegian Nynorsk" },
+  { "no": "Norwegian" },
+  { "oc": "Occitan" },
+  { "pa": "Punjabi" },
+  { "pl": "Polish" },
+  { "ps": "Pashto" },
+  { "pt": "Portuguese" },
+  { "ro": "Romanian" },
+  { "ru": "Russian" },
+  { "sa": "Sanskrit" },
+  { "sd": "Sindhi" },
+  { "si": "Sinhala" },
+  { "sk": "Slovak" },
+  { "sl": "Slovenian" },
+  { "sn": "Shona" },
+  { "so": "Somali" },
+  { "sq": "Albanian" },
+  { "sr": "Serbian" },
+  { "su": "Sundanese" },
+  { "sv": "Swedish" },
+  { "sw": "Swahili" },
+  { "ta": "Tamil" },
+  { "te": "Telugu" },
+  { "tg": "Tajik" },
+  { "th": "Thai" },
+  { "tk": "Turkmen" },
+  { "tl": "Tagalog" },
+  { "tr": "Turkish" },
+  { "tt": "Tatar" },
+  { "uk": "Ukrainian" },
+  { "ur": "Urdu" },
+  { "uz": "Uzbek" },
+  { "vi": "Vietnamese" },
+  { "yi": "Yiddish" },
+  { "yo": "Yoruba" },
+  { "zh": "Chinese" }
+]

whisper-tiny/vocab.json ADDED Viewed

The diff for this file is too large to render. See raw diff