Instructions to use DS-Archive/Misc-Models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use DS-Archive/Misc-Models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf DS-Archive/Misc-Models:Q4_K_S # Run inference directly in the terminal: llama cli -hf DS-Archive/Misc-Models:Q4_K_S
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf DS-Archive/Misc-Models:Q4_K_S # Run inference directly in the terminal: llama cli -hf DS-Archive/Misc-Models:Q4_K_S
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf DS-Archive/Misc-Models:Q4_K_S # Run inference directly in the terminal: ./build/bin/llama cli -hf DS-Archive/Misc-Models:Q4_K_S
Use Docker
docker model run hf.co/DS-Archive/Misc-Models:Q4_K_S
- Llama new
- LM Studio
- Jan
- vLLM
How to use DS-Archive/Misc-Models with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "DS-Archive/Misc-Models" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DS-Archive/Misc-Models", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/DS-Archive/Misc-Models:Q4_K_S
- Ollama
How to use DS-Archive/Misc-Models with Ollama:
ollama run hf.co/DS-Archive/Misc-Models:Q4_K_S
- Unsloth Desktop
- Docker Model Runner
How to use DS-Archive/Misc-Models with Docker Model Runner:
docker model run hf.co/DS-Archive/Misc-Models:Q4_K_S
- Lemonade
How to use DS-Archive/Misc-Models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull DS-Archive/Misc-Models:Q4_K_S
Run and chat with the model
lemonade run user.Misc-Models-Q4_K_S
List all available models
lemonade list
- Atomic Chat
Download .gitattributes from DS-Archive/Misc-Models: direct link, hf CLI and curl.
- Browser
- Download file 5.38 kB
-
https://huggingface.co/DS-Archive/Misc-Models/resolve/main/.gitattributes
- Command line
-
hf download hf://DS-Archive/Misc-Models/.gitattributes
-
curl -L -o .gitattributes https://huggingface.co/DS-Archive/Misc-Models/resolve/main/.gitattributes
5.38 kB
| *.7z filter=lfs diff=lfs merge=lfs -text | |
| *.arrow filter=lfs diff=lfs merge=lfs -text | |
| *.bin filter=lfs diff=lfs merge=lfs -text | |
| *.bz2 filter=lfs diff=lfs merge=lfs -text | |
| *.ckpt filter=lfs diff=lfs merge=lfs -text | |
| *.ftz filter=lfs diff=lfs merge=lfs -text | |
| *.gz filter=lfs diff=lfs merge=lfs -text | |
| *.h5 filter=lfs diff=lfs merge=lfs -text | |
| *.joblib filter=lfs diff=lfs merge=lfs -text | |
| *.lfs.* filter=lfs diff=lfs merge=lfs -text | |
| *.mlmodel filter=lfs diff=lfs merge=lfs -text | |
| *.model filter=lfs diff=lfs merge=lfs -text | |
| *.msgpack filter=lfs diff=lfs merge=lfs -text | |
| *.npy filter=lfs diff=lfs merge=lfs -text | |
| *.npz filter=lfs diff=lfs merge=lfs -text | |
| *.onnx filter=lfs diff=lfs merge=lfs -text | |
| *.ot filter=lfs diff=lfs merge=lfs -text | |
| *.parquet filter=lfs diff=lfs merge=lfs -text | |
| *.pb filter=lfs diff=lfs merge=lfs -text | |
| *.pickle filter=lfs diff=lfs merge=lfs -text | |
| *.pkl filter=lfs diff=lfs merge=lfs -text | |
| *.pt filter=lfs diff=lfs merge=lfs -text | |
| *.pth filter=lfs diff=lfs merge=lfs -text | |
| *.rar filter=lfs diff=lfs merge=lfs -text | |
| *.safetensors filter=lfs diff=lfs merge=lfs -text | |
| saved_model/**/* filter=lfs diff=lfs merge=lfs -text | |
| *.tar.* filter=lfs diff=lfs merge=lfs -text | |
| *.tar filter=lfs diff=lfs merge=lfs -text | |
| *.tflite filter=lfs diff=lfs merge=lfs -text | |
| *.tgz filter=lfs diff=lfs merge=lfs -text | |
| *.wasm filter=lfs diff=lfs merge=lfs -text | |
| *.xz filter=lfs diff=lfs merge=lfs -text | |
| *.zip filter=lfs diff=lfs merge=lfs -text | |
| *.zst filter=lfs diff=lfs merge=lfs -text | |
| *tfevents* filter=lfs diff=lfs merge=lfs -text | |
| MythoMax-L2-13b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| MythoMax-L2-13b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| Huginn-13b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| Huginn-13b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| airoboros-creative-13b-2.1.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| airoboros-creative-13b-2.1.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| llama-2-13b-chat-limarp-v2-merged.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| llama-2-13b-chat-limarp-v2-merged.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| Mytho-TIES-L2-13b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| Mytho-TIES-L2-13b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| ds-brew-13b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| ds-brew-13b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| ds-spicy-brew-13b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| ds-spicy-brew-13b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| mythospice-70b.q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| mythospice-70b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| mythospice-70b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| mythospice-limarp-70b.q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| mythospice-limarp-70b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| mythospice-limarp-70b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| ds-smol-brew-7b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| ds-smol-brew-7b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| mythalion-13b-supercot2.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| mythalion-13b-supercot2.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| CalliopeDS-L2-13B.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| CalliopeDS-L2-13B.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| pygmalion-2-supercot-limarpv3-13b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| pygmalion-2-supercot-limarpv3-13b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| pygmalion-2-supercot-limarpv3-0.66-13b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| pygmalion-2-supercot-limarpv3-0.66-13b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| CalliopeDS-v2-L2-13B.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| CalliopeDS-v2-L2-13B.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| pygmalion-2-supercot-limarpv3-gradient-13b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| pygmalion-2-supercot-limarpv3-gradient-13b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| mistral-v0.1-limarpv3-7b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| mistral-v0.1-limarpv3-7b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| mistral-v0.1-7b-pippa-metharme-limarp.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| mistral-v0.1-7b-pippa-metharme-limarp.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| MiniRP-DS-mis0.1-7b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| MiniRP-DS-mis0.1-7b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| mythalion-supercot-limarpv3-gradient-13b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| mythalion-supercot-limarpv3-gradient-13b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| airolima-mistral-7b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| airolima-mistral-7b.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| LimaRP-MistralOrca-7B.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| LimaRP-MistralOrca-7B.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| MistRP-AirOrca-7B.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| zephyr-7b-alpha.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| zephyr-7b-alpha.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |
| Euryale-1.3-limarpv3-L2-70B.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| airoboros-2.2.1-limarpv3-y34b.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES.q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text | |
| Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-DARE-TIES.q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text | |