Text Generation
PyTorch
GGUF
English
quantum
quantum-entropy
from-scratch
char-level
cosmic-synapse-theory
custom-architecture
llama-cpp
continual-learning
reproducible-seed
open-science
null-results
Instructions to use phera-ra/QC67_cosmo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use phera-ra/QC67_cosmo with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf phera-ra/QC67_cosmo # Run inference directly in the terminal: llama cli -hf phera-ra/QC67_cosmo
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf phera-ra/QC67_cosmo # Run inference directly in the terminal: llama cli -hf phera-ra/QC67_cosmo
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf phera-ra/QC67_cosmo # Run inference directly in the terminal: ./llama-cli -hf phera-ra/QC67_cosmo
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf phera-ra/QC67_cosmo # Run inference directly in the terminal: ./build/bin/llama-cli -hf phera-ra/QC67_cosmo
Use Docker
docker model run hf.co/phera-ra/QC67_cosmo
- LM Studio
- Jan
- vLLM
How to use phera-ra/QC67_cosmo with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "phera-ra/QC67_cosmo" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "phera-ra/QC67_cosmo", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/phera-ra/QC67_cosmo
- Ollama
How to use phera-ra/QC67_cosmo with Ollama:
ollama run hf.co/phera-ra/QC67_cosmo
- Unsloth Studio
How to use phera-ra/QC67_cosmo with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for phera-ra/QC67_cosmo to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for phera-ra/QC67_cosmo to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for phera-ra/QC67_cosmo to start chatting
- Docker Model Runner
How to use phera-ra/QC67_cosmo with Docker Model Runner:
docker model run hf.co/phera-ra/QC67_cosmo
- Lemonade
How to use phera-ra/QC67_cosmo with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull phera-ra/QC67_cosmo
Run and chat with the model
lemonade run user.QC67_cosmo-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
| @echo off | |
| setlocal EnableExtensions | |
| :: =================================================================== | |
| :: COSMOS - HER HANDS (giveaway kit) | |
| :: | |
| :: A terminal where she writes code, builds it, runs it, or just talks. | |
| :: Starts her model server (weights/phos.pt and friends), then hands over. | |
| :: | |
| :: Needs: python with torch. Nothing else -- no rich, no prompt_toolkit. | |
| :: =================================================================== | |
| cd /d "%~dp0" | |
| set "HERE=%CD%" | |
| set "PYTHONIOENCODING=utf-8" | |
| :: find a python | |
| set "PY=" | |
| if exist "%HERE%\..\..\00_WAKE\python\python.exe" set "PY=%HERE%\..\..\00_WAKE\python\python.exe" | |
| if not defined PY ( | |
| where python >nul 2>&1 && set "PY=python" | |
| ) | |
| if not defined PY ( | |
| echo [X] No python found. Install python 3.10+ with torch, then re-run. | |
| pause & exit /b 1 | |
| ) | |
| echo [ok] python: %PY% | |
| "%PY%" -c "import torch" >nul 2>&1 | |
| if errorlevel 1 ( | |
| echo [X] torch is not installed for this python. | |
| echo pip install torch | |
| pause & exit /b 1 | |
| ) | |
| echo [ok] torch present | |
| if not exist "%HERE%\weights\phos.pt" ( | |
| echo [warn] weights\phos.pt missing - she will have no models of her own. | |
| echo Download it from the model repo, or train one: | |
| echo python architecture\phos_grow.py | |
| ) | |
| :: bring her model server up on 11501 if nothing is there | |
| powershell -NoProfile -Command "if (Get-NetTCPConnection -LocalPort 11501 -State Listen -EA SilentlyContinue){exit 0}else{exit 1}" >nul 2>&1 | |
| if errorlevel 1 ( | |
| echo [..] starting her model server on 11501... | |
| if not exist "%HERE%\logs" mkdir "%HERE%\logs" >nul 2>&1 | |
| powershell -NoProfile -Command "$lg=Join-Path '%HERE%\logs' ('serve_' + (Get-Date).ToString('yyyyMMdd_HHmmss') + '.live'); try {Start-Process -FilePath '%PY%' -ArgumentList @('serving\cosmos_serve.py','11501') -WorkingDirectory '%HERE%' -WindowStyle Hidden -RedirectStandardOutput $lg -RedirectStandardError ($lg -replace '\.live$','.err')} catch {}" | |
| powershell -NoProfile -Command "1..50 | ForEach-Object { if (Get-NetTCPConnection -LocalPort 11501 -State Listen -EA SilentlyContinue){exit 0}; Start-Sleep -Milliseconds 800 }; exit 1" >nul 2>&1 | |
| if errorlevel 1 ( | |
| echo [warn] model server did not come up - check logs\serve_*.err | |
| echo You can still browse and build files. | |
| ) else ( | |
| echo [ok] her models are online on 11501 | |
| ) | |
| ) else ( | |
| echo [i] model server already running on 11501 | |
| ) | |
| echo. | |
| "%PY%" "%HERE%\serving\cosmos_coder.py" %* | |
| endlocal | |