Text Generation
Transformers
Safetensors
GGUF
English
causal-lm
qwen2.5
reasoning
code-generation
Mixture of Experts
qlora
multimodal
tool-use
Eval Results (legacy)
conversational
Instructions to use ram1234598766/Cesium2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ram1234598766/Cesium2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="ram1234598766/Cesium2") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ram1234598766/Cesium2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use ram1234598766/Cesium2 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf ram1234598766/Cesium2:Q8_0 # Run inference directly in the terminal: llama cli -hf ram1234598766/Cesium2:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf ram1234598766/Cesium2:Q8_0 # Run inference directly in the terminal: llama cli -hf ram1234598766/Cesium2:Q8_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf ram1234598766/Cesium2:Q8_0 # Run inference directly in the terminal: ./llama-cli -hf ram1234598766/Cesium2:Q8_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf ram1234598766/Cesium2:Q8_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf ram1234598766/Cesium2:Q8_0
Use Docker
docker model run hf.co/ram1234598766/Cesium2:Q8_0
- LM Studio
- Jan
- vLLM
How to use ram1234598766/Cesium2 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "ram1234598766/Cesium2" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ram1234598766/Cesium2", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/ram1234598766/Cesium2:Q8_0
- SGLang
How to use ram1234598766/Cesium2 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "ram1234598766/Cesium2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ram1234598766/Cesium2", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "ram1234598766/Cesium2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ram1234598766/Cesium2", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Ollama
How to use ram1234598766/Cesium2 with Ollama:
ollama run hf.co/ram1234598766/Cesium2:Q8_0
- Unsloth Studio
How to use ram1234598766/Cesium2 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ram1234598766/Cesium2 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ram1234598766/Cesium2 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for ram1234598766/Cesium2 to start chatting
- Pi
How to use ram1234598766/Cesium2 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf ram1234598766/Cesium2:Q8_0
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "ram1234598766/Cesium2:Q8_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use ram1234598766/Cesium2 with Docker Model Runner:
docker model run hf.co/ram1234598766/Cesium2:Q8_0
- Lemonade
How to use ram1234598766/Cesium2 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull ram1234598766/Cesium2:Q8_0
Run and chat with the model
lemonade run user.Cesium2-Q8_0
List all available models
lemonade list
- Hermes Agent
How to use ram1234598766/Cesium2 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf ram1234598766/Cesium2:Q8_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default ram1234598766/Cesium2:Q8_0
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use ram1234598766/Cesium2 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf ram1234598766/Cesium2:Q8_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "ram1234598766/Cesium2:Q8_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
| """Tests for MORPH-AI v6 components (no model required).""" | |
| import sys | |
| import torch | |
| from pathlib import Path | |
| ROOT = Path(__file__).resolve().parent.parent | |
| sys.path.insert(0, str(ROOT / "src")) | |
| from architecture import ( | |
| MorphConfig, MorphModel, MixtureOfDepths, MemoryEfficientAttention, | |
| DynamicMoEBlock, MultimodalFusion, ToolUseModule, DocumentModule, | |
| VideoModule, CodeSandbox, QuantizedMemoryModule, build_code_features, | |
| ) | |
| from audio import AudioModule, AudioFacts | |
| from video import VideoModule as VM | |
| from document import DocumentModule as DM | |
| from tools import ToolRegistry, ToolCall | |
| def test_mod_forward(): | |
| cfg = MorphConfig(mod_hidden=64, mod_keep_prob=0.8) | |
| mod = MixtureOfDepths(128, cfg.mod_hidden, cfg.mod_keep_prob) | |
| x = torch.randn(2, 16, 128) | |
| out, probs = mod(x) | |
| assert out.shape == x.shape | |
| assert probs.shape == (2, 16, 1) | |
| assert (probs >= 0).all() and (probs <= 1).all() | |
| def test_memory_efficient_attention(): | |
| attn = MemoryEfficientAttention(64, 4) | |
| x = torch.randn(2, 8, 64) | |
| out = attn(x) | |
| assert out.shape == x.shape | |
| def test_dynamic_moe_block(): | |
| moe = DynamicMoEBlock(128, 4, 256, 2, prune_threshold=0.01) | |
| x = torch.randn(2, 8, 128) | |
| out, aux = moe(x) | |
| assert out.shape == x.shape | |
| assert aux.item() >= 0 | |
| def test_multimodal_fusion(): | |
| cfg = MorphConfig() | |
| fusion = MultimodalFusion(cfg, 128) | |
| text = torch.randn(2, 8, 128) | |
| vision = torch.randn(2, 8, 768) | |
| out = fusion(text, vision) | |
| assert out.shape == text.shape | |
| def test_tool_use_module(): | |
| cfg = MorphConfig() | |
| tool = ToolUseModule(cfg, 128) | |
| x = torch.randn(2, 8, 128) | |
| tool_emb, args = tool(x) | |
| assert tool_emb.shape[0] == 2 | |
| assert args.shape == (2, 128) | |
| def test_document_module(): | |
| cfg = MorphConfig() | |
| doc = DocumentModule(cfg, 128) | |
| x = torch.randn(2, 8, 128) | |
| out = doc(x) | |
| assert out.shape == x.shape | |
| def test_video_module(): | |
| cfg = MorphConfig() | |
| video = VideoModule(cfg, 128) | |
| x = torch.randn(2, 8, 128) | |
| frames = torch.randn(4, 128) | |
| out = video(x, frames.unsqueeze(0)) | |
| assert out.shape == x.shape | |
| def test_code_sandbox(): | |
| sandbox = CodeSandbox(timeout=2.0) | |
| result = sandbox.execute("1 + 1") | |
| assert result["success"] is True | |
| assert "2" in result["output"] | |
| result = sandbox.execute("import os") | |
| assert result["success"] is False | |
| assert "not allowed" in result["error"] | |
| def test_quantized_memory(): | |
| mem = QuantizedMemoryModule(256, 128, 256, quantize=True, quant_bits=8) | |
| x = torch.randn(2, 8, 256) | |
| mem.write(x) | |
| out = mem.read(x) | |
| assert out.shape == x.shape | |
| def test_tool_registry(): | |
| registry = ToolRegistry() | |
| assert "calculator" in registry._tools | |
| assert "search" in registry._tools | |
| assert "code_exec" in registry._tools | |
| schema = registry.get_tool_schema() | |
| assert "calculator" in schema | |
| def test_audio_module_init(): | |
| cfg = MorphConfig() | |
| audio = AudioModule(cfg, 768) | |
| assert audio is not None | |
| def test_build_code_features_v7(): | |
| from transformers import AutoTokenizer | |
| tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2.5-1.5B-Instruct", trust_remote_code=True) | |
| ids = torch.tensor([[1, 2, 3, 4, 5]]) | |
| feats = build_code_features(tokenizer, ids) | |
| assert feats.shape[-1] == 4 | |
| def test_video_analyze(): | |
| from video import VideoModule as VM | |
| vm = VM(MorphConfig(), 128) | |
| facts = vm.analyze("nonexistent.mp4") | |
| assert isinstance(facts.to_text(), str) | |
| def test_document_extract(): | |
| cfg = MorphConfig() | |
| dm = DocumentModule(cfg, 128) | |
| result = dm.extract_text("nonexistent.pdf") | |
| assert isinstance(result, str) | |
| if __name__ == "__main__": | |
| test_mod_forward() | |
| test_memory_efficient_attention() | |
| test_dynamic_moe_block() | |
| test_multimodal_fusion() | |
| test_tool_use_module() | |
| test_document_module() | |
| test_video_module() | |
| test_code_sandbox() | |
| test_quantized_memory() | |
| test_tool_registry() | |
| test_audio_module_init() | |
| test_build_code_features_v7() | |
| test_video_analyze() | |
| test_document_extract() | |
| print("All v6 component tests passed!") | |