Instructions to use FerrellSyntheticIntelligence/fsi-anomaly with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use FerrellSyntheticIntelligence/fsi-anomaly with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf FerrellSyntheticIntelligence/fsi-anomaly # Run inference directly in the terminal: llama cli -hf FerrellSyntheticIntelligence/fsi-anomaly
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf FerrellSyntheticIntelligence/fsi-anomaly # Run inference directly in the terminal: llama cli -hf FerrellSyntheticIntelligence/fsi-anomaly
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf FerrellSyntheticIntelligence/fsi-anomaly # Run inference directly in the terminal: ./llama-cli -hf FerrellSyntheticIntelligence/fsi-anomaly
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf FerrellSyntheticIntelligence/fsi-anomaly # Run inference directly in the terminal: ./build/bin/llama-cli -hf FerrellSyntheticIntelligence/fsi-anomaly
Use Docker
docker model run hf.co/FerrellSyntheticIntelligence/fsi-anomaly
- LM Studio
- Jan
- Ollama
How to use FerrellSyntheticIntelligence/fsi-anomaly with Ollama:
ollama run hf.co/FerrellSyntheticIntelligence/fsi-anomaly
- Unsloth Desktop
- Docker Model Runner
How to use FerrellSyntheticIntelligence/fsi-anomaly with Docker Model Runner:
docker model run hf.co/FerrellSyntheticIntelligence/fsi-anomaly
- Lemonade
How to use FerrellSyntheticIntelligence/fsi-anomaly with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull FerrellSyntheticIntelligence/fsi-anomaly
Run and chat with the model
lemonade run user.fsi-anomaly-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
Publishing TinyLiquid Analyst on Hugging Face (for downloads → grants/loans)
1. Prepare the artifact
export PYTHONPATH=$PWD
# after the training pipeline finishes (ckpt/dpo exists):
.venv/bin/python hf/export_hf.py --ckpt ckpt/dpo --out hf_repo # safetensors + q8 + configs + modeling file
.venv/bin/python hf/export_gguf.py --ckpt ckpt/dpo --out hf_repo/tiny-liquid-q8.gguf
.venv/bin/python eval/bench.py --ckpt ckpt/dpo --out bench/metrics.json
.venv/bin/python hf/build_card.py --metrics bench/metrics.json # model card from real metrics
Sanity checks before publishing:
# 1) transformers path (trust_remote_code) produces coherent text
.venv/bin/python - << 'PY'
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("hf_repo")
m = AutoModelForCausalLM.from_pretrained("hf_repo", trust_remote_code=True)
m.persona_id = 1
ids = tok("<|analyst|><|user|>Verify: 'The bridge was painted in 2019 and never repainted.' Records show a 2022 repaint permit.<|assistant|>", return_tensors="pt").input_ids
print(tok.decode(m.generate(ids, max_new_tokens=80, do_sample=True)[0]))
PY
# 2) GGUF round-trips natively
.venv/bin/python -m model.gguf_runtime --gguf hf_repo/tiny-liquid-q8.gguf \
--prompt "<|analyst|><|user|>What's your take on coincidences?<|assistant|>"
2. Publish
huggingface-cli login # paste your HF token
.venv/bin/python hf_upload.py --repo YOURNAME/tiny-liquid-analyst
Then on the HF web page:
- set the License to
apache-2.0(already in the model card metadata), - add tags:
tiny-model,on-device,liquid-architecture,fact-checking,osint,gguf, - add a demo (optional):
demo/serve.pybehind a tunnel, or the HF Spaces template, - pin the README's
YOUR-ORGlinks after upload.
3. Grant/loan-ready framing (what reviewers look for)
- Reproducibility: every step in this repo is scripted (
run_*.sh,data/gen_*.py,hf/export_*.py,eval/bench.py). Include the commit hash in your application. - Originality: non-transformer liquid architecture, own tokenizer, own data pipeline, own SOP/agent tooling — nothing is a wrapper around another model.
- Efficiency story: 7.8M params, trained on an 8-core ARM laptop with no GPU, quantized to ~5-11 MB. That is the headline for edge-AI grants: SOTA-scale capability per watt.
- Evidence:
bench/metrics.json(val perplexity, probe accuracy, tok/s) plus generation samples in the model card. Add a short technical report citing them. - Guardrails: the OSINT/dark-web tooling is scoped to authorized research with hard stop rules — show this explicitly; it de-risks your application.
- Community: answer questions on the HF discussion tab, add a Spaces demo, and post quantization/config updates. Downloads follow usefulness, not hype.
4. Growth levers after v1
- Code stage (continuation pretraining on
data/code_train.bin) — planned next. - Bigger variant (e.g., 30-60M MoE) once a GPU or cloud budget appears.
- Multilingual tokenizer + a second persona language.
- ONNX export + onnxruntime for even faster ARM inference.