Text Generation
MLX
English
German
next-concept-modeling
apple-silicon
diffusion-lm
research-code
negative-results
Instructions to use Red-fuchs/ncm-modular with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use Red-fuchs/ncm-modular with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("Red-fuchs/ncm-modular") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use Red-fuchs/ncm-modular with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "Red-fuchs/ncm-modular" --prompt "Once upon a time"
- Atomic Chat
Download pyproject.toml from Red-fuchs/ncm-modular: direct link, hf CLI and curl.
- Browser
- Download file 1.16 kB
-
https://huggingface.co/Red-fuchs/ncm-modular/resolve/main/pyproject.toml
- Command line
-
hf download hf://Red-fuchs/ncm-modular/pyproject.toml
-
curl -L -o pyproject.toml https://huggingface.co/Red-fuchs/ncm-modular/resolve/main/pyproject.toml
1.16 kB
| [project] | |
| name = "ncm-modular" | |
| version = "0.1.0" | |
| description = "MLX port of the NCM XSum/WMT14 codecs, surrogate masking, prefix-conditioned NCM generator training and a block-seam experiment (Apple Silicon)" | |
| readme = "README.md" | |
| license = "MIT" | |
| requires-python = ">=3.11" | |
| dependencies = [ | |
| "mlx==0.32.3", | |
| "numpy", | |
| "safetensors", | |
| "transformers", # tokenizers (gpt2, Qwen3-0.6B) for codec round trips / MASSIVE pilot | |
| "pyarrow", # massive_build.py reads the MASSIVE parquet files | |
| "ncm-mlx==0.2.0", # janmus1c/ncm-mlx (MIT): official TinyStories codec, Block/rope/BPE used by the seam + generator code | |
| ] | |
| [project.urls] | |
| Homepage = "https://github.com/Red-fuchs/ncm-modular" | |
| Repository = "https://github.com/Red-fuchs/ncm-modular" | |
| "Hugging Face" = "https://huggingface.co/Red-fuchs/ncm-modular" | |
| [project.optional-dependencies] | |
| torch = ["torch", "omegaconf", "pyyaml"] # only convert.py / ref_dump.py / ref_torch.py (needs a HazyResearch/ncm checkout via NCM_UPSTREAM) | |
| judge = ["mlx-lm"] # seam/judge.py | |
| [tool.setuptools] | |
| py-modules = [] # scripts, run as `python src/ncm_modular/<script>.py`; no installable package | |