Upload folder using huggingface_hub

README.md

@@ -23,13 +23,13 @@ Nanochat is a small language model from Andrej Karpathy, converted to HuggingFac
 
 ## Usage
 
-This model uses a custom tokenizer. You must use `trust_remote_code=True` when loading.
+### With Transformers (PyTorch)
 
 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer
 
 model = AutoModelForCausalLM.from_pretrained("<model-path>", trust_remote_code=True)
-tokenizer = AutoTokenizer.from_pretrained("<model-path>", trust_remote_code=True)
+tokenizer = AutoTokenizer.from_pretrained("<model-path>")
 
 prompt = "Once upon a time"
 inputs = tokenizer(prompt, return_tensors="pt")
@@ -37,6 +37,15 @@ outputs = model.generate(**inputs, max_new_tokens=50)
 print(tokenizer.decode(outputs[0]))
 ```
 
+### Converting to MLX
+
+To use with Apple's MLX framework:
+
+```bash
+mlx_lm.convert --hf-path <model-path> --mlx-path nanochat-mlx --trust-remote-code
+mlx_lm.generate --model nanochat-mlx --prompt "Once upon a time"
+```
+
 ## Citation
 
 Original model by Andrej Karpathy: https://github.com/karpathy/nanochat

tiktoken/tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:22b70a034f8864b798f8349672ee348cbc519406fc71af52ee54f0eb83b1eece
+size 1139659