Instructions to use namanadep/foundational-llama-scratch-epic-model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use namanadep/foundational-llama-scratch-epic-model with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf namanadep/foundational-llama-scratch-epic-model
# Run inference directly in the terminal:
llama cli -hf namanadep/foundational-llama-scratch-epic-model

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf namanadep/foundational-llama-scratch-epic-model
# Run inference directly in the terminal:
llama cli -hf namanadep/foundational-llama-scratch-epic-model

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf namanadep/foundational-llama-scratch-epic-model
# Run inference directly in the terminal:
./llama-cli -hf namanadep/foundational-llama-scratch-epic-model

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf namanadep/foundational-llama-scratch-epic-model
# Run inference directly in the terminal:
./build/bin/llama-cli -hf namanadep/foundational-llama-scratch-epic-model

Use Docker

docker model run hf.co/namanadep/foundational-llama-scratch-epic-model

LM Studio
Jan

vLLM

How to use namanadep/foundational-llama-scratch-epic-model with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "namanadep/foundational-llama-scratch-epic-model"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "namanadep/foundational-llama-scratch-epic-model",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/namanadep/foundational-llama-scratch-epic-model

Ollama
How to use namanadep/foundational-llama-scratch-epic-model with Ollama:
```
ollama run hf.co/namanadep/foundational-llama-scratch-epic-model
```

Unsloth Studio

How to use namanadep/foundational-llama-scratch-epic-model with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for namanadep/foundational-llama-scratch-epic-model to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for namanadep/foundational-llama-scratch-epic-model to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for namanadep/foundational-llama-scratch-epic-model to start chatting

Docker Model Runner
How to use namanadep/foundational-llama-scratch-epic-model with Docker Model Runner:
```
docker model run hf.co/namanadep/foundational-llama-scratch-epic-model
```

Lemonade

How to use namanadep/foundational-llama-scratch-epic-model with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull namanadep/foundational-llama-scratch-epic-model

Run and chat with the model

lemonade run user.foundational-llama-scratch-epic-model-{{QUANT_TAG}}

List all available models

lemonade list

Atomic Chat

foundational-llama-scratch-epic-model / FOUNDATIONAL_MODEL_EPIC /tokenizer /tokenizer.json

namanadep

Upload Foundational Scratch Epic Model suite (PyTorch & GGUF weights, code, tokenizer, Reflection AI strategy, presentation)

54a634f verified 7 days ago

Raw

History Blame Contribute Delete

4.15 kB

	{
	"version": "1.0",
	"truncation": null,
	"padding": null,
	"added_tokens": [
	{
	"id": 0,
	"content": "<unk>",
	"single_word": false,
	"lstrip": false,
	"rstrip": false,
	"normalized": false,
	"special": true
	},
	{
	"id": 1,
	"content": "<s>",
	"single_word": false,
	"lstrip": false,
	"rstrip": false,
	"normalized": false,
	"special": true
	},
	{
	"id": 2,
	"content": "</s>",
	"single_word": false,
	"lstrip": false,
	"rstrip": false,
	"normalized": false,
	"special": true
	},
	{
	"id": 3,
	"content": "<pad>",
	"single_word": false,
	"lstrip": false,
	"rstrip": false,
	"normalized": false,
	"special": true
	},
	{
	"id": 4,
	"content": "<mask>",
	"single_word": false,
	"lstrip": false,
	"rstrip": false,
	"normalized": false,
	"special": true
	}
	],
	"normalizer": null,
	"pre_tokenizer": {
	"type": "ByteLevel",
	"add_prefix_space": false,
	"trim_offsets": true,
	"use_regex": true
	},
	"post_processor": {
	"type": "ByteLevel",
	"add_prefix_space": true,
	"trim_offsets": false,
	"use_regex": true
	},
	"decoder": {
	"type": "ByteLevel",
	"add_prefix_space": true,
	"trim_offsets": true,
	"use_regex": true
	},
	"model": {
	"type": "BPE",
	"dropout": null,
	"unk_token": "<unk>",
	"continuing_subword_prefix": null,
	"end_of_word_suffix": null,
	"fuse_unk": false,
	"byte_fallback": false,
	"ignore_merges": false,
	"vocab": {
	"<unk>": 0,
	"<s>": 1,
	"</s>": 2,
	"<pad>": 3,
	"<mask>": 4,
	"'": 5,
	"*": 6,
	";": 7,
	"=": 8,
	"C": 9,
	"E": 10,
	"F": 11,
	"H": 12,
	"L": 13,
	"M": 14,
	"O": 15,
	"R": 16,
	"S": 17,
	"T": 18,
	"W": 19,
	"a": 20,
	"c": 21,
	"e": 22,
	"i": 23,
	"r": 24,
	"s": 25,
	"t": 26,
	"u": 27,
	"v": 28,
	"Ċ": 29,
	"Ġ": 30,
	"us": 31,
	"';": 32,
	"CT": 33,
	"EL": 34,
	"ER": 35,
	"ECT": 36,
	"FR": 37,
	"HER": 38,
	"OM": 39,
	"SEL": 40,
	"WHER": 41,
	"ac": 42,
	"at": 43,
	"er": 44,
	"iv": 45,
	"st": 46,
	"tiv": 47,
	"Ġ'": 48,
	"Ġ*": 49,
	"Ġ=": 50,
	"Ġus": 51,
	"ĠFR": 52,
	"ĠWHER": 53,
	"Ġst": 54,
	"SELECT": 55,
	"activ": 56,
	"atus": 57,
	"ers": 58,
	"Ġusers": 59,
	"ĠFROM": 60,
	"ĠWHERE": 61,
	"Ġstatus": 62,
	"active": 63
	},
	"merges": [
	[
	"u",
	"s"
	],
	[
	"'",
	";"
	],
	[
	"C",
	"T"
	],
	[
	"E",
	"L"
	],
	[
	"E",
	"R"
	],
	[
	"E",
	"CT"
	],
	[
	"F",
	"R"
	],
	[
	"H",
	"ER"
	],
	[
	"O",
	"M"
	],
	[
	"S",
	"EL"
	],
	[
	"W",
	"HER"
	],
	[
	"a",
	"c"
	],
	[
	"a",
	"t"
	],
	[
	"e",
	"r"
	],
	[
	"i",
	"v"
	],
	[
	"s",
	"t"
	],
	[
	"t",
	"iv"
	],
	[
	"Ġ",
	"'"
	],
	[
	"Ġ",
	"*"
	],
	[
	"Ġ",
	"="
	],
	[
	"Ġ",
	"us"
	],
	[
	"Ġ",
	"FR"
	],
	[
	"Ġ",
	"WHER"
	],
	[
	"Ġ",
	"st"
	],
	[
	"SEL",
	"ECT"
	],
	[
	"ac",
	"tiv"
	],
	[
	"at",
	"us"
	],
	[
	"er",
	"s"
	],
	[
	"Ġus",
	"ers"
	],
	[
	"ĠFR",
	"OM"
	],
	[
	"ĠWHER",
	"E"
	],
	[
	"Ġst",
	"atus"
	],
	[
	"activ",
	"e"
	]
	]
	}
	}