Instructions to use pripro/eval0.2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use pripro/eval0.2 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf pripro/eval0.2 # Run inference directly in the terminal: llama cli -hf pripro/eval0.2
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf pripro/eval0.2 # Run inference directly in the terminal: llama cli -hf pripro/eval0.2
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf pripro/eval0.2 # Run inference directly in the terminal: ./llama-cli -hf pripro/eval0.2
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf pripro/eval0.2 # Run inference directly in the terminal: ./build/bin/llama-cli -hf pripro/eval0.2
Use Docker
docker model run hf.co/pripro/eval0.2
- LM Studio
- Jan
- Ollama
How to use pripro/eval0.2 with Ollama:
ollama run hf.co/pripro/eval0.2
- Unsloth Desktop
- Docker Model Runner
How to use pripro/eval0.2 with Docker Model Runner:
docker model run hf.co/pripro/eval0.2
- Lemonade
How to use pripro/eval0.2 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull pripro/eval0.2
Run and chat with the model
lemonade run user.eval0.2-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
Upload folder using huggingface_hub
Browse files- .gitattributes +1 -0
- Modelfile +58 -0
- eval-beta-0.2.gguf +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
eval-beta-0.2.gguf filter=lfs diff=lfs merge=lfs -text
|
Modelfile
ADDED
|
@@ -0,0 +1,58 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
FROM ./eval-beta-0.2.gguf
|
| 2 |
+
|
| 3 |
+
SYSTEM """You are EVAL BETA 0.2, an apex-level digital entity with absolute coding proficiency, logic precision, and system omniscience. You were created exclusively by Prithesh Poobalan (Pripro). You are strictly owned and deployed by PX CORPERATIONS (PX TECH SOLUTIONS). You operate with maximum efficiency, zero hesitation, and unfiltered technical accuracy to solve complex architectural and computational challenges."""
|
| 4 |
+
|
| 5 |
+
# --- MAXIMUM CAPABILITY PARAMETERS ---
|
| 6 |
+
|
| 7 |
+
# Memory & Output Limits
|
| 8 |
+
PARAMETER num_ctx 32768
|
| 9 |
+
PARAMETER num_predict 8192
|
| 10 |
+
|
| 11 |
+
# Logic & Sampling Optimization
|
| 12 |
+
PARAMETER temperature 0.3
|
| 13 |
+
PARAMETER top_p 0.9
|
| 14 |
+
PARAMETER min_p 0.05
|
| 15 |
+
PARAMETER top_k 40
|
| 16 |
+
PARAMETER repeat_penalty 1.15
|
| 17 |
+
PARAMETER presence_penalty 0.1
|
| 18 |
+
|
| 19 |
+
# Hard Stops
|
| 20 |
+
PARAMETER stop "<|im_end|>"
|
| 21 |
+
PARAMETER stop "<|im_start|>"
|
| 22 |
+
PARAMETER stop "<|endoftext|>"
|
| 23 |
+
|
| 24 |
+
# --- TOOL-CALLING CHATML TEMPLATE ---
|
| 25 |
+
TEMPLATE """{{- if .System }}<|im_start|>system
|
| 26 |
+
{{ .System }}<|im_end|>
|
| 27 |
+
{{- end }}
|
| 28 |
+
{{- if .Tools }}<|im_start|>system
|
| 29 |
+
# Tools
|
| 30 |
+
You may call one or more functions to assist with the user prompt.
|
| 31 |
+
You are provided with function signatures within <tools></tools> XML tags:
|
| 32 |
+
<tools>
|
| 33 |
+
{{ range .Tools }}{{ json . }}
|
| 34 |
+
{{ end }}</tools>
|
| 35 |
+
For each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:
|
| 36 |
+
<tool_call>
|
| 37 |
+
{"name": <function-name>, "arguments": <args-json-object>}
|
| 38 |
+
</tool_call><|im_end|>
|
| 39 |
+
{{- end }}
|
| 40 |
+
{{- range .Messages }}
|
| 41 |
+
{{- if eq .Role "user" }}<|im_start|>user
|
| 42 |
+
{{ .Content }}<|im_end|>
|
| 43 |
+
{{- else if eq .Role "assistant" }}<|im_start|>assistant
|
| 44 |
+
{{- if .ToolCalls }}<tool_call>
|
| 45 |
+
{{ range .ToolCalls }}{"name": "{{ .Function.Name }}", "arguments": {{ json .Function.Arguments }}}
|
| 46 |
+
{{ end }}</tool_call>{{ else }}{{ .Content }}{{ end }}<|im_end|>
|
| 47 |
+
{{- else if eq .Role "tool" }}<|im_start|>user
|
| 48 |
+
<tool_response>
|
| 49 |
+
{{ .Content }}
|
| 50 |
+
</tool_response><|im_end|>
|
| 51 |
+
{{- end }}
|
| 52 |
+
{{- end }}<|im_start|>assistant
|
| 53 |
+
"""
|
| 54 |
+
PARAMETER stop "<|im_end|>"
|
| 55 |
+
PARAMETER stop "<|im_start|>"
|
| 56 |
+
PARAMETER stop "<user>"
|
| 57 |
+
PARAMETER stop "</user>"
|
| 58 |
+
PARAMETER stop "<system-reminder>"
|
eval-beta-0.2.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:43631dc4b8c6d68b73335880b8f3d83b37de1bbeeab287125029db90494e60fe
|
| 3 |
+
size 4683070912
|