Text Generation
Safetensors
GGUF
English
reasoning
reinforcement-learning
grpo
small-language-model
samsung-ennovatex
conversational
Instructions to use OmnipotentFool/Aurvion with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use OmnipotentFool/Aurvion with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf OmnipotentFool/Aurvion:Q4_K_M # Run inference directly in the terminal: llama cli -hf OmnipotentFool/Aurvion:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf OmnipotentFool/Aurvion:Q4_K_M # Run inference directly in the terminal: llama cli -hf OmnipotentFool/Aurvion:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf OmnipotentFool/Aurvion:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf OmnipotentFool/Aurvion:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf OmnipotentFool/Aurvion:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf OmnipotentFool/Aurvion:Q4_K_M
Use Docker
docker model run hf.co/OmnipotentFool/Aurvion:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use OmnipotentFool/Aurvion with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "OmnipotentFool/Aurvion" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OmnipotentFool/Aurvion", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/OmnipotentFool/Aurvion:Q4_K_M
- Ollama
How to use OmnipotentFool/Aurvion with Ollama:
ollama run hf.co/OmnipotentFool/Aurvion:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use OmnipotentFool/Aurvion with Docker Model Runner:
docker model run hf.co/OmnipotentFool/Aurvion:Q4_K_M
- Lemonade
How to use OmnipotentFool/Aurvion with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull OmnipotentFool/Aurvion:Q4_K_M
Run and chat with the model
lemonade run user.Aurvion-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Download llama.cpp/build/tools/ui/ui-src/node_modules/@sveltejs/kit/package.json from OmnipotentFool/Aurvion: direct link, hf CLI and curl.
- Browser
- Download file 4.44 kB
-
https://huggingface.co/OmnipotentFool/Aurvion/resolve/main/llama.cpp/build/tools/ui/ui-src/node_modules/%40sveltejs/kit/package.json
- Command line
-
hf download hf://OmnipotentFool/Aurvion/llama.cpp/build/tools/ui/ui-src/node_modules/@sveltejs/kit/package.json
-
curl -L -o package.json https://huggingface.co/OmnipotentFool/Aurvion/resolve/main/llama.cpp/build/tools/ui/ui-src/node_modules/%40sveltejs/kit/package.json
4.44 kB
| { | |
| "name": "@sveltejs/kit", | |
| "version": "2.60.1", | |
| "description": "SvelteKit is the fastest way to build Svelte apps", | |
| "keywords": [ | |
| "framework", | |
| "official", | |
| "svelte", | |
| "sveltekit", | |
| "vite" | |
| ], | |
| "repository": { | |
| "type": "git", | |
| "url": "git+https://github.com/sveltejs/kit.git", | |
| "directory": "packages/kit" | |
| }, | |
| "license": "MIT", | |
| "homepage": "https://svelte.dev", | |
| "type": "module", | |
| "dependencies": { | |
| "@standard-schema/spec": "^1.0.0", | |
| "@sveltejs/acorn-typescript": "^1.0.5", | |
| "@types/cookie": "^0.6.0", | |
| "acorn": "^8.14.1", | |
| "cookie": "^0.6.0", | |
| "devalue": "^5.8.1", | |
| "esm-env": "^1.2.2", | |
| "kleur": "^4.1.5", | |
| "magic-string": "^0.30.5", | |
| "mrmime": "^2.0.0", | |
| "set-cookie-parser": "^3.0.0", | |
| "sirv": "^3.0.0" | |
| }, | |
| "devDependencies": { | |
| "@opentelemetry/api": "^1.0.0", | |
| "@playwright/test": "^1.59.1", | |
| "@sveltejs/vite-plugin-svelte": "^6.0.0-next.3", | |
| "@types/connect": "^3.4.38", | |
| "@types/node": "^18.19.119", | |
| "@types/set-cookie-parser": "^2.4.7", | |
| "dts-buddy": "^0.7.0", | |
| "rollup": "^4.59.0", | |
| "svelte": "^5.55.7", | |
| "typescript": "^5.3.3", | |
| "vite": "^6.4.2", | |
| "vitest": "^4.0.0" | |
| }, | |
| "peerDependencies": { | |
| "@sveltejs/vite-plugin-svelte": "^3.0.0 || ^4.0.0-next.1 || ^5.0.0 || ^6.0.0-next.0 || ^7.0.0", | |
| "@opentelemetry/api": "^1.0.0", | |
| "svelte": "^4.0.0 || ^5.0.0-next.0", | |
| "typescript": "^5.3.3 || ^6.0.0", | |
| "vite": "^5.0.3 || ^6.0.0 || ^7.0.0-beta.0 || ^8.0.0" | |
| }, | |
| "peerDependenciesMeta": { | |
| "@opentelemetry/api": { | |
| "optional": true | |
| }, | |
| "typescript": { | |
| "optional": true | |
| } | |
| }, | |
| "bin": { | |
| "svelte-kit": "svelte-kit.js" | |
| }, | |
| "files": [ | |
| "src", | |
| "!src/**/*.spec.js", | |
| "!src/core/**/fixtures", | |
| "!src/core/**/test", | |
| "types", | |
| "svelte-kit.js" | |
| ], | |
| "imports": { | |
| "#app/paths": { | |
| "browser": "./src/runtime/app/paths/client.js", | |
| "default": "./src/runtime/app/paths/server.js" | |
| } | |
| }, | |
| "exports": { | |
| "./package.json": "./package.json", | |
| ".": { | |
| "types": "./types/index.d.ts", | |
| "import": "./src/exports/index.js" | |
| }, | |
| "./internal": { | |
| "types": "./types/index.d.ts", | |
| "import": "./src/exports/internal/index.js" | |
| }, | |
| "./internal/server": { | |
| "types": "./types/index.d.ts", | |
| "import": "./src/exports/internal/server.js" | |
| }, | |
| "./node": { | |
| "types": "./types/index.d.ts", | |
| "import": "./src/exports/node/index.js" | |
| }, | |
| "./node/polyfills": { | |
| "types": "./types/index.d.ts", | |
| "import": "./src/exports/node/polyfills.js" | |
| }, | |
| "./hooks": { | |
| "types": "./types/index.d.ts", | |
| "import": "./src/exports/hooks/index.js" | |
| }, | |
| "./vite": { | |
| "types": "./types/index.d.ts", | |
| "import": "./src/exports/vite/index.js" | |
| } | |
| }, | |
| "types": "types/index.d.ts", | |
| "engines": { | |
| "node": ">=18.13" | |
| }, | |
| "scripts": { | |
| "lint": "prettier --config ../../.prettierrc --check .", | |
| "check": "tsc && cd ./test/types && tsc", | |
| "check:all": "tsc && pnpm -r --filter=\"./**\" check", | |
| "format": "prettier --config ../../.prettierrc --write .", | |
| "test": "pnpm test:unit && pnpm test:integration", | |
| "test:integration": "pnpm -r --workspace-concurrency 1 --filter=\"./test/**\" test", | |
| "test:cross-platform:dev": "pnpm -r --workspace-concurrency 1 --filter=\"./test/**\" test:cross-platform:dev", | |
| "test:cross-platform:build": "pnpm test:unit && pnpm -r --workspace-concurrency 1 --filter=\"./test/**\" test:cross-platform:build", | |
| "test:server-side-route-resolution:dev": "pnpm -r --workspace-concurrency 1 --filter=\"./test/**\" test:server-side-route-resolution:dev", | |
| "test:server-side-route-resolution:build": "pnpm test:unit && pnpm -r --workspace-concurrency 1 --filter=\"./test/**\" test:server-side-route-resolution:build", | |
| "test:svelte-async:dev": "pnpm -r --workspace-concurrency 1 --filter=\"./test/**\" test:svelte-async:dev", | |
| "test:svelte-async:build": "pnpm test:unit && pnpm -r --workspace-concurrency 1 --filter=\"./test/**\" test:svelte-async:build", | |
| "test:unit:dev": "vitest --config kit.vitest.config.js run", | |
| "test:unit:prod": "NODE_ENV=production vitest --config kit.vitest.config.js run csp.spec.js cookie.spec.js", | |
| "test:unit": "pnpm test:unit:dev && pnpm test:unit:prod", | |
| "generate:version": "node scripts/generate-version.js", | |
| "generate:types": "node scripts/generate-dts.js" | |
| } | |
| } |