Text Generation
Safetensors
GGUF
English
reasoning
reinforcement-learning
grpo
small-language-model
samsung-ennovatex
conversational
Instructions to use OmnipotentFool/Aurvion with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use OmnipotentFool/Aurvion with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf OmnipotentFool/Aurvion:Q4_K_M # Run inference directly in the terminal: llama cli -hf OmnipotentFool/Aurvion:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf OmnipotentFool/Aurvion:Q4_K_M # Run inference directly in the terminal: llama cli -hf OmnipotentFool/Aurvion:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf OmnipotentFool/Aurvion:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf OmnipotentFool/Aurvion:Q4_K_M
Use Docker
docker model run hf.co/OmnipotentFool/Aurvion:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use OmnipotentFool/Aurvion with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "OmnipotentFool/Aurvion" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OmnipotentFool/Aurvion", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/OmnipotentFool/Aurvion:Q4_K_M
- Ollama
How to use OmnipotentFool/Aurvion with Ollama:
ollama run hf.co/OmnipotentFool/Aurvion:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use OmnipotentFool/Aurvion with Docker Model Runner:
docker model run hf.co/OmnipotentFool/Aurvion:Q4_K_M
- Lemonade
How to use OmnipotentFool/Aurvion with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull OmnipotentFool/Aurvion:Q4_K_M
Run and chat with the model
lemonade run user.Aurvion-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Download llama.cpp/build/tools/ui/ui-src/node_modules/@ampproject/remapping/package.json from OmnipotentFool/Aurvion: direct link, hf CLI and curl.
- Browser
- Download file 2.23 kB
-
https://huggingface.co/OmnipotentFool/Aurvion/resolve/main/llama.cpp/build/tools/ui/ui-src/node_modules/%40ampproject/remapping/package.json
- Command line
-
hf download hf://OmnipotentFool/Aurvion/llama.cpp/build/tools/ui/ui-src/node_modules/@ampproject/remapping/package.json
-
curl -L -o package.json https://huggingface.co/OmnipotentFool/Aurvion/resolve/main/llama.cpp/build/tools/ui/ui-src/node_modules/%40ampproject/remapping/package.json
2.23 kB
| { | |
| "name": "@ampproject/remapping", | |
| "version": "2.3.0", | |
| "description": "Remap sequential sourcemaps through transformations to point at the original source code", | |
| "keywords": [ | |
| "source", | |
| "map", | |
| "remap" | |
| ], | |
| "main": "dist/remapping.umd.js", | |
| "module": "dist/remapping.mjs", | |
| "types": "dist/types/remapping.d.ts", | |
| "exports": { | |
| ".": [ | |
| { | |
| "types": "./dist/types/remapping.d.ts", | |
| "browser": "./dist/remapping.umd.js", | |
| "require": "./dist/remapping.umd.js", | |
| "import": "./dist/remapping.mjs" | |
| }, | |
| "./dist/remapping.umd.js" | |
| ], | |
| "./package.json": "./package.json" | |
| }, | |
| "files": [ | |
| "dist" | |
| ], | |
| "author": "Justin Ridgewell <jridgewell@google.com>", | |
| "repository": { | |
| "type": "git", | |
| "url": "git+https://github.com/ampproject/remapping.git" | |
| }, | |
| "license": "Apache-2.0", | |
| "engines": { | |
| "node": ">=6.0.0" | |
| }, | |
| "scripts": { | |
| "build": "run-s -n build:*", | |
| "build:rollup": "rollup -c rollup.config.js", | |
| "build:ts": "tsc --project tsconfig.build.json", | |
| "lint": "run-s -n lint:*", | |
| "lint:prettier": "npm run test:lint:prettier -- --write", | |
| "lint:ts": "npm run test:lint:ts -- --fix", | |
| "prebuild": "rm -rf dist", | |
| "prepublishOnly": "npm run preversion", | |
| "preversion": "run-s test build", | |
| "test": "run-s -n test:lint test:only", | |
| "test:debug": "node --inspect-brk node_modules/.bin/jest --runInBand", | |
| "test:lint": "run-s -n test:lint:*", | |
| "test:lint:prettier": "prettier --check '{src,test}/**/*.ts'", | |
| "test:lint:ts": "eslint '{src,test}/**/*.ts'", | |
| "test:only": "jest --coverage", | |
| "test:watch": "jest --coverage --watch" | |
| }, | |
| "devDependencies": { | |
| "@rollup/plugin-typescript": "8.3.2", | |
| "@types/jest": "27.4.1", | |
| "@typescript-eslint/eslint-plugin": "5.20.0", | |
| "@typescript-eslint/parser": "5.20.0", | |
| "eslint": "8.14.0", | |
| "eslint-config-prettier": "8.5.0", | |
| "jest": "27.5.1", | |
| "jest-config": "27.5.1", | |
| "npm-run-all": "4.1.5", | |
| "prettier": "2.6.2", | |
| "rollup": "2.70.2", | |
| "ts-jest": "27.1.4", | |
| "tslib": "2.4.0", | |
| "typescript": "4.6.3" | |
| }, | |
| "dependencies": { | |
| "@jridgewell/gen-mapping": "^0.3.5", | |
| "@jridgewell/trace-mapping": "^0.3.24" | |
| } | |
| } | |