Safetensors
GGUF
Turkish
llama
Llama-3
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
Instructions to use tda45/TdAI with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use tda45/TdAI with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="tda45/TdAI", filename="llama.cpp/models/ggml-vocab-aquila.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use tda45/TdAI with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf tda45/TdAI # Run inference directly in the terminal: llama cli -hf tda45/TdAI
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf tda45/TdAI # Run inference directly in the terminal: llama cli -hf tda45/TdAI
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf tda45/TdAI # Run inference directly in the terminal: ./llama-cli -hf tda45/TdAI
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf tda45/TdAI # Run inference directly in the terminal: ./build/bin/llama-cli -hf tda45/TdAI
Use Docker
docker model run hf.co/tda45/TdAI
- LM Studio
- Jan
- Ollama
How to use tda45/TdAI with Ollama:
ollama run hf.co/tda45/TdAI
- Unsloth Studio
How to use tda45/TdAI with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for tda45/TdAI to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for tda45/TdAI to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for tda45/TdAI to start chatting
- Atomic Chat new
- Docker Model Runner
How to use tda45/TdAI with Docker Model Runner:
docker model run hf.co/tda45/TdAI
- Lemonade
How to use tda45/TdAI with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull tda45/TdAI
Run and chat with the model
lemonade run user.TdAI-{{QUANT_TAG}}List all available models
lemonade list
| { | |
| "name": "llama-ui", | |
| "private": true, | |
| "version": "1.0.0", | |
| "type": "module", | |
| "scripts": { | |
| "build": "npm run build-pwa-assets && vite build", | |
| "build-pwa-assets": "npx @vite-pwa/assets-generator --root . --config pwa-assets.config.ts && npx @vite-pwa/assets-generator --root . --config pwa-assets-dark.config.ts && node scripts/make-icons-circular.js", | |
| "dev": "bash scripts/dev.sh", | |
| "preview": "vite preview", | |
| "prepare": "svelte-kit sync || echo ''", | |
| "check": "svelte-kit sync && svelte-check --tsconfig ./tsconfig.json", | |
| "check:watch": "svelte-kit sync && svelte-check --tsconfig ./tsconfig.json --watch", | |
| "reset": "rm -rf .svelte-kit node_modules", | |
| "format": "prettier --write .", | |
| "lint": "prettier --check . && eslint .", | |
| "test": "npm run test:ui -- --run && npm run test:client -- --run && npm run test:unit -- --run && npm run test:e2e", | |
| "test:e2e": "playwright test", | |
| "test:e2e:pwa": "playwright test tests/e2e/pwa.e2e.ts", | |
| "test:client": "vitest --project=client", | |
| "test:unit": "vitest --project=unit", | |
| "test:unit:pwa": "vitest --project=unit --run tests/unit/pwa.spec.ts", | |
| "test:pwa": "npm run test:unit:pwa && npm run test:e2e:pwa", | |
| "test:ui": "vitest --project=ui", | |
| "storybook": "storybook dev -p 6006", | |
| "build-storybook": "storybook build", | |
| "cleanup": "rm -rf .svelte-kit build node_modules test-results dist dev-dist debug-storybook.log static/pwa-*.png static/maskable-icon-*.png static/apple-touch-icon-*.png static/apple-splash-*.png static/favicon*.ico" | |
| }, | |
| "devDependencies": { | |
| "@chromatic-com/storybook": "5.0.0", | |
| "@eslint/compat": "1.4.1", | |
| "@eslint/js": "9.39.2", | |
| "@internationalized/date": "3.10.1", | |
| "@lucide/svelte": "0.515.0", | |
| "@modelcontextprotocol/sdk": "1.26.0", | |
| "@playwright/test": "1.56.1", | |
| "@storybook/addon-a11y": "10.2.4", | |
| "@storybook/addon-docs": "10.2.4", | |
| "@storybook/addon-svelte-csf": "5.0.10", | |
| "@storybook/addon-vitest": "10.2.4", | |
| "@storybook/sveltekit": "10.2.4", | |
| "@sveltejs/adapter-static": "3.0.10", | |
| "@sveltejs/kit": "2.60.1", | |
| "@sveltejs/vite-plugin-svelte": "6.2.1", | |
| "@tailwindcss/forms": "0.5.10", | |
| "@tailwindcss/typography": "0.5.16", | |
| "@tailwindcss/vite": "4.1.11", | |
| "@types/node": "24.13.0", | |
| "@vite-pwa/assets-generator": "1.0.2", | |
| "@vite-pwa/sveltekit": "1.1.0", | |
| "@vitest/browser": "4.1.8", | |
| "@vitest/browser-playwright": "4.1.8", | |
| "@vitest/coverage-v8": "4.1.8", | |
| "bits-ui": "2.18.1", | |
| "clsx": "2.1.1", | |
| "dexie": "4.4.3", | |
| "dompurify": "3.4.11", | |
| "eslint": "9.39.4", | |
| "eslint-config-prettier": "10.1.8", | |
| "eslint-plugin-storybook": "10.4.2", | |
| "eslint-plugin-svelte": "3.19.0", | |
| "fflate": "0.8.3", | |
| "globals": "16.5.0", | |
| "highlight.js": "11.11.1", | |
| "http-server": "14.1.1", | |
| "mdast": "3.0.0", | |
| "mdsvex": "0.12.7", | |
| "mermaid": "11.15.0", | |
| "mode-watcher": "1.1.0", | |
| "pdfjs-dist": "5.4.54", | |
| "playwright": "1.56.1", | |
| "prettier": "3.8.3", | |
| "prettier-plugin-svelte": "4.1.0", | |
| "prettier-plugin-tailwindcss": "0.8.0", | |
| "rehype-highlight": "7.0.2", | |
| "rehype-katex": "7.0.1", | |
| "rehype-stringify": "10.0.1", | |
| "remark": "15.0.1", | |
| "remark-breaks": "4.0.0", | |
| "remark-gfm": "4.0.1", | |
| "remark-html": "16.0.1", | |
| "remark-math": "6.0.0", | |
| "remark-rehype": "11.1.2", | |
| "sass": "1.100.0", | |
| "storybook": "10.4.2", | |
| "svelte": "5.56.1", | |
| "svelte-check": "4.6.0", | |
| "svelte-sonner": "1.1.1", | |
| "tailwind-merge": "3.6.0", | |
| "tailwind-variants": "3.2.2", | |
| "tailwindcss": "4.3.0", | |
| "tw-animate-css": "1.4.0", | |
| "typescript": "5.9.3", | |
| "typescript-eslint": "8.60.1", | |
| "unified": "11.0.5", | |
| "unist-util-visit": "5.1.0", | |
| "uuid": "13.0.2", | |
| "vite": "7.3.5", | |
| "vite-plugin-devtools-json": "0.2.1", | |
| "vitest": "4.1.8", | |
| "vitest-browser-svelte": "2.1.1", | |
| "workbox-window": "7.4.1" | |
| }, | |
| "overrides": { | |
| "cookie": "1.1.1" | |
| } | |
| } | |