Safetensors
GGUF
Turkish
llama
Llama-3
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
Instructions to use tda45/TdAI with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use tda45/TdAI with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="tda45/TdAI", filename="llama.cpp/models/ggml-vocab-aquila.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use tda45/TdAI with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf tda45/TdAI # Run inference directly in the terminal: llama cli -hf tda45/TdAI
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf tda45/TdAI # Run inference directly in the terminal: llama cli -hf tda45/TdAI
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf tda45/TdAI # Run inference directly in the terminal: ./llama-cli -hf tda45/TdAI
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf tda45/TdAI # Run inference directly in the terminal: ./build/bin/llama-cli -hf tda45/TdAI
Use Docker
docker model run hf.co/tda45/TdAI
- LM Studio
- Jan
- Ollama
How to use tda45/TdAI with Ollama:
ollama run hf.co/tda45/TdAI
- Unsloth Studio
How to use tda45/TdAI with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for tda45/TdAI to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for tda45/TdAI to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for tda45/TdAI to start chatting
- Atomic Chat new
- Docker Model Runner
How to use tda45/TdAI with Docker Model Runner:
docker model run hf.co/tda45/TdAI
- Lemonade
How to use tda45/TdAI with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull tda45/TdAI
Run and chat with the model
lemonade run user.TdAI-{{QUANT_TAG}}List all available models
lemonade list
| <script lang="ts"> | |
| import { X, Plus } from '@lucide/svelte'; | |
| import { Button } from '$lib/components/ui/button'; | |
| import { mcpStore } from '$lib/stores/mcp.svelte'; | |
| import { conversationsStore } from '$lib/stores/conversations.svelte'; | |
| import { toolsStore } from '$lib/stores/tools.svelte'; | |
| import { ActionIcon, McpServerCard, McpServerCardSkeleton } from '$lib/components/app'; | |
| import { DialogMcpServerAddNew } from '$lib/components/app/dialogs'; | |
| import { HealthCheckStatus } from '$lib/enums'; | |
| import { ROUTES } from '$lib/constants'; | |
| import { fade } from 'svelte/transition'; | |
| import { onMount } from 'svelte'; | |
| import McpLogo from '../mcp/McpLogo.svelte'; | |
| import { browser } from '$app/environment'; | |
| import { page } from '$app/state'; | |
| import { goto, replaceState } from '$app/navigation'; | |
| interface Props { | |
| class?: string; | |
| } | |
| let { class: className }: Props = $props(); | |
| let servers = $derived(mcpStore.visibleMcpServers); | |
| let initialLoadComplete = $state(false); | |
| let isAddingServer = $state(false); | |
| let previousRouteId = $state<string | null>(null); | |
| $effect(() => { | |
| const currentId = page.route.id; | |
| return () => { | |
| previousRouteId = currentId; | |
| }; | |
| }); | |
| function handleClose() { | |
| const prevIsMcpServers = previousRouteId === '/mcp-servers'; | |
| if (browser && window.history.length > 1 && !prevIsMcpServers) { | |
| history.back(); | |
| } else { | |
| goto(ROUTES.START); | |
| } | |
| } | |
| onMount(() => { | |
| if (page.url.searchParams.has('add')) { | |
| isAddingServer = true; | |
| const newUrl = new URL(page.url); | |
| newUrl.searchParams.delete('add'); | |
| replaceState(newUrl, {}); | |
| } | |
| }); | |
| $effect(() => { | |
| if (initialLoadComplete) return; | |
| const allChecked = | |
| servers.length > 0 && | |
| servers.every((server) => { | |
| const state = mcpStore.getHealthCheckState(server.id); | |
| return ( | |
| state.status === HealthCheckStatus.SUCCESS || state.status === HealthCheckStatus.ERROR | |
| ); | |
| }); | |
| if (allChecked) { | |
| initialLoadComplete = true; | |
| } | |
| }); | |
| </script> | |
| <div in:fade={{ duration: 150 }}> | |
| <div class="fixed top-4.5 right-4 z-50 md:hidden"> | |
| <ActionIcon icon={X} tooltip="Close" onclick={handleClose} /> | |
| </div> | |
| <div | |
| class="sticky top-0 z-10 mt-4 mb-2 flex items-start gap-4 md:p-4 p-0 px-4 md:justify-between md:px-8" | |
| > | |
| <div class="flex items-center gap-2"> | |
| <McpLogo class="h-5 w-5 md:h-6 md:w-6" /> | |
| <h1 class="text-lg font-semibold md:text-2xl">MCP Servers</h1> | |
| </div> | |
| <Button | |
| variant="outline" | |
| size="lg" | |
| class="shrink-0 fixed md:static bottom-6 right-6" | |
| onclick={() => (isAddingServer = true)} | |
| > | |
| <Plus class="h-4 w-4" /> | |
| Add New Server | |
| </Button> | |
| </div> | |
| <DialogMcpServerAddNew bind:open={isAddingServer} /> | |
| <div class="grid gap-5 md:space-y-4 {className}"> | |
| {#if servers.length === 0 && !isAddingServer} | |
| <div class="rounded-md border border-dashed p-4 text-sm text-muted-foreground"> | |
| No MCP Servers configured yet. Add one to enable agentic features. | |
| </div> | |
| {/if} | |
| {#if servers.length > 0} | |
| <div | |
| class="grid gap-3" | |
| style="grid-template-columns: repeat(auto-fill, minmax(min(32rem, calc(100dvw - 2rem)), 1fr));" | |
| > | |
| {#each servers as server (server.id)} | |
| {#if !initialLoadComplete} | |
| <McpServerCardSkeleton /> | |
| {:else} | |
| <McpServerCard | |
| {server} | |
| enabled={conversationsStore.isMcpServerEnabledForChat(server.id)} | |
| onToggle={async () => { | |
| const wasEnabled = conversationsStore.isMcpServerEnabledForChat(server.id); | |
| await conversationsStore.toggleMcpServerForChat(server.id); | |
| if (!wasEnabled) { | |
| toolsStore.enableAllToolsForServer(server.id); | |
| } | |
| }} | |
| onUpdate={(updates) => mcpStore.updateServer(server.id, updates)} | |
| onDelete={() => mcpStore.removeServer(server.id)} | |
| /> | |
| {/if} | |
| {/each} | |
| </div> | |
| {/if} | |
| </div> | |
| </div> | |