Safetensors
GGUF
Turkish
llama
Llama-3
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
Instructions to use tda45/TdAI with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use tda45/TdAI with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="tda45/TdAI", filename="llama.cpp/models/ggml-vocab-aquila.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use tda45/TdAI with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf tda45/TdAI # Run inference directly in the terminal: llama cli -hf tda45/TdAI
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf tda45/TdAI # Run inference directly in the terminal: llama cli -hf tda45/TdAI
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf tda45/TdAI # Run inference directly in the terminal: ./llama-cli -hf tda45/TdAI
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf tda45/TdAI # Run inference directly in the terminal: ./build/bin/llama-cli -hf tda45/TdAI
Use Docker
docker model run hf.co/tda45/TdAI
- LM Studio
- Jan
- Ollama
How to use tda45/TdAI with Ollama:
ollama run hf.co/tda45/TdAI
- Unsloth Studio
How to use tda45/TdAI with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for tda45/TdAI to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for tda45/TdAI to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for tda45/TdAI to start chatting
- Atomic Chat new
- Docker Model Runner
How to use tda45/TdAI with Docker Model Runner:
docker model run hf.co/tda45/TdAI
- Lemonade
How to use tda45/TdAI with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull tda45/TdAI
Run and chat with the model
lemonade run user.TdAI-{{QUANT_TAG}}List all available models
lemonade list
| # Requires Run as Administrator is NOT strictly necessary for User-scope env vars, | |
| # but recommended for creating directories in C:\ root if permissions are restricted. | |
| $ErrorActionPreference = "Stop" | |
| # --- Configuration --- | |
| $BaseDir = "C:\Qualcomm" | |
| # SDK 1: Hexagon | |
| $HexagonUrl = "https://github.com/snapdragon-toolchain/hexagon-sdk/releases/download/v6.6.0.0/hexagon-sdk-v6.6.0.0-arm64-wos.tar.xz" | |
| $HexagonParent = Join-Path $BaseDir "Hexagon_SDK" | |
| $HexagonSdkVersion = "6.6.0.0" | |
| $HexagonToolsVersion = "19.0.07" | |
| $HexagonSdkTarget = Join-Path $HexagonParent $HexagonSdkVersion | |
| $HexagonToolsTarget = Join-Path $HexagonSdkTarget "\tools\HEXAGON_Tools\$HexagonToolsVersion" | |
| # SDK 2: OpenCL | |
| $OpenCLUrl = "https://github.com/snapdragon-toolchain/opencl-sdk/releases/download/v2.3.2/adreno-opencl-sdk-v2.3.2-arm64-wos.tar.xz" | |
| $OpenCLParent = Join-Path $BaseDir "OpenCL_SDK" | |
| $OpenCLVersion = "2.3.2" | |
| $OpenCLTarget = Join-Path $OpenCLParent $OpenCLVersion | |
| # --- Helper Function --- | |
| function Install-QualcommSDK { | |
| param ( | |
| [string]$Url, | |
| [string]$ParentDir, | |
| [string]$TargetDir, | |
| [string]$Name | |
| ) | |
| # 1. Create Parent Directory | |
| if (-not (Test-Path -Path $ParentDir)) { | |
| Write-Host "Creating directory: $ParentDir" -ForegroundColor Cyan | |
| New-Item -Path $ParentDir -ItemType Directory -Force | Out-Null | |
| } | |
| # 2. Check for Specific Version Directory | |
| if (Test-Path -Path $TargetDir) { | |
| Write-Host "$Name ($TargetDir) already exists. Skipping download." -ForegroundColor Green | |
| } | |
| else { | |
| Write-Host "$Name not found. preparing to download..." -ForegroundColor Yellow | |
| # Create the target directory to extract into | |
| New-Item -Path $TargetDir -ItemType Directory -Force | Out-Null | |
| # Define temporary archive path | |
| $TempFile = Join-Path $ParentDir "temp_sdk.tar.xz" | |
| try { | |
| # Download | |
| Write-Host "Downloading from: $Url" | |
| Invoke-WebRequest -Uri $Url -OutFile $TempFile | |
| # Untar | |
| # Note: We assume Windows includes tar.exe (Win 10 build 17063+) | |
| Write-Host "Extracting archive to $TargetDir..." | |
| # We use -C to extract contents INTO the target directory created above | |
| tar -xJvf $TempFile -C $TargetDir\.. | |
| Write-Host "Extraction complete." -ForegroundColor Green | |
| } | |
| catch { | |
| Write-Error "Failed to download or extract $Name. Error: $_" | |
| # Cleanup target dir if failed so script tries again next time | |
| Remove-Item -Path $TargetDir -Recurse -Force -ErrorAction SilentlyContinue | |
| } | |
| finally { | |
| # Cleanup Archive | |
| if (Test-Path $TempFile) { Remove-Item $TempFile -Force } | |
| } | |
| } | |
| } | |
| # --- Execution --- | |
| # 1. Ensure Base C:\Qualcomm exists | |
| if (-not (Test-Path $BaseDir)) { | |
| New-Item -Path $BaseDir -ItemType Directory -Force | Out-Null | |
| } | |
| # 2. Run Install Logic | |
| Install-QualcommSDK -Url $HexagonUrl -ParentDir $HexagonParent -TargetDir $HexagonSdkTarget -Name "Hexagon SDK" | |
| Install-QualcommSDK -Url $OpenCLUrl -ParentDir $OpenCLParent -TargetDir $OpenCLTarget -Name "OpenCL SDK" | |
| # --- Environment Variables --- | |
| Write-Host "`nSetting Environment Variables..." -ForegroundColor Cyan | |
| # Set OPENCL_SDK_ROOT | |
| [System.Environment]::SetEnvironmentVariable('OPENCL_SDK_ROOT', $OpenCLTarget, [System.EnvironmentVariableTarget]::User) | |
| $env:OPENCL_SDK_ROOT = $OpenCLTarget # Set for current session as well | |
| Write-Host "OPENCL_SDK_ROOT set to: $OpenCLTarget" | |
| # Set HEXAGON_SDK_ROOT | |
| [System.Environment]::SetEnvironmentVariable('HEXAGON_SDK_ROOT', $HexagonSdkTarget, [System.EnvironmentVariableTarget]::User) | |
| $env:HEXAGON_SDK_ROOT = $HexagonSdkTarget # Set for current session as well | |
| Write-Host "HEXAGON_SDK_ROOT set to: $HexagonSdkTarget" | |
| # Set HEXAGON_SDK_ROOT | |
| [System.Environment]::SetEnvironmentVariable('HEXAGON_TOOLS_ROOT', $HexagonToolsTarget, [System.EnvironmentVariableTarget]::User) | |
| $env:HEXAGON_TOOLS_ROOT = $HexagonToolsTarget # Set for current session as well | |
| Write-Host "HEXAGON_TOOLS_ROOT set to: $HexagonToolsTarget" | |