Safetensors
GGUF
Turkish
llama
Llama-3
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
Instructions to use tda45/TdAI with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use tda45/TdAI with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="tda45/TdAI", filename="llama.cpp/models/ggml-vocab-aquila.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use tda45/TdAI with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf tda45/TdAI # Run inference directly in the terminal: llama cli -hf tda45/TdAI
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf tda45/TdAI # Run inference directly in the terminal: llama cli -hf tda45/TdAI
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf tda45/TdAI # Run inference directly in the terminal: ./llama-cli -hf tda45/TdAI
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf tda45/TdAI # Run inference directly in the terminal: ./build/bin/llama-cli -hf tda45/TdAI
Use Docker
docker model run hf.co/tda45/TdAI
- LM Studio
- Jan
- Ollama
How to use tda45/TdAI with Ollama:
ollama run hf.co/tda45/TdAI
- Unsloth Studio
How to use tda45/TdAI with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for tda45/TdAI to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for tda45/TdAI to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for tda45/TdAI to start chatting
- Atomic Chat new
- Docker Model Runner
How to use tda45/TdAI with Docker Model Runner:
docker model run hf.co/tda45/TdAI
- Lemonade
How to use tda45/TdAI with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull tda45/TdAI
Run and chat with the model
lemonade run user.TdAI-{{QUANT_TAG}}List all available models
lemonade list
| <script> | |
| let { class: className = '', style = '' } = $props(); | |
| </script> | |
| <svg | |
| class={className} | |
| {style} | |
| xmlns="http://www.w3.org/2000/svg" | |
| viewBox="0 0 174 174" | |
| xmlns:xlink="http://www.w3.org/1999/xlink" | |
| fill="none" | |
| version="1.1" | |
| ><g id="shape-320b5b95-d08d-8089-8007-585a8e498184" | |
| ><defs | |
| ><clipPath | |
| id="frame-clip-320b5b95-d08d-8089-8007-585a8e498184-render-1" | |
| class="frame-clip frame-clip-def" | |
| ><rect | |
| rx="0" | |
| ry="0" | |
| x="0" | |
| y="0" | |
| width="174.00000000000045" | |
| height="174" | |
| transform="matrix(1.000000, 0.000000, 0.000000, 1.000000, 0.000000, 0.000000)" | |
| /></clipPath | |
| ></defs | |
| ><g class="frame-container-wrapper" | |
| ><g class="frame-container-blur" | |
| ><g class="frame-container-shadows" | |
| ><g clip-path="url(#frame-clip-320b5b95-d08d-8089-8007-585a8e498184-render-1)" fill="none" | |
| ><g class="fills" id="fills-320b5b95-d08d-8089-8007-585a8e498184" | |
| ><rect | |
| rx="0" | |
| ry="0" | |
| x="0" | |
| y="0" | |
| width="174.00000000000045" | |
| height="174" | |
| transform="matrix(1.000000, 0.000000, 0.000000, 1.000000, 0.000000, 0.000000)" | |
| class="frame-background" | |
| /></g | |
| ><g class="frame-children" | |
| ><g id="shape-320b5b95-d08d-8089-8007-585a974337b1" | |
| ><g class="fills" id="fills-320b5b95-d08d-8089-8007-585a974337b1" | |
| ><path | |
| d="M15.5587158203125,81.5927734375L83.44091796875,13.7105712890625C92.813720703125,4.3380126953125,108.0096435546875,4.3380126953125,117.3817138671875,13.7105712890625L117.3817138671875,13.7105712890625C126.7547607421875,23.08306884765625,126.7547607421875,38.27911376953125,117.3817138671875,47.65167236328125L66.1168212890625,98.9169921875" | |
| fill="none" | |
| stroke-linecap="round" | |
| style="fill: none;" | |
| /></g | |
| ><g | |
| fill="none" | |
| stroke-linecap="round" | |
| id="strokes-b954dcef-3e3e-8015-8007-585acd4382b6-320b5b95-d08d-8089-8007-585a974337b1" | |
| class="strokes" | |
| ><g class="stroke-shape" | |
| ><path | |
| d="M15.5587158203125,81.5927734375L83.44091796875,13.7105712890625C92.813720703125,4.3380126953125,108.0096435546875,4.3380126953125,117.3817138671875,13.7105712890625L117.3817138671875,13.7105712890625C126.7547607421875,23.08306884765625,126.7547607421875,38.27911376953125,117.3817138671875,47.65167236328125L66.1168212890625,98.9169921875" | |
| style="fill: none; stroke-width: 12; stroke: currentColor; stroke-opacity: 1;" | |
| /></g | |
| ></g | |
| ></g | |
| ><g id="shape-320b5b95-d08d-8089-8007-585a974337b2" | |
| ><g class="fills" id="fills-320b5b95-d08d-8089-8007-585a974337b2" | |
| ><path | |
| d="M66.5587158203125,98.26885986328125L117.1165771484375,47.7105712890625C126.489501953125,38.3380126953125,141.6854248046875,38.3380126953125,151.0584716796875,47.7105712890625L151.4114990234375,48.0640869140625C160.7845458984375,57.43670654296875,160.7845458984375,72.6326904296875,151.4114990234375,82.00518798828125L90.018310546875,143.39886474609375C86.8941650390625,146.52288818359375,86.8941650390625,151.587890625,90.018310546875,154.71185302734375L102.62451171875,167.31890869140625" | |
| fill="none" | |
| stroke-linecap="round" | |
| style="fill: none;" | |
| /></g | |
| ><g | |
| fill="none" | |
| stroke-linecap="round" | |
| id="strokes-b954dcef-3e3e-8015-8007-585acd447743-320b5b95-d08d-8089-8007-585a974337b2" | |
| class="strokes" | |
| ><g class="stroke-shape" | |
| ><path | |
| d="M66.5587158203125,98.26885986328125L117.1165771484375,47.7105712890625C126.489501953125,38.3380126953125,141.6854248046875,38.3380126953125,151.0584716796875,47.7105712890625L151.4114990234375,48.0640869140625C160.7845458984375,57.43670654296875,160.7845458984375,72.6326904296875,151.4114990234375,82.00518798828125L90.018310546875,143.39886474609375C86.8941650390625,146.52288818359375,86.8941650390625,151.587890625,90.018310546875,154.71185302734375L102.62451171875,167.31890869140625" | |
| style="fill: none; stroke-width: 12; stroke: currentColor; stroke-opacity: 1;" | |
| /></g | |
| ></g | |
| ></g | |
| ><g id="shape-320b5b95-d08d-8089-8007-585a974337b3" | |
| ><g class="fills" id="fills-320b5b95-d08d-8089-8007-585a974337b3" | |
| ><path | |
| d="M99.79296875,30.68115234375L49.588134765625,80.8857421875C40.215576171875,90.258056640625,40.215576171875,105.45404052734375,49.588134765625,114.82708740234375L49.588134765625,114.82708740234375C58.9608154296875,124.19903564453125,74.1566162109375,124.19903564453125,83.529296875,114.82708740234375L133.7340087890625,64.62225341796875" | |
| fill="none" | |
| stroke-linecap="round" | |
| style="fill: none;" | |
| /></g | |
| ><g | |
| fill="none" | |
| stroke-linecap="round" | |
| id="strokes-b954dcef-3e3e-8015-8007-585acd44c5c9-320b5b95-d08d-8089-8007-585a974337b3" | |
| class="strokes" | |
| ><g class="stroke-shape" | |
| ><path | |
| d="M99.79296875,30.68115234375L49.588134765625,80.8857421875C40.215576171875,90.258056640625,40.215576171875,105.45404052734375,49.588134765625,114.82708740234375L49.588134765625,114.82708740234375C58.9608154296875,124.19903564453125,74.1566162109375,124.19903564453125,83.529296875,114.82708740234375L133.7340087890625,64.62225341796875" | |
| style="fill: none; stroke-width: 12; stroke: currentColor; stroke-opacity: 1;" | |
| /></g | |
| ></g | |
| ></g | |
| ></g | |
| ></g | |
| ></g | |
| ></g | |
| ></g | |
| ></g | |
| ></svg | |
| > | |