Safetensors
GGUF
Turkish
llama
Llama-3
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
Instructions to use tda45/TdAI with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use tda45/TdAI with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="tda45/TdAI", filename="llama.cpp/models/ggml-vocab-aquila.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use tda45/TdAI with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf tda45/TdAI # Run inference directly in the terminal: llama cli -hf tda45/TdAI
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf tda45/TdAI # Run inference directly in the terminal: llama cli -hf tda45/TdAI
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf tda45/TdAI # Run inference directly in the terminal: ./llama-cli -hf tda45/TdAI
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf tda45/TdAI # Run inference directly in the terminal: ./build/bin/llama-cli -hf tda45/TdAI
Use Docker
docker model run hf.co/tda45/TdAI
- LM Studio
- Jan
- Ollama
How to use tda45/TdAI with Ollama:
ollama run hf.co/tda45/TdAI
- Unsloth Studio
How to use tda45/TdAI with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for tda45/TdAI to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for tda45/TdAI to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for tda45/TdAI to start chatting
- Atomic Chat new
- Docker Model Runner
How to use tda45/TdAI with Docker Model Runner:
docker model run hf.co/tda45/TdAI
- Lemonade
How to use tda45/TdAI with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull tda45/TdAI
Run and chat with the model
lemonade run user.TdAI-{{QUANT_TAG}}List all available models
lemonade list
| Language: Cpp | |
| AlignAfterOpenBracket: Align | |
| AlignArrayOfStructures: Left | |
| AlignConsecutiveAssignments: AcrossComments | |
| AlignConsecutiveBitFields: AcrossComments | |
| AlignConsecutiveDeclarations: AcrossComments | |
| AlignConsecutiveMacros: AcrossComments | |
| # AlignConsecutiveShortCaseStatements: AcrossComments | |
| AlignEscapedNewlines: Left # LeftWithLastLine | |
| AlignOperands: Align | |
| AlignTrailingComments: | |
| Kind: Always | |
| OverEmptyLines: 1 | |
| AllowAllArgumentsOnNextLine: true | |
| AllowAllParametersOfDeclarationOnNextLine: false | |
| # AllowBreakBeforeNoexceptSpecifier: OnlyWithParen | |
| AllowShortBlocksOnASingleLine: Never | |
| AllowShortCaseLabelsOnASingleLine: false | |
| AllowShortFunctionsOnASingleLine: Inline | |
| AllowShortIfStatementsOnASingleLine: Never | |
| AllowShortLambdasOnASingleLine: Inline | |
| AllowShortLoopsOnASingleLine: false | |
| AlwaysBreakBeforeMultilineStrings: true | |
| # Treat CUDA keywords/attributes as "attribute macros" and avoid breaking lines inside them | |
| AttributeMacros: | |
| - __host__ | |
| - __device__ | |
| - __global__ | |
| - __forceinline__ | |
| - __launch_bounds__ | |
| BinPackArguments: true | |
| BinPackParameters: false # OnePerLine | |
| BitFieldColonSpacing: Both | |
| BreakBeforeBraces: Custom # Attach | |
| BraceWrapping: | |
| AfterCaseLabel: true | |
| AfterClass: false | |
| AfterControlStatement: false | |
| AfterEnum: false | |
| AfterFunction: false | |
| AfterNamespace: false | |
| AfterObjCDeclaration: false | |
| AfterStruct: false | |
| AfterUnion: false | |
| AfterExternBlock: false | |
| BeforeCatch: false | |
| BeforeElse: false | |
| BeforeLambdaBody: false | |
| BeforeWhile: false | |
| IndentBraces: false | |
| SplitEmptyFunction: false | |
| SplitEmptyRecord: false | |
| SplitEmptyNamespace: false | |
| # BreakAdjacentStringLiterals: true | |
| BreakAfterAttributes: Never | |
| BreakBeforeBinaryOperators: None | |
| BreakBeforeInlineASMColon: OnlyMultiline | |
| BreakBeforeTernaryOperators: false | |
| # BreakBinaryOperations: Never | |
| BreakConstructorInitializers: AfterColon | |
| # BreakFunctionDefinitionParameters: false | |
| BreakInheritanceList: AfterComma | |
| BreakStringLiterals: true | |
| # BreakTemplateDeclarations: Yes | |
| ColumnLimit: 120 | |
| CommentPragmas: '^ IWYU pragma:' | |
| CompactNamespaces: false | |
| ConstructorInitializerIndentWidth: 4 | |
| ContinuationIndentWidth: 4 | |
| Cpp11BracedListStyle: false | |
| DerivePointerAlignment: false | |
| DisableFormat: false | |
| EmptyLineBeforeAccessModifier: Leave | |
| EmptyLineAfterAccessModifier: Never | |
| ExperimentalAutoDetectBinPacking: false | |
| FixNamespaceComments: true | |
| IncludeBlocks: Regroup | |
| IncludeCategories: | |
| - Regex: '".*"' | |
| Priority: 1 | |
| SortPriority: 0 | |
| - Regex: '^<.*\.h>' | |
| Priority: 2 | |
| SortPriority: 0 | |
| - Regex: '^<.*' | |
| Priority: 3 | |
| SortPriority: 0 | |
| - Regex: '.*' | |
| Priority: 4 | |
| SortPriority: 0 | |
| IncludeIsMainRegex: '([-_](test|unittest))?$' | |
| IncludeIsMainSourceRegex: '' | |
| IndentAccessModifiers: false | |
| IndentCaseBlocks: true | |
| IndentCaseLabels: true | |
| IndentExternBlock: NoIndent | |
| IndentGotoLabels: false | |
| IndentPPDirectives: AfterHash | |
| IndentWidth: 4 | |
| IndentWrappedFunctionNames: false | |
| InsertBraces: true # NOTE: may lead to incorrect formatting | |
| InsertNewlineAtEOF: true | |
| JavaScriptQuotes: Leave | |
| JavaScriptWrapImports: true | |
| KeepEmptyLinesAtTheStartOfBlocks: false | |
| LambdaBodyIndentation: Signature | |
| LineEnding: LF | |
| MacroBlockBegin: '' | |
| MacroBlockEnd: '' | |
| MaxEmptyLinesToKeep: 1 | |
| NamespaceIndentation: None | |
| ObjCBinPackProtocolList: Auto | |
| ObjCBlockIndentWidth: 4 | |
| ObjCSpaceAfterProperty: true | |
| ObjCSpaceBeforeProtocolList: true | |
| PPIndentWidth: -1 | |
| PackConstructorInitializers: CurrentLine | |
| PenaltyBreakAssignment: 2 | |
| PenaltyBreakBeforeFirstCallParameter: 1 | |
| PenaltyBreakComment: 300 | |
| PenaltyBreakFirstLessLess: 120 | |
| PenaltyBreakString: 1000 | |
| PenaltyBreakTemplateDeclaration: 10 | |
| PenaltyExcessCharacter: 1000000 | |
| PenaltyReturnTypeOnItsOwnLine: 200 | |
| PointerAlignment: Middle | |
| QualifierAlignment: Left | |
| #QualifierOrder: ['static', 'inline', 'friend', 'constexpr', 'const', 'volatile', 'type', 'restrict'] | |
| RawStringFormats: | |
| - Language: Cpp | |
| Delimiters: | |
| - cc | |
| - CC | |
| - cpp | |
| - Cpp | |
| - CPP | |
| - 'c++' | |
| - 'C++' | |
| CanonicalDelimiter: '' | |
| ReferenceAlignment: Middle | |
| ReflowComments: false # IndentOnly | |
| SeparateDefinitionBlocks: Always | |
| SortIncludes: CaseInsensitive | |
| SortUsingDeclarations: LexicographicNumeric | |
| SpaceAfterCStyleCast: true | |
| SpaceAfterLogicalNot: false | |
| SpaceAfterTemplateKeyword: true | |
| SpaceBeforeAssignmentOperators: true | |
| SpaceBeforeCpp11BracedList: false | |
| SpaceBeforeCtorInitializerColon: true | |
| SpaceBeforeInheritanceColon: true | |
| SpaceBeforeParens: ControlStatements | |
| SpaceBeforeRangeBasedForLoopColon: true | |
| SpaceInEmptyBlock: false | |
| SpaceInEmptyParentheses: false | |
| SpacesBeforeTrailingComments: 2 | |
| SpacesInAngles: Never | |
| SpacesInContainerLiterals: true | |
| SpacesInLineCommentPrefix: | |
| Minimum: 1 | |
| Maximum: -1 | |
| SpacesInParentheses: false | |
| SpacesInSquareBrackets: false | |
| SpaceBeforeSquareBrackets: false | |
| Standard: c++17 | |
| TabWidth: 4 | |
| UseTab: Never | |
| WhitespaceSensitiveMacros: ['STRINGIZE'] | |
| ... | |