Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf mgonzs13/TextBase-7B-v0.1-GGUF:# Run inference directly in the terminal:
llama cli -hf mgonzs13/TextBase-7B-v0.1-GGUF:Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf mgonzs13/TextBase-7B-v0.1-GGUF:# Run inference directly in the terminal:
./llama-cli -hf mgonzs13/TextBase-7B-v0.1-GGUF:Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf mgonzs13/TextBase-7B-v0.1-GGUF:# Run inference directly in the terminal:
./build/bin/llama-cli -hf mgonzs13/TextBase-7B-v0.1-GGUF:Use Docker
docker model run hf.co/mgonzs13/TextBase-7B-v0.1-GGUF:TextBase-7B-v0.1
Model creator: SF-Foundation
Original model: TextBase-7B-v0.1
GGUF quantization: llama.cpp commit 4bfe50f741479c1df1c377260c3ff5702586719e
Description
Finetuned version of Mistral-7B-Instruct. Details on development to be published soon.
TextBase-7B was fine-tuned from the open source Mistral-7B model using a novel and patent-pending learning technique. Our learning framework relies on efficiently combining supervised and Reinforcement learning methods leveraging human and AI labels over a combination of public and CRM task-specific datasets. Supervised finetuning allows the model to learn task-specific skills while RLHF imparts human judgement making the model able to generalize, reason and follow instructions efficiently.
Checkout more models developed by Salesforce under https://huggingface.co/Salesforce
- Downloads last month
- 33
2-bit
3-bit
4-bit
5-bit
6-bit
16-bit
Model tree for mgonzs13/TextBase-7B-v0.1-GGUF
Base model
SF-Foundation/TextBase-7B-v0.1
Install (macOS, Linux)
# Start a local OpenAI-compatible server with a web UI: llama serve -hf mgonzs13/TextBase-7B-v0.1-GGUF:# Run inference directly in the terminal: llama cli -hf mgonzs13/TextBase-7B-v0.1-GGUF: