Instructions to use Sleem247/LexEmbed-Contracts-Q8_0-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Sleem247/LexEmbed-Contracts-Q8_0-GGUF with sentence-transformers:

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("Sleem247/LexEmbed-Contracts-Q8_0-GGUF")

sentences = [
    "Rofr/Rofo/Rofn",
    "between the parties is not executed within thirty (30) days following delivery, of such notice to Snap, Snap shall be free thereafter to enter into an such an agreement with any third party.",
    "This Agreement contains the entire agreement of the parties and SYNTEL shall not be bound by any other different, additional, or further agreements or understandings except as consented to in writing by the Chief Administrative Officer or Director, Human Resources of SYNTEL. This Agreement shall be binding upon and inure to the benefit of the parties hereto and their respective successors and assigns. No amendment hereof shall be effective unless contained in a written instrument signed by the parties hereto. No delay or omission by either party to exercise any right or power under this Agreement shall impair such right or power or be construed to be a waiver thereof. A waiver by either party of any of the covenants to be performed by the other party or of any breach shall not be construed to be a waiver of any succeeding breach or of any other covenant. If any portion of any provision of the Agreement is declared invalid, the offending portion of such provision shall be deemed severable from such provision and the remaining provisions of the Agreement, which shall remain in full force and effect. EMPLOYEE shall not assign or transfer this Agreement without the prior written consent of SYNTEL. EMPLOYEE’s employment with SYNTEL is at will and may be terminated by SYNTEL at any time with or without cause, and with or without notice. All rights and remedies provided for in this Agreement shall be cumulative and in addition to and not in lieu of any other rights or remedies available to either party at law, in equity, or otherwise. Paragraphs 2, 3, 6, 7, 8, 9, 10, 11, 12, and 13 of this Agreement shall survive termination of this Agreement and EMPLOYEE’s employment with SYNTEL. The parties submit to the jurisdiction and venue of the circuit court for the County of Oakland, State of Michigan or, if original jurisdiction can be established, the United States District Court for the Eastern District of Michigan with respect to: a) disputes, controversies, or claims arising out of EMPLOYEE’S failure to abide by Paragraphs 6, 7, and/or Exhibit A – “Confidential Information” of this Agreement, b) claims initiated by SYNTEL pursuant to Paragraph 10 of this Agreement, and c) the enforcement of any awards or relief granted pursuant to the dispute resolution procedures set forth in Paragraph 11 of this Agreement. The parties stipulate that the venues referenced in this Agreement are convenient. This Agreement shall be construed under and in accordance with the laws of the State of Michigan.",
    "The existence and terms of this Term Sheet are “Confidential Information” under and subject to the terms of the Confidentiality Agreement, dated February 23, 2016 (as amended on August 16, 2016, the “ Confidentiality Agreement ”), between CHC Leasing (Ireland) Limited and The Milestone Aviation Group Limited. The parties confirm that the Confidentiality Agreement remains in full force and effect; provided , however, the parties (i) agree that each party may disclose Confidential Information to the professional advisers retained by the Committee and (ii) agree to work in good faith to amend the Confidentiality Agreement to permit certain participants in the Chapter 11 Case (as agreed to by the parties) to view a partially redacted version of this Term Sheet. In addition, as each of the parties hereto acknowledges that this Term Sheet is itself, and this Term Sheet contains, commercially sensitive and proprietary information, with respect to the Chapter 11 Case, each of the parties agrees to maintain this Term Sheet and this information strictly confidential, and agrees to disclose it to no person other than: (i) the parties to the Plan Support Agreement (ii) any person that has executed an accession and joinder to the Confidentiality Agreement in the form appended thereto, (iii) the Bankruptcy Court during the course of the Chapter 11 Case, provided , however, that no document relating to the proposed transactions (including this Term Sheet) shall be filed with the Bankruptcy Court (other than a motion, in form and substance acceptable to the CHC Parties and the Milestone Parties, seeking protective order authority to file this Term Sheet under seal, which motion shall not describe the specific economic elements of the transaction) unless either (x) there has been obtained prior to the filing thereof an order of the Bankruptcy Court acceptable to the Milestone Parties enabling the CHC Parties to file such document under seal or (y) portions of such filed documents mutually agreed upon by the CHC Parties and the Milestone Parties are redacted, and (iv) the professional advisors of the Committee on a confidential basis pursuant to a letter agreement entered into with the Committee acceptable to the CHC Parties and Milestone setting forth a protocol for disclosure including the information that can be disclosed generally to the Committee and the information that is subject to limited disclosure to only certain professional advisors to the Committee."
]
embeddings = model.encode(sentences)

similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [4, 4]

llama-cpp-python

How to use Sleem247/LexEmbed-Contracts-Q8_0-GGUF with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="Sleem247/LexEmbed-Contracts-Q8_0-GGUF",
	filename="lexembed-contracts-q8_0.gguf",
)

output = llm(
	"Once upon a time,",
	max_tokens=512,
	echo=True
)
print(output)

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use Sleem247/LexEmbed-Contracts-Q8_0-GGUF with llama.cpp:

Install from brew

brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf Sleem247/LexEmbed-Contracts-Q8_0-GGUF:Q8_0
# Run inference directly in the terminal:
llama-cli -hf Sleem247/LexEmbed-Contracts-Q8_0-GGUF:Q8_0

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf Sleem247/LexEmbed-Contracts-Q8_0-GGUF:Q8_0
# Run inference directly in the terminal:
llama-cli -hf Sleem247/LexEmbed-Contracts-Q8_0-GGUF:Q8_0

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf Sleem247/LexEmbed-Contracts-Q8_0-GGUF:Q8_0
# Run inference directly in the terminal:
./llama-cli -hf Sleem247/LexEmbed-Contracts-Q8_0-GGUF:Q8_0

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf Sleem247/LexEmbed-Contracts-Q8_0-GGUF:Q8_0
# Run inference directly in the terminal:
./build/bin/llama-cli -hf Sleem247/LexEmbed-Contracts-Q8_0-GGUF:Q8_0

Use Docker

docker model run hf.co/Sleem247/LexEmbed-Contracts-Q8_0-GGUF:Q8_0

LM Studio
Jan
Ollama
How to use Sleem247/LexEmbed-Contracts-Q8_0-GGUF with Ollama:
```
ollama run hf.co/Sleem247/LexEmbed-Contracts-Q8_0-GGUF:Q8_0
```

Unsloth Studio

How to use Sleem247/LexEmbed-Contracts-Q8_0-GGUF with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for Sleem247/LexEmbed-Contracts-Q8_0-GGUF to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for Sleem247/LexEmbed-Contracts-Q8_0-GGUF to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for Sleem247/LexEmbed-Contracts-Q8_0-GGUF to start chatting

Docker Model Runner
How to use Sleem247/LexEmbed-Contracts-Q8_0-GGUF with Docker Model Runner:
```
docker model run hf.co/Sleem247/LexEmbed-Contracts-Q8_0-GGUF:Q8_0
```

Lemonade

How to use Sleem247/LexEmbed-Contracts-Q8_0-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull Sleem247/LexEmbed-Contracts-Q8_0-GGUF:Q8_0

Run and chat with the model

lemonade run user.LexEmbed-Contracts-Q8_0-GGUF-Q8_0

List all available models

lemonade list

Sleem247/LexEmbed-Contracts-Q8_0-GGUF

This model was converted to GGUF format from yasserrmd/LexEmbed-Contracts using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

Use with llama.cpp

Install llama.cpp through brew (works on Mac and Linux)

brew install llama.cpp

Invoke the llama.cpp server or the CLI.

CLI:

llama-cli --hf-repo Sleem247/LexEmbed-Contracts-Q8_0-GGUF --hf-file lexembed-contracts-q8_0.gguf -p "The meaning to life and the universe is"

Server:

llama-server --hf-repo Sleem247/LexEmbed-Contracts-Q8_0-GGUF --hf-file lexembed-contracts-q8_0.gguf -c 2048

Note: You can also use this checkpoint directly through the usage steps listed in the Llama.cpp repo as well.

Step 1: Clone llama.cpp from GitHub.

git clone https://github.com/ggerganov/llama.cpp

Step 2: Move into the llama.cpp folder and build it with LLAMA_CURL=1 flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).

cd llama.cpp && LLAMA_CURL=1 make

Step 3: Run inference through the main binary.

./llama-cli --hf-repo Sleem247/LexEmbed-Contracts-Q8_0-GGUF --hf-file lexembed-contracts-q8_0.gguf -p "The meaning to life and the universe is"

./llama-server --hf-repo Sleem247/LexEmbed-Contracts-Q8_0-GGUF --hf-file lexembed-contracts-q8_0.gguf -c 2048

Downloads last month: 1

GGUF

Model size

0.6B params

Architecture

bert

Hardware compatibility

8-bit

Model tree for Sleem247/LexEmbed-Contracts-Q8_0-GGUF

Base model

yasserrmd/LexEmbed-Contracts

Quantized

(1)

this model