Instructions to use avinashm/text2cypher with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use avinashm/text2cypher with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf avinashm/text2cypher # Run inference directly in the terminal: llama cli -hf avinashm/text2cypher
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf avinashm/text2cypher # Run inference directly in the terminal: llama cli -hf avinashm/text2cypher
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf avinashm/text2cypher # Run inference directly in the terminal: ./llama-cli -hf avinashm/text2cypher
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf avinashm/text2cypher # Run inference directly in the terminal: ./build/bin/llama-cli -hf avinashm/text2cypher
Use Docker
docker model run hf.co/avinashm/text2cypher
- LM Studio
- Jan
- Ollama
How to use avinashm/text2cypher with Ollama:
ollama run hf.co/avinashm/text2cypher
- Unsloth Studio
How to use avinashm/text2cypher with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for avinashm/text2cypher to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for avinashm/text2cypher to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for avinashm/text2cypher to start chatting
- Docker Model Runner
How to use avinashm/text2cypher with Docker Model Runner:
docker model run hf.co/avinashm/text2cypher
- Lemonade
How to use avinashm/text2cypher with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull avinashm/text2cypher
Run and chat with the model
lemonade run user.text2cypher-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
Update README.md
Browse files
README.md
CHANGED
|
@@ -81,6 +81,11 @@ output = _postprocess_output_cypher(raw_output)
|
|
| 81 |
print(output)
|
| 82 |
```
|
| 83 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 84 |
|
| 85 |
|
| 86 |
## Bias, Risks, and Limitations
|
|
@@ -105,8 +110,3 @@ lora_config = LoraConfig( r=64, lora_alpha=64, target_modules=target_modules, lo
|
|
| 105 |
sft_config = SFTConfig( dataset_text_field=dataset_text_field, per_device_train_batch_size=4, gradient_accumulation_steps=8, dataset_num_proc=16, max_seq_length=1600, logging_dir="./logs", num_train_epochs=1, learning_rate=2e-5, save_steps=5, save_total_limit=1, logging_steps=5, output_dir="outputs", optim="paged_adamw_8bit", save_strategy="steps", )
|
| 106 |
bnb_config = BitsAndBytesConfig( load_in_4bit=True, bnb_4bit_use_double_quant=True, bnb_4bit_quant_type="nf4", bnb_4bit_compute_dtype=torch.bfloat16, )
|
| 107 |
|
| 108 |
-
### NOTE on creating your own schemas:
|
| 109 |
-
In the dataset we used, the schemas are already provided. They are created either by
|
| 110 |
-
Directly using the schema the input data source provided OR
|
| 111 |
-
Creating schema using neo4j-graphrag package (Check: SchemaReader.get_schema(...) function)
|
| 112 |
-
In your own Neo4j database, you can utilize neo4j-graphrag package::SchemaReader functions
|
|
|
|
| 81 |
print(output)
|
| 82 |
```
|
| 83 |
|
| 84 |
+
### NOTE on creating your own schemas:
|
| 85 |
+
# In the dataset we used, the schemas are already provided.
|
| 86 |
+
# They are created either by Directly using the schema the input data source provided OR
|
| 87 |
+
# Creating schema using neo4j-graphrag package (Check: SchemaReader.get_schema(...) function)
|
| 88 |
+
# In your own Neo4j database, you can utilize neo4j-graphrag package::SchemaReader functions
|
| 89 |
|
| 90 |
|
| 91 |
## Bias, Risks, and Limitations
|
|
|
|
| 110 |
sft_config = SFTConfig( dataset_text_field=dataset_text_field, per_device_train_batch_size=4, gradient_accumulation_steps=8, dataset_num_proc=16, max_seq_length=1600, logging_dir="./logs", num_train_epochs=1, learning_rate=2e-5, save_steps=5, save_total_limit=1, logging_steps=5, output_dir="outputs", optim="paged_adamw_8bit", save_strategy="steps", )
|
| 111 |
bnb_config = BitsAndBytesConfig( load_in_4bit=True, bnb_4bit_use_double_quant=True, bnb_4bit_quant_type="nf4", bnb_4bit_compute_dtype=torch.bfloat16, )
|
| 112 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|