Text Generation
PEFT
Safetensors
English
falcon
search-queries
instruct-fine-tuned
search-queries-parser
zero-shot
llm
custom_code
Instructions to use EmbeddingStudio/query-parser-falcon-7b-instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use EmbeddingStudio/query-parser-falcon-7b-instruct with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("tiiuae/falcon-7b-instruct") model = PeftModel.from_pretrained(base_model, "EmbeddingStudio/query-parser-falcon-7b-instruct") - Notebooks
- Google Colab
- Kaggle
Commit ·
d609877
1
Parent(s): 3b8ef86
[add]: trying to add inference API
Browse files
README.md
CHANGED
|
@@ -11,6 +11,11 @@ tags:
|
|
| 11 |
- search-queries-parser
|
| 12 |
- zero-shot
|
| 13 |
- llm
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
---
|
| 15 |
|
| 16 |
# Model Card for the Query Parser LLM using Falcon-7B-Instruct
|
|
@@ -404,11 +409,6 @@ print(output)
|
|
| 404 |
#### Summary
|
| 405 |
|
| 406 |
|
| 407 |
-
|
| 408 |
-
## Model Examination [optional]
|
| 409 |
-
|
| 410 |
-
<!-- Relevant interpretability work for the model goes here -->
|
| 411 |
-
|
| 412 |
[More Information Needed]
|
| 413 |
|
| 414 |
## Environmental Impact
|
|
|
|
| 11 |
- search-queries-parser
|
| 12 |
- zero-shot
|
| 13 |
- llm
|
| 14 |
+
- falcon
|
| 15 |
+
inference:
|
| 16 |
+
parameters:
|
| 17 |
+
temperature: 0.05
|
| 18 |
+
do_sample: False
|
| 19 |
---
|
| 20 |
|
| 21 |
# Model Card for the Query Parser LLM using Falcon-7B-Instruct
|
|
|
|
| 409 |
#### Summary
|
| 410 |
|
| 411 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 412 |
[More Information Needed]
|
| 413 |
|
| 414 |
## Environmental Impact
|