Spaces:

gathnex
/

LLM_deployment_zerocost_playground

Sleeping

gathnex commited on Dec 8, 2023

Commit

3e5975d

1 Parent(s): 5f2cb44

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -6,7 +6,7 @@ As a derivate work of [Linkedin Automation System](https://medium.com/@gathnex)
 Follow us on [linkedin](https://www.linkedin.com/company/gathnex/) and [Github](https://github.com/gathnexadmin). A special thanks to the Gathnex team members who made a significant contribution to this project.
 """
-llm = AutoModelForCausalLM.from_pretrained("https://huggingface.co/TheBloke/zephyr-7B-beta-GGUF/blob/main/zephyr-7b-beta.Q4_K_S.gguf",
 model_type='mistral',
 max_new_tokens = 1096,
 threads = 3,

 Follow us on [linkedin](https://www.linkedin.com/company/gathnex/) and [Github](https://github.com/gathnexadmin). A special thanks to the Gathnex team members who made a significant contribution to this project.
 """
+llm = AutoModelForCausalLM.from_pretrained("TheBloke/zephyr-7B-beta-GGUF/zephyr-7b-beta.Q4_K_S.gguf",
 model_type='mistral',
 max_new_tokens = 1096,
 threads = 3,