mainbrains commited on
Commit
5bd356f
·
verified ·
1 Parent(s): 927e266

Add maintainer notes and deployment config

Browse files
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -16,6 +16,15 @@ widget:
16
  - role: user
17
  content: Can you provide ways to eat combinations of bananas and dragonfruits?
18
  ---
 
 
 
 
 
 
 
 
 
19
  🎉 **Phi-3.5**: [[mini-instruct]](https://huggingface.co/microsoft/Phi-3.5-mini-instruct); [[MoE-instruct]](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct) ; [[vision-instruct]](https://huggingface.co/microsoft/Phi-3.5-vision-instruct)
20
 
21
  ## Model Summary
 
16
  - role: user
17
  content: Can you provide ways to eat combinations of bananas and dragonfruits?
18
  ---
19
+
20
+
21
+ > **Fork maintained by [@mainbrains](https://huggingface.co/mainbrains)** — Using Phi-3-mini as a lightweight reasoning backbone for multi-agent pipelines. Low latency on edge hardware (Pi 5, Jetson).
22
+ >
23
+ > **Use case:** Local inference node in a WireGuard mesh — handles tool-calling and structured output generation at ~40 tok/s on consumer hardware with llama.cpp.
24
+
25
+ ---
26
+
27
+
28
  🎉 **Phi-3.5**: [[mini-instruct]](https://huggingface.co/microsoft/Phi-3.5-mini-instruct); [[MoE-instruct]](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct) ; [[vision-instruct]](https://huggingface.co/microsoft/Phi-3.5-vision-instruct)
29
 
30
  ## Model Summary