Update README.md

README.md

@@ -49,12 +49,28 @@ language:
 metrics:
 - accuracy
 base_model:
-- Qwen/Qwen2-7B
+- FreedomIntelligence/Apollo2-7B
 pipeline_tag: question-answering
 tags:
 - biology
 - medical
 ---
+# Apollo2-7B-exl2
+Original model: [Apollo2-7B](https://huggingface.co/FreedomIntelligence/Apollo2-7B)  
+Made by: [FreedomIntelligence](https://huggingface.co/FreedomIntelligence)
+
+## Quants
+[4bpw h6 (main)](https://huggingface.co/cgus/Apollo2-7B-exl2/tree/main)  
+[4.5bpw h6](https://huggingface.co/cgus/Apollo2-7B-exl2/tree/4.5bpw-h6)  
+[5bpw h6](https://huggingface.co/cgus/Apollo2-7B-exl2/tree/5bpw-h6)  
+[6bpw h6](https://huggingface.co/cgus/Apollo2-7B-exl2/tree/6bpw-h6)  
+[8bpw h8](https://huggingface.co/cgus/Apollo2-7B-exl2/tree/8bpw-h8)  
+
+## Quantization notes
+Made with Exllamav2 0.2.3 with the default dataset. This model needs software with Exllamav2 library such as Text-Generation-WebUI, TabbyAPI, etc.  
+This model has to fit your GPU to be usable and it's mainly meant for RTX cards on Windows/Linux or AMD on Linux.  
+
+# Original model card
 # Democratizing Medical LLMs For Much More Languages
 
 Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish, Arabic, Russian, Japanese, Korean, German, Italian, Portuguese and 38 Minor Languages So far.
@@ -67,7 +83,7 @@ Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish,
 
 
 
-![Apollo](assets/apollo_medium_final.png)
+![Apollo](https://huggingface.co/FreedomIntelligence/Apollo2-7B/resolve/main/assets/apollo_medium_final.png)
 
 
 ## 🌈 Update
@@ -81,7 +97,7 @@ Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish,
 <details>
   <summary>Click to view the Languages Coverage</summary>
    
-   ![ApolloMoE](assets/languages.png)
+   ![ApolloMoE](https://huggingface.co/FreedomIntelligence/Apollo2-7B/resolve/main/assets/languages.png)
 
 </details>
 
@@ -91,7 +107,7 @@ Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish,
 <details>
   <summary>Click to view the MoE routing image</summary>
 
-  ![ApolloMoE](assets/hybrid_routing.png)
+  ![ApolloMoE](https://huggingface.co/FreedomIntelligence/Apollo2-7B/resolve/main/assets/hybrid_routing.png)
 
 </details>
 
@@ -105,7 +121,7 @@ Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish,
 <details>
   <summary>Click to view the Dense Models Results</summary>
 
-   ![ApolloMoE](assets/dense_results.png)
+   ![ApolloMoE](https://huggingface.co/FreedomIntelligence/Apollo2-7B/resolve/main/assets/dense_results.png)
 
 </details>
 
@@ -116,7 +132,7 @@ Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish,
 <details>
   <summary>Click to view the Post-MoE Models Results</summary>
 
-   ![ApolloMoE](assets/post_moe_results.png)
+   ![ApolloMoE](https://huggingface.co/FreedomIntelligence/Apollo2-7B/resolve/main/assets/post_moe_results.png)
 
 </details>
 
@@ -139,7 +155,7 @@ Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish,
 
    <details><summary>Click to expand</summary>
 
-    ![ApolloMoE](assets/Dataset.png)
+    ![ApolloMoE](https://huggingface.co/FreedomIntelligence/Apollo2-7B/resolve/main/assets/Dataset.png)
 
     - [Data category](https://huggingface.co/datasets/FreedomIntelligence/ApolloCorpus/tree/main/train)