Update README.md

README.md

@@ -9,4 +9,87 @@ tags:
 - minerva-math
 library_name: transformers
 pipeline_tag: text-generation
----
+---
+
+# jrc/phi3-mini-math
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+Phi-3 Mini 4k Instruct model finetuned on math datasets.
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+## Evaluation
+
+The finetuned model is evaluated on [minerva-math]() using [EleutherAI Eval Harness]() through torchtune:
+
+CMD: `tune run eleuther_eval --config eleuther_evaluation checkpoint.checkpoint_dir=./lora-phi3-math tasks=["minerva_math"] batch_size=32
+
+RESULTS:
+```
+|               Tasks                |Version|Filter|n-shot|  Metric   |Value |   |Stderr|
+|------------------------------------|-------|------|-----:|-----------|-----:|---|-----:|
+|minerva_math                        |N/A    |none  |     4|exact_match|0.1670|±  |0.0051|
+| - minerva_math_algebra             |      1|none  |     4|exact_match|0.2502|±  |0.0126|
+| - minerva_math_counting_and_prob   |      1|none  |     4|exact_match|0.1329|±  |0.0156|
+| - minerva_math_geometry            |      1|none  |     4|exact_match|0.1232|±  |0.0150|
+| - minerva_math_intermediate_algebra|      1|none  |     4|exact_match|0.0576|±  |0.0078|
+| - minerva_math_num_theory          |      1|none  |     4|exact_match|0.1148|±  |0.0137|
+| - minerva_math_prealgebra          |      1|none  |     4|exact_match|0.3077|±  |0.0156|
+| - minerva_math_precalc             |      1|none  |     4|exact_match|0.0623|±  |0.0104|
+```
+
+
+## Technical Specifications [optional]
+
+#### Hardware
+
+4 x NVIDIA A100 GPUs
+
+Max VRAM used per GPU: 29 GB
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]