Update README.md
Browse files
README.md
CHANGED
|
@@ -3,35 +3,53 @@ library_name: transformers
|
|
| 3 |
tags: []
|
| 4 |
---
|
| 5 |
|
| 6 |
-
#
|
| 7 |
|
| 8 |
-
|
|
|
|
| 9 |
|
| 10 |
|
| 11 |
|
| 12 |
## Model Details
|
| 13 |
|
| 14 |
-
### Model Description
|
| 15 |
|
| 16 |
-
|
|
|
|
|
|
|
| 17 |
|
| 18 |
-
|
|
|
|
|
|
|
| 19 |
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
- **Shared by [optional]:** [More Information Needed]
|
| 23 |
-
- **Model type:** [More Information Needed]
|
| 24 |
-
- **Language(s) (NLP):** [More Information Needed]
|
| 25 |
-
- **License:** [More Information Needed]
|
| 26 |
-
- **Finetuned from model [optional]:** [More Information Needed]
|
| 27 |
|
| 28 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
|
| 30 |
-
|
|
|
|
|
|
|
|
|
|
| 31 |
|
| 32 |
-
|
| 33 |
-
- **
|
| 34 |
-
- **
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 35 |
|
| 36 |
## Uses
|
| 37 |
|
|
|
|
| 3 |
tags: []
|
| 4 |
---
|
| 5 |
|
| 6 |
+
# FinPlan-1
|
| 7 |
|
| 8 |
+
FinPlan-1 is a an LLM trained to assist with the creation of basic personal financial plans for individuals. This model is built off of the
|
| 9 |
+
Fino1 model which is itself a version of Llama-3.1-8B-Instruct, which was CoT fine tuned to improve its finaicial reasoning ability.
|
| 10 |
|
| 11 |
|
| 12 |
|
| 13 |
## Model Details
|
| 14 |
|
| 15 |
+
### Model Description -- Introduction
|
| 16 |
|
| 17 |
+
According to Bankrate’s 2025 Emergency Savings Report, only 41% of American’s would be able to use their personal savings to pay for a $1,000 emergency expense,
|
| 18 |
+
with the rest “financing it with a credit card they’d pay off over time, reducing their spending on other things, taking out a personal loan,
|
| 19 |
+
borrowing from family or friends or other methods.”
|
| 20 |
|
| 21 |
+
The financial health of American’s is based on a number of factors but one important component is basic financial literacy and having a financial plan.
|
| 22 |
+
The financial planning component is one area I think LLMs can be of assistance. This LLM is my attempt to further train and fine tune a model which has been trained
|
| 23 |
+
on financial reasoning tasks to assist individuals with two key aspects of financial planning.
|
| 24 |
|
| 25 |
+
1. Assist with the creation of a budget spreadsheet to enable individuals to keep track of their finances and understand where their money is going.
|
| 26 |
+
2. Provide assistance with planning for short, medium and long term goals including breaking those goals down into monthly savings targets, and suggesting broad investment vehicles to fit each goal's timeframe.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
|
| 28 |
+
While current LLM's can perform these tasks to an extent, they are often inconsistent with their responce structure, can sometimes struggle with breaking down basic mathematics
|
| 29 |
+
and frequently go beyond the basic tasks at hand reccomending inappropriate savings and investiment vehicles for individual savings goals. The Fino-1 8B model is certainly well
|
| 30 |
+
trained for the corporate financial reasoning tasks but its reccomendations for savings and investment vehicles were often too agressive for short term goals and may reccomend
|
| 31 |
+
long term savings vehicles which carry tax penalties if not used approporately. This model uses LoRA on a proceedureally generated budgeting dataset as well as few shot prompting using
|
| 32 |
+
a separate dataset based around short, medium and long term goals to enchance the ability of Fino-1 8B to accomplish these tasks.
|
| 33 |
|
| 34 |
+
The results of this training and prompting method are encouraging as the model consistently produces budget spreadsheets (through the generation of executable python code)
|
| 35 |
+
as well as somewhat reliable savings plan assistance with the use of few shot prompting. These training methods do have an impact on this model's performance on standard
|
| 36 |
+
benchmarks like gsm8k and mmlu resulting in drops in performance on both tasks compared with the base model, however this loss in generalization is made up for in the model's
|
| 37 |
+
improved ability to accomplish the tasks of assisting indivudals with budgeting and fixed term savinings goals.
|
| 38 |
|
| 39 |
+
|
| 40 |
+
- **Developed by:** Timothy Austin Rodriguez
|
| 41 |
+
- **Funded by [optional]:** University of Virginia
|
| 42 |
+
- **Training type:** LoRA - Few Shot Prompting (3)
|
| 43 |
+
- **Language(s) (NLP):** Python
|
| 44 |
+
- **License:** MIT
|
| 45 |
+
- **Finetuned from model [optional]:** Fino1-8B [which is fine tuned from Llama 3.1 8B Instruct]
|
| 46 |
+
|
| 47 |
+
### Training Data
|
| 48 |
+
|
| 49 |
+
This model is trained on a procedurally generated synthetic dataset that provides structured prompts and responses to assist the underlying Fino-1 8B model
|
| 50 |
+
with creating executable python code which creates and exports budget spreadsheet to a Microsoft Excel .xlsx format. THis dataset (attached to this repository) is comprised
|
| 51 |
+
of 3000 examples which were divided into a train/validation split of 2500 for training and 500 for validation. The code used to create this dataset including the seeds() can be
|
| 52 |
+
located in the ipynb files attached to this repository.
|
| 53 |
|
| 54 |
## Uses
|
| 55 |
|