ThinkTim21 commited on
Commit
84f5979
·
verified ·
1 Parent(s): 54547ed

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -17
README.md CHANGED
@@ -3,35 +3,53 @@ library_name: transformers
3
  tags: []
4
  ---
5
 
6
- # Model Card for Model ID
7
 
8
- <!-- Provide a quick summary of what the model is/does. -->
 
9
 
10
 
11
 
12
  ## Model Details
13
 
14
- ### Model Description
15
 
16
- <!-- Provide a longer summary of what this model is. -->
 
 
17
 
18
- This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
 
 
19
 
20
- - **Developed by:** [More Information Needed]
21
- - **Funded by [optional]:** [More Information Needed]
22
- - **Shared by [optional]:** [More Information Needed]
23
- - **Model type:** [More Information Needed]
24
- - **Language(s) (NLP):** [More Information Needed]
25
- - **License:** [More Information Needed]
26
- - **Finetuned from model [optional]:** [More Information Needed]
27
 
28
- ### Model Sources [optional]
 
 
 
 
29
 
30
- <!-- Provide the basic links for the model. -->
 
 
 
31
 
32
- - **Repository:** [More Information Needed]
33
- - **Paper [optional]:** [More Information Needed]
34
- - **Demo [optional]:** [More Information Needed]
 
 
 
 
 
 
 
 
 
 
 
35
 
36
  ## Uses
37
 
 
3
  tags: []
4
  ---
5
 
6
+ # FinPlan-1
7
 
8
+ FinPlan-1 is a an LLM trained to assist with the creation of basic personal financial plans for individuals. This model is built off of the
9
+ Fino1 model which is itself a version of Llama-3.1-8B-Instruct, which was CoT fine tuned to improve its finaicial reasoning ability.
10
 
11
 
12
 
13
  ## Model Details
14
 
15
+ ### Model Description -- Introduction
16
 
17
+ According to Bankrate’s 2025 Emergency Savings Report, only 41% of American’s would be able to use their personal savings to pay for a $1,000 emergency expense,
18
+ with the rest “financing it with a credit card they’d pay off over time, reducing their spending on other things, taking out a personal loan,
19
+ borrowing from family or friends or other methods.”
20
 
21
+ The financial health of American’s is based on a number of factors but one important component is basic financial literacy and having a financial plan.
22
+ The financial planning component is one area I think LLMs can be of assistance. This LLM is my attempt to further train and fine tune a model which has been trained
23
+ on financial reasoning tasks to assist individuals with two key aspects of financial planning.
24
 
25
+ 1. Assist with the creation of a budget spreadsheet to enable individuals to keep track of their finances and understand where their money is going.
26
+ 2. Provide assistance with planning for short, medium and long term goals including breaking those goals down into monthly savings targets, and suggesting broad investment vehicles to fit each goal's timeframe.
 
 
 
 
 
27
 
28
+ While current LLM's can perform these tasks to an extent, they are often inconsistent with their responce structure, can sometimes struggle with breaking down basic mathematics
29
+ and frequently go beyond the basic tasks at hand reccomending inappropriate savings and investiment vehicles for individual savings goals. The Fino-1 8B model is certainly well
30
+ trained for the corporate financial reasoning tasks but its reccomendations for savings and investment vehicles were often too agressive for short term goals and may reccomend
31
+ long term savings vehicles which carry tax penalties if not used approporately. This model uses LoRA on a proceedureally generated budgeting dataset as well as few shot prompting using
32
+ a separate dataset based around short, medium and long term goals to enchance the ability of Fino-1 8B to accomplish these tasks.
33
 
34
+ The results of this training and prompting method are encouraging as the model consistently produces budget spreadsheets (through the generation of executable python code)
35
+ as well as somewhat reliable savings plan assistance with the use of few shot prompting. These training methods do have an impact on this model's performance on standard
36
+ benchmarks like gsm8k and mmlu resulting in drops in performance on both tasks compared with the base model, however this loss in generalization is made up for in the model's
37
+ improved ability to accomplish the tasks of assisting indivudals with budgeting and fixed term savinings goals.
38
 
39
+
40
+ - **Developed by:** Timothy Austin Rodriguez
41
+ - **Funded by [optional]:** University of Virginia
42
+ - **Training type:** LoRA - Few Shot Prompting (3)
43
+ - **Language(s) (NLP):** Python
44
+ - **License:** MIT
45
+ - **Finetuned from model [optional]:** Fino1-8B [which is fine tuned from Llama 3.1 8B Instruct]
46
+
47
+ ### Training Data
48
+
49
+ This model is trained on a procedurally generated synthetic dataset that provides structured prompts and responses to assist the underlying Fino-1 8B model
50
+ with creating executable python code which creates and exports budget spreadsheet to a Microsoft Excel .xlsx format. THis dataset (attached to this repository) is comprised
51
+ of 3000 examples which were divided into a train/validation split of 2500 for training and 500 for validation. The code used to create this dataset including the seeds() can be
52
+ located in the ipynb files attached to this repository.
53
 
54
  ## Uses
55