|
|
--- |
|
|
base_model: unsloth/Qwen3-0.6B |
|
|
library_name: peft |
|
|
license: mit |
|
|
datasets: |
|
|
- atahanuz/stock_prediction |
|
|
language: |
|
|
- en |
|
|
pipeline_tag: text-generation |
|
|
tags: |
|
|
- finance |
|
|
- sft |
|
|
- trl |
|
|
- unsloth |
|
|
- transformers |
|
|
--- |
|
|
|
|
|
# Model Card for StockDirection-6K |
|
|
|
|
|
## Model Details |
|
|
|
|
|
StockDirection is a fine-tuned language model for binary stock movement prediction. |
|
|
The model is trained to predict whether the next day’s stock price of Akbank (AKBNK), traded on Borsa Istanbul (BIST), will move UP or DOWN, based on the daily percentage changes from the last four days and the current day. |
|
|
|
|
|
- Input: A formatted prompt describing the last 5 days of daily percentage price changes. |
|
|
- Output: A simple categorical prediction — "UP" or "DOWN". |
|
|
|
|
|
This model was fine-tuned on a dataset of 6,300 labeled rows of AKBNK stock data. |
|
|
|
|
|
## Uses |
|
|
|
|
|
### Direct Use |
|
|
|
|
|
- Educational purposes: Demonstrating how LLMs can be fine-tuned for financial classification tasks. |
|
|
- Research: Exploring text-based sequence learning for stock direction prediction. |
|
|
- Proof of concept: Serving as an example for stock price direction prediction using natural language prompts. |
|
|
|
|
|
⚠️ Not for financial advice or live trading decisions. |
|
|
|
|
|
|
|
|
## How to Get Started with the Model |
|
|
|
|
|
Use the code below to get started with the model. |
|
|
|
|
|
```python |
|
|
from transformers import AutoTokenizer, AutoModelForCausalLM |
|
|
from peft import PeftModel |
|
|
|
|
|
|
|
|
|
|
|
tokenizer = AutoTokenizer.from_pretrained("unsloth/Qwen3-0.6B",) |
|
|
base_model = AutoModelForCausalLM.from_pretrained( |
|
|
"unsloth/Qwen3-0.6B", |
|
|
device_map={"": 0} |
|
|
) |
|
|
|
|
|
model = PeftModel.from_pretrained(base_model,"khazarai/StockDirection-6K") |
|
|
|
|
|
|
|
|
question =""" |
|
|
You are an assistant that predicts whatever a stock will go up or down in the next day based on the daily percentage price changes of the last: |
|
|
4 days ago: 0.00 |
|
|
3 days ago: -3.09 |
|
|
2 days ago: 2.13 |
|
|
1 day ago: -2.04 |
|
|
today: 0.01 |
|
|
Predict whatever the next day's price will go up or down. Simply write your prediction as UP or DOWN |
|
|
""" |
|
|
|
|
|
messages = [ |
|
|
{"role" : "user", "content" : question} |
|
|
] |
|
|
text = tokenizer.apply_chat_template( |
|
|
messages, |
|
|
tokenize = False, |
|
|
add_generation_prompt = True, |
|
|
enable_thinking = False, |
|
|
) |
|
|
|
|
|
from transformers import TextStreamer |
|
|
_ = model.generate( |
|
|
**tokenizer(text, return_tensors = "pt").to("cuda"), |
|
|
max_new_tokens = 200, |
|
|
temperature = 0.7, |
|
|
top_p = 0.8, |
|
|
top_k = 20, |
|
|
streamer = TextStreamer(tokenizer, skip_prompt = True), |
|
|
) |
|
|
``` |
|
|
**For pipeline:** |
|
|
|
|
|
```python |
|
|
from transformers import pipeline, AutoModelForCausalLM, AutoTokenizer |
|
|
from peft import PeftModel |
|
|
|
|
|
tokenizer = AutoTokenizer.from_pretrained("unsloth/Qwen3-0.6B") |
|
|
base_model = AutoModelForCausalLM.from_pretrained("unsloth/Qwen3-0.6B") |
|
|
model = PeftModel.from_pretrained(base_model, "khazarai/StockDirection-6K") |
|
|
|
|
|
question =""" |
|
|
You are an assistant that predicts whatever a stock will go up or down in the next day based on the daily percentage price changes of the last: |
|
|
4 days ago: 0.00 |
|
|
3 days ago: -3.09 |
|
|
2 days ago: 2.13 |
|
|
1 day ago: -2.04 |
|
|
today: 0.01 |
|
|
Predict whatever the next day's price will go up or down. Simply write your prediction as UP or DOWN |
|
|
""" |
|
|
|
|
|
pipe = pipeline("text-generation", model=model, tokenizer=tokenizer) |
|
|
messages = [ |
|
|
{"role": "user", "content": question} |
|
|
] |
|
|
pipe(messages) |
|
|
|
|
|
``` |
|
|
|
|
|
## Training Data |
|
|
|
|
|
- Dataset: [atahanuz/stock_prediction](https://huggingface.co/datasets/atahanuz/stock_prediction) |
|
|
- Size: 6,355 labeled examples. |
|
|
- Structure: Each sample contains past 5 daily percentage changes and the target label (UP/DOWN). |
|
|
|
|
|
Example: |
|
|
|
|
|
```vbnet |
|
|
Question: You are an assistant that predicts whether a stock will go up or down in the next day |
|
|
based on the daily percentage price changes of the last: |
|
|
4 days ago: nan |
|
|
3 days ago: 0.00 |
|
|
2 days ago: 2.22 |
|
|
1 day ago: -2.17 |
|
|
today: -2.22 |
|
|
Predict whether the next day's price will go up or down. |
|
|
Simply write your prediction as UP or DOWN. |
|
|
|
|
|
Answer: DOWN |
|
|
``` |
|
|
|
|
|
|
|
|
### Framework versions |
|
|
|
|
|
- PEFT 0.15.2 |
