meridianal commited on
Commit
85555b2
·
verified ·
1 Parent(s): f7d208f

Update model card with correct v4.1 specs

Browse files
Files changed (1) hide show
  1. README.md +83 -83
README.md CHANGED
@@ -8,137 +8,137 @@ tags:
8
  - transformer
9
  - mamba
10
  - state-space-models
11
- - financial-ai
12
  - stock-prediction
13
  - forex-prediction
14
  ---
15
 
16
- # MeridianAlgo Financial Prediction Models
17
 
18
- ## Model Overview
19
 
20
- This repository contains financial prediction models built on the latest state-of-the-art 2026 architecture. These models leverage machine learning techniques, including Mamba State Space Models, Mixture of Experts, and Flash Attention 2, for accurate market forecasting.
21
 
22
- ### Architecture Highlights
23
 
24
- - Latest 2026 Architecture: Implementing the latest advances in deep learning for time series.
25
- - 388M Parameters: Large-scale model for comprehensive pattern recognition.
26
- - Unified Design: A single high-capacity model architectures for all assets within its class.
27
- - Specialized Logic: Distinct optimization paths for Stocks and Forex markets.
 
 
 
 
 
 
 
28
 
29
- ## Technical Specifications
30
-
31
- ### Core Technologies
32
-
33
- | Component | Description |
34
- |-----------|-------------|
35
- | Mamba SSM | State Space Models for efficient long-range sequence modeling with linear complexity. |
36
- | RoPE | Rotary Position Embeddings for enhanced temporal relationship encoding. |
37
- | GQA | Grouped Query Attention for optimized computational throughput. |
38
- | MoE | Mixture of Experts with top-k routing for specialized regime recognition. |
39
- | SwiGLU | Swish-Gated Linear Unit activation for improved transformer performance. |
40
- | RMSNorm | Root Mean Square Normalization for enhanced gradient stability. |
41
- | Flash Attention 2 | High-performance, memory-efficient attention implementation. |
42
-
43
- ### Model Specifications
44
 
45
  ```
46
- Architecture: Revolutionary 2026
47
- Parameters: 388,000,000
48
  Input Features: 44 technical indicators
49
- Sequence Length: 30 time steps
50
- Hidden Dimensions: 768
51
  Transformer Layers: 6
52
- Attention Heads: 12 (Query), 4 (Key/Value)
53
- Experts: 12 specialized models
54
- Prediction Heads: 8 ensemble heads
55
  ```
56
- ## Available Models
57
-
58
- ### 1. Meridian.AI Stocks Model
59
- - Repo ID: meridianal/ARA.AI
60
- - File: models/Meridian.AI_Stocks.pt
61
- - Purpose: Comprehensive stock market forecasting.
62
- - Coverage: Broad equity market compatibility.
63
- - Accuracy: Optimized for directional consistency.
64
 
65
- ### 2. Meridian.AI Forex Model
66
- - Repo ID: meridianal/ARA.AI
67
- - File: models/Meridian.AI_Forex.pt
68
- - Purpose: High-precision currency pair forecasting.
69
- - Coverage: Major, Minor, and Exotic pairs.
70
- - Accuracy: Optimized for pip-based movement prediction.
71
-
72
- ## Performance Metrics
73
 
74
- | Attribute | Stocks Model | Forex Model |
75
- |-----------|--------------|-------------|
76
- | Parameters | 388 Million | 388 Million |
77
- | Inference Latency | <100ms | <100ms |
78
- | Model Size | ~1.5 GB | ~1.5 GB |
79
- | Accuracy | Optimized | Optimized |
80
 
81
- ## Usage and Implementation
 
 
82
 
83
- ### Installation
84
 
85
- ```bash
86
- pip install torch transformers huggingface_hub
87
- ```
88
 
89
- ### Loading and Inference
90
 
91
  ```python
92
  from huggingface_hub import hf_hub_download
93
  from meridianalgo.unified_ml import UnifiedStockML
94
 
95
- # Download the unified stocks model
96
  model_path = hf_hub_download(
97
  repo_id="meridianal/ARA.AI",
98
  filename="models/Meridian.AI_Stocks.pt"
99
  )
100
 
101
- # Initialize the system
102
  ml = UnifiedStockML(model_path=model_path)
 
 
 
103
 
104
- # Execute prediction
105
- prediction = ml.predict_ultimate('AAPL', days=5)
106
 
107
- print(f"Current Price: {prediction['current_price']}")
 
 
 
 
 
 
 
 
108
  ```
109
 
110
- ## Training Methodology
111
 
112
- ### Configuration
113
- - Optimizer: AdamW with Weight Decay
114
- - Scheduler: Cosine Annealing with Warm Restarts
115
- - Loss Function: Balanced Directional Loss
116
- - Batch Size: 64
117
- - Learning Rate: 0.0005
 
 
118
 
119
- ### Infrastructure
120
- Models are trained using a distributed pipeline with Accelerate, tracking all metrics via Comet ML for rigorous validation.
121
 
122
- ## Limitations and Ethical Use
123
 
124
- 1. Market Volatility: Performance may degrade during black swan events or extreme volatility.
125
- 2. Horizon Decay: Predictive accuracy naturally decreases as the forecast horizon extends.
126
- 3. Historical Bias: Models reflect patterns in historical data which may not repeat.
127
- 4. Professional Use Only: Intended for research; users bear all financial risk.
 
 
 
 
 
 
128
 
129
- ## Citation
130
 
131
- If utilizing these models in professional research or applications, please cite:
 
 
 
 
 
132
 
133
  ```bibtex
134
  @software{meridianalgo_2026,
135
- title = {MeridianAlgo: Revolutionary Financial Prediction Platform},
136
  author = {MeridianAlgo},
137
  year = {2026},
138
- version = {4.0.0}
139
  }
140
  ```
141
 
142
  ## Disclaimer
143
 
144
- IMPORTANT: These models are for research and educational purposes only. They do not constitute financial advice. All trading involves risk of capital loss. The developers and contributors are not registered financial advisors.
 
 
 
 
 
8
  - transformer
9
  - mamba
10
  - state-space-models
 
11
  - stock-prediction
12
  - forex-prediction
13
  ---
14
 
15
+ # Meridian.AI - Financial Prediction Models
16
 
17
+ ## Overview
18
 
19
+ Meridian.AI is a 45M-parameter deep learning system for predicting price movements across stocks and forex pairs. It combines Mamba-2 state space models, sparse mixture-of-experts routing, and grouped query attention into a single unified architecture, trained continuously via GitHub Actions.
20
 
21
+ ## Architecture
22
 
23
+ | Component | Implementation | Purpose |
24
+ |-----------|---------------|---------|
25
+ | Sequence Modeling | Mamba-2 SSM with selective scan | Linear-time long-range dependencies |
26
+ | Attention | Grouped Query Attention (GQA) + QK-Norm | Efficient multi-head attention with reduced KV cache |
27
+ | Position Encoding | Rotary Position Embeddings (RoPE) | Relative temporal awareness |
28
+ | Expert Routing | Mixture of Experts (4 experts, top-2) | Regime-specific specialization |
29
+ | Activations | SwiGLU (gated linear units) | Improved gradient flow |
30
+ | Normalization | RMSNorm + Layer Scale | Training stability at scale |
31
+ | Regularization | Stochastic Depth (drop path) | Better generalization |
32
+ | Training | Mixed precision (FP16/BF16) via Accelerate | 2x throughput on compatible hardware |
33
+ | Loss | BalancedDirectionLoss (Huber + BCE) | Joint price regression and direction accuracy |
34
 
35
+ ## Model Specifications
 
 
 
 
 
 
 
 
 
 
 
 
 
 
36
 
37
  ```
38
+ Architecture: Revolutionary v4.1
39
+ Parameters: ~45 Million (33,071,045)
40
  Input Features: 44 technical indicators
41
+ Sequence Length: 30 timesteps
42
+ Hidden Dimension: 384
43
  Transformer Layers: 6
44
+ Attention Heads: 6 (2 KV heads)
45
+ Experts: 4 (top-2 routing)
46
+ Prediction Heads: 4
47
  ```
 
 
 
 
 
 
 
 
48
 
49
+ ## Available Models
 
 
 
 
 
 
 
50
 
51
+ ### Meridian.AI Stocks
 
 
 
 
 
52
 
53
+ - **File:** `models/Meridian.AI_Stocks.pt`
54
+ - **Coverage:** 49 equities across sectors (AAPL, MSFT, GOOGL, AMZN, TSLA, etc.)
55
+ - **Data:** Daily + hourly + weekly OHLCV with 44 technical indicators
56
 
57
+ ### Meridian.AI Forex
58
 
59
+ - **File:** `models/Meridian.AI_Forex.pt`
60
+ - **Coverage:** 22 currency pairs (EUR/USD, GBP/USD, USD/JPY, etc.)
61
+ - **Data:** Multi-timeframe OHLCV with 44 technical indicators
62
 
63
+ ## Usage
64
 
65
  ```python
66
  from huggingface_hub import hf_hub_download
67
  from meridianalgo.unified_ml import UnifiedStockML
68
 
69
+ # Download the stocks model
70
  model_path = hf_hub_download(
71
  repo_id="meridianal/ARA.AI",
72
  filename="models/Meridian.AI_Stocks.pt"
73
  )
74
 
 
75
  ml = UnifiedStockML(model_path=model_path)
76
+ prediction = ml.predict_ultimate("AAPL", days=5)
77
+ print(prediction)
78
+ ```
79
 
80
+ ```python
81
+ from meridianalgo.forex_ml import ForexML
82
 
83
+ # Download the forex model
84
+ model_path = hf_hub_download(
85
+ repo_id="meridianal/ARA.AI",
86
+ filename="models/Meridian.AI_Forex.pt"
87
+ )
88
+
89
+ ml = ForexML(model_path=model_path)
90
+ prediction = ml.predict("EURUSD=X", days=5)
91
+ print(prediction)
92
  ```
93
 
94
+ ## Training
95
 
96
+ - **Optimizer:** AdamW (weight decay 0.02, betas 0.9/0.95)
97
+ - **Scheduler:** Cosine annealing with warm restarts
98
+ - **Loss:** BalancedDirectionLoss (60% Huber + 40% balanced BCE)
99
+ - **Batch Size:** Effective 256 via gradient accumulation
100
+ - **EMA:** Exponential moving average of weights (decay 0.999)
101
+ - **Data Augmentation:** Gaussian noise (0.5%) + random timestep masking (5%)
102
+ - **Early Stopping:** Patience of 20 epochs on EMA validation loss
103
+ - **Pipeline:** Automated via GitHub Actions every 6 hours
104
 
105
+ Metrics are tracked with Comet ML. Version gating ensures stale pre-v4.1 checkpoints are never loaded.
 
106
 
107
+ ## Technical Indicators (44 features)
108
 
109
+ | Category | Indicators |
110
+ |----------|-----------|
111
+ | Price | Returns, Log Returns, Volatility, ATR |
112
+ | Trend | SMA (5/10/20/50/200), EMA (5/10/20/50/200) |
113
+ | Momentum | RSI, Fast RSI, Stochastic RSI, Momentum, ROC, Williams %R |
114
+ | Oscillators | MACD, MACD Signal, MACD Histogram, Stochastic K/D, CCI |
115
+ | Volatility | Bollinger Bands (Upper/Lower/Width/%B), Keltner Channels (Upper/Lower/%K) |
116
+ | Volume | Volume SMA, Volume Ratio, OBV (normalized) |
117
+ | Trend Strength | ADX, +DI, -DI, Price vs SMA50/SMA200, ATR% |
118
+ | Mean Reversion | Z-Score (20d), Distance from 52-week High |
119
 
120
+ ## Limitations
121
 
122
+ 1. Performance may degrade during black swan events or extreme volatility.
123
+ 2. Predictive accuracy decreases as forecast horizon extends.
124
+ 3. Models reflect patterns in historical data which may not repeat.
125
+ 4. For research and educational use only -- not financial advice.
126
+
127
+ ## Citation
128
 
129
  ```bibtex
130
  @software{meridianalgo_2026,
131
+ title = {Meridian.AI: Financial Prediction Engine},
132
  author = {MeridianAlgo},
133
  year = {2026},
134
+ version = {4.1.0}
135
  }
136
  ```
137
 
138
  ## Disclaimer
139
 
140
+ These models are for research and educational purposes only. They do not constitute financial advice. Trading financial instruments carries significant risk. The developers and contributors are not liable for any financial losses. All trading decisions are yours alone.
141
+
142
+ ## License
143
+
144
+ MIT License. See the [GitHub repository](https://github.com/MeridianAlgo/AraAI) for details.