WildnerveAI's picture
Upload 11 files
69800cb verified
# Wildnerve-tlm01 Model Checkpoints
This repository contains the trained weights for the Wildnerve-tlm01 hybrid neural-symbolic language model architecture, which combines transformer-based language processing with biologically-inspired Spike-Timing-Dependent Plasticity (STDP).
## Repository Structure
The weights are organized into two main components:
- **`snn/`**: Contains the STDP-trained synaptic weights that enable neuromorphic learning
- `stdp_model_epoch_30.bin`: Synaptic weights after 30 epochs of STDP training
- **`transformer/`**: Contains the transformer model weights for language processing
- `model_weights.bin`: Transformer component weights
## Usage
These weights are designed to be used with the Wildnerve-tlm01 model implementation located in the [EvolphTech/Model](https://huggingface.co/EvolphTech/Model) repository.
### Loading the Weights
```python
import torch
import os
from huggingface_hub import hf_hub_download
# Download the components
snn_path = hf_hub_download(
repo_id="EvolphTech/Checkpoints",
filename="snn/stdp_model_epoch_30.bin",
cache_dir="model_cache"
)
transformer_path = hf_hub_download(
repo_id="EvolphTech/Checkpoints",
filename="transformer/model_weights.bin",
cache_dir="model_cache"
)
# Load the weights
snn_weights = torch.load(snn_path, map_location="cpu")
transformer_weights = torch.load(transformer_path, map_location="cpu")
```
For complete integration instructions, see the [model documentation](https://huggingface.co/EvolphTech/Model#usage).
## Training Details
- **SNN Component**: Trained for 30 epochs using STDP learning rule with adaptive synaptic weights
- **Transformer Component**: Trained on multiple programming and general knowledge datasets
## License
Mozilla Public License 2.0 (MPL 2.0)