LexiMind / src /models /encoder.py

Commit History

Update LexiMind: improved training, model architecture, and evaluation
076bc18

OliverPerrin commited on

Full training run, code cleanup, mypy/ruff fixes
a47e5cf

OliverPerrin commited on

feat: Add FLAN-T5 compatibility with relative position bias
486475d

OliverPerrin commited on

Build: Pin ruff to v0.4.4 in pre-commit to match CI
68d7617

OliverPerrin commited on

Chore: Update pre-commit hooks and fix formatting
2dcb4b5

OliverPerrin commited on

Style: Fix formatting for models and tests
f2e0099

OliverPerrin commited on

Refactor: Consolidate dependencies, improve testing, and add CI/CD
f6d689c

OliverPerrin commited on

Implemented the following parts for the Transformer model: poisional_encoding, feedfoward, encoder, and skeleton of decoder. As well as Test cases for each class respectively and visualizations
aefdcf0

OliverPerrin commited on

Implemented ScaledDotProduct Attention and Multi-Head Attention
046d0f2

OliverPerrin commited on