LexiMind / src /models

Commit History

Fixed compiling issue, added legnth penalty, and atttempting freezing encoder layers 0-5 to lower parameters and preserve T5's langauge understanding.
baf3026

OliverPerrin commited on

Improve emotion task architecture and fix visualizations
6a7a381

OliverPerrin commited on

Clean up codebase and fix training bugs
1601799

OliverPerrin commited on

Update LexiMind: improved training, model architecture, and evaluation
076bc18

OliverPerrin commited on

Fix Pylance type errors, add inductor compilation support
cf79a6c

OliverPerrin commited on

Full training run, code cleanup, mypy/ruff fixes
a47e5cf

OliverPerrin commited on

feat: Add FLAN-T5 compatibility with relative position bias
486475d

OliverPerrin commited on

Build: Pin ruff to v0.4.4 in pre-commit to match CI
68d7617

OliverPerrin commited on

Refactor: Fix B905 zip() strictness and resolve mypy error in evaluate.py
a7d82d1

OliverPerrin commited on

Fix: Resolve mypy type errors and configuration
c0044cc

OliverPerrin commited on

Chore: Update pre-commit hooks and fix formatting
2dcb4b5

OliverPerrin commited on

Style: Fix formatting for models and tests
f2e0099

OliverPerrin commited on

Style: Apply ruff formatting
29f2de2

OliverPerrin commited on

Style: Fix linting errors and organize imports (ruff & mypy)
f9d964d

OliverPerrin commited on

Refactor: Consolidate dependencies, improve testing, and add CI/CD
f6d689c

OliverPerrin commited on

refactor: update training code, history and remove large checkpoint to fix storage limit
0ec3f34

OliverPerrin commited on

Added pretrained BART wights for the encoder/decoder while keeping custom architectiure and task heads
3225a94

OliverPerrin commited on

Updated Greedy Decode w/ a minlen search
45089eb

OliverPerrin commited on

chore: snapshot current refinements
185b05e

OliverPerrin commited on

Updated Summarizer, Preprocessor to run on my custom transformer and added basic streamlit frontend demo
e48a8ab

OliverPerrin commited on

Finsihed Decoder Implementation, as well as prediction heads and multitask
f672f40

OliverPerrin commited on

Implemented the following parts for the Transformer model: poisional_encoding, feedfoward, encoder, and skeleton of decoder. As well as Test cases for each class respectively and visualizations
aefdcf0

OliverPerrin commited on

Implemented ScaledDotProduct Attention and Multi-Head Attention
046d0f2

OliverPerrin commited on

Reformatted Project Structure
133ab4d

OliverPerrin commited on