LexiMind / src /models /attention.py

Commit History

Fix Pylance type errors, add inductor compilation support
cf79a6c

OliverPerrin commited on

feat: Add FLAN-T5 compatibility with relative position bias
486475d

OliverPerrin commited on

Refactor: Consolidate dependencies, improve testing, and add CI/CD
f6d689c

OliverPerrin commited on

Added pretrained BART wights for the encoder/decoder while keeping custom architectiure and task heads
3225a94

OliverPerrin commited on

Implemented the following parts for the Transformer model: poisional_encoding, feedfoward, encoder, and skeleton of decoder. As well as Test cases for each class respectively and visualizations
aefdcf0

OliverPerrin commited on

Implemented ScaledDotProduct Attention and Multi-Head Attention
046d0f2

OliverPerrin commited on

Reformatted Project Structure
133ab4d

OliverPerrin commited on