EN→FR Transformer (From Scratch)

Custom Transformer for English-French translation, built entirely from scratch in Keras without pre-trained models.

Live Demo Kaggle Notebook GitHub

Performance

BLEU: 0.58
Parameters: 44.9M
Architecture: 2-layer encoder-decoder, 4 attention heads, 128-dim embeddings

Files

enhanced_transformer.keras - Model weights (550MB)
source_vocab.pkl - English vocabulary
target_vocab.pkl - French vocabulary
config.pkl - Configuration

Training

Dataset: 175K EN-FR sentence pairs
Vocab: 20K tokens per language
Max length: 20 tokens
Built from scratch - no transfer learning

Full implementation details: GitHub

Examples

English	French
Hello, how are you?	Bonjour, comment vous êtes?
Thank you very much	Merci beaucoup
The weather is beautiful	Le temps est beau

Citation

@misc{vachier2026transformer,
  author = {Vachier, Jeremy},
  title = {English-French Transformer from Scratch},
  year = {2026},
  url = {https://huggingface.co/Jvachier/en-fr-transformer-from-scratch}
}

Downloads last month: 2