Hugging Face's logo

simonykq
/
nvidia-transaction-decoder-fm

Feature Extraction
Transformers
Safetensors
llama
financial
transactions
foundation-model
embeddings
Model card Files
xet
 Community
nvidia-transaction-decoder-fm / README.md
simonykq's picture
simonykq
Upload folder using huggingface_hub
962ade5 verified
preview code
|
Raw
History Blame Contribute Delete
1.01 kB
metadata 
license: apache-2.0
library_name: transformers
tags:
  - financial
  - transactions
  - llama
  - foundation-model
  - embeddings
pipeline_tag: feature-extraction

NVIDIA Transaction Decoder Foundation Model (~29M)

Pretrained checkpoint from the NVIDIA Build Your Own Transaction Foundation Model developer example, as described in the NVIDIA Technical Blog.

  • Architecture: Llama decoder-only (~29M params, hidden 512, 8 layers, GQA)
  • Vocabulary: ~6,251 domain-specific financial transaction tokens
  • Trained ~3,000 steps on IBM TabFormer with NeMo AutoModel
  • Load with AutoModelForCausalLM.from_pretrained(...) and extract last-token embeddings

This Hub mirror exists so Spaces / Transformers can load the Git LFS checkpoint published under models/decoder-foundation-model/ in the upstream GitHub repo.