Hugging Face's logo

vrishv
/
Viveka-34M

Text Generation
Transformers
Safetensors
English
llama
small-language-model
from-scratch
sentence-scoring
sentence-ranking
text-scoring
tiny-model
english
34m
causal-lm
language-model
perplexity
grammar
sentence-judge
small-model
pretrained-from-scratch
fineweb-edu
wikipedia
gutenberg
open-data
colab
kaggle
slm
nano-model
lightweight
edge-ai
on-device
cpu
offline
local-ai
base-model
pretraining
language-modeling
nlp
llama-architecture
rope
swiglu
rmsnorm
custom-tokenizer
byte-level-bpe
reranking
sentence-acceptability
fluency-scoring
grammar-checking
education
research
cc-by-sa-data
text-generation-inference
Model card Files
xet
 Community
Viveka-34M / tokenizer.json

Commit History

Yesterday

  1. Viveka v3: IAM-free retrain, now CC BY-SA 4.0 (perplexity 176.9 -> 137.3)

    vrishv
    Verified signature
    d5bafc2

13 days ago

  1. Viveka v2: better sentence judge; CC BY-NC 4.0 (first stage used IAM texts); new card

    vrishv
    Verified signature
    119b9c0

  2. Retrained from scratch without IAM; MIT licence; new card

    vrishv
    Verified signature
    5d1702b

17 days ago

  1. Viveka-34M: small English sentence-scoring model trained from scratch

    vrishv
    Verified signature
    4fea3cd