Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
rtferraz
/
domainTokenizer
like
0
arxiv:
9 papers
Model card
Files
Files and versions
xet
Community
main
domainTokenizer
/
src
/
domain_tokenizer
/
training
Ctrl+K
Ctrl+K
1 contributor
History:
6 commits
rtferraz
Update training init with finetune exports
64d55e2
verified
8 days ago
__init__.py
Safe
520 Bytes
Update training init with finetune exports
8 days ago
data_pipeline.py
Safe
3.65 kB
Add data_pipeline.py — tokenize_user_sequences, pack_sequences, prepare_clm_dataset
8 days ago
finetune.py
Safe
3.35 kB
Add finetune.py — finetune_domain_model (HF Trainer Pattern A, auto tabular_features passthrough)
8 days ago
finetune_data.py
Safe
3.45 kB
Phase 2D: Fine-tuning pipeline — DomainFinetuneDataset, finetune_domain_model, 139 total tests passing
8 days ago
pretrain.py
Safe
4.62 kB
Add pretrain.py — pretrain_domain_model with HF Trainer, cosine schedule, DataCollatorForLanguageModeling
8 days ago
