Tabular Classification
Transformers
Safetensors
felatab
feature-extraction
fela
tabular
in-context-learning
prior-fitted-network
foundation-model
delta-rule
cpu
on-device
custom_code
Eval Results (legacy)
Instructions to use lowdown-labs/fela-tab with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use lowdown-labs/fela-tab with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("lowdown-labs/fela-tab", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Quickstart
Point FelaTab at a real public table and get zero shot predictions on CPU. Uses the self
contained loader and in context predict path in ../modeling.py.
Steps
Install the pinned requirements (CPU PyTorch + scikit-learn for the example datasets):
pip install -r requirements.txtRun. The model files ship in the parent directory, so the default
--weightspoints there:python run.py # small int8 tier, breast cancer classification python run.py --tier big # the 411.9M flagship python run.py --dataset wine --bag 8 # with inference time bagging
Load from Python
from modeling import load_model, predict, predict_bagged
# tier = "small" (dim512, ~51.6M) or "big" (dim1024, ~411.9M). The loader auto detects
# the int8 bundle and dequantizes it, so you always get a plain fp32 model.
model = load_model("/path/to/repo_dir", tier="small") # or a HF repo id, or a .safetensors path
# classification: Xtr/ytr are the support rows (your labelled examples), Xte the query rows
probs = predict(model, Xtr, ytr, Xte, task="classification", n_classes=3) # [n_query, 3]
# regression: returns (mean, std) error bars in the original label units
mean, std = predict(model, Xtr, ytr, Xte, task="regression")
# optional: inference time bagging lifts classification a little (no retraining)
probs = predict_bagged(model, Xtr, ytr, Xte, task="classification", n_classes=3, n_bag=16)
There is no per table training. The support rows and query rows are packed into one sequence and run through the model in a single forward pass; the query predictions come out calibrated. See the model card for the honest measured numbers, the regression caveat, and the intended use.