Add CPU inference script, update README with model details and perf stats

Update gitignore to allow .pt files

Initial upload: base + distill checkpoints, model code, train_shim.py