EdgeRock / runtime /model /fixed_memory.py
rockmatrix-ai's picture
Use BF16 inference and align figures and results with the technical report
799fa1f verified
Raw History Blame Contribute Delete
106 Bytes
from modeling_edgerock import *
from modeling_edgerock import _linear_cache_tensor, _batch_scatter_state_