Convert weights to bf16; add max_position_embeddings
#3
by yueweng - opened
- Convert all 17 tensors from fp16 to bf16 using round-to-nearest-ties-to-even rounding.
- Add max_position_embeddings=262144 to config.json.
lightseek changed pull request status to merged