| model_info: | |
| name: anemll-5a149550068a1eb93398160d8953f5f56c3603e9-ctx2048 | |
| version: 0.3.0 | |
| description: | | |
| Demonstarates running 5a149550068a1eb93398160d8953f5f56c3603e9 on Apple Neural Engine | |
| Context length: 2048 | |
| Batch size: 64 | |
| Chunks: 2 | |
| license: MIT | |
| author: Anemll | |
| framework: Core ML | |
| language: Python | |
| parameters: | |
| context_length: 2048 | |
| batch_size: 64 | |
| lut_embeddings: 8 | |
| lut_ffn: 4 | |
| lut_lmhead: 6 | |
| num_chunks: 2 | |
| model_prefix: phi4 | |
| embeddings: phi4_embeddings_lut8.mlmodelc | |
| lm_head: phi4_lm_head_lut6.mlmodelc | |
| ffn: phi4_FFN_PF_lut4.mlmodelc | |
| split_lm_head: 1 | |