README.md

metadata

library_name: aneforge
license: mit
base_model: openai-community/gpt2
pipeline_tag: text-generation
tags:
  - aneforge
  - apple-neural-engine

GPT-2 (ANEForge)

An unmodified duplicate of openai-community/gpt2, tagged for use with ANEForge so the weights load and run directly on the Apple Neural Engine (no CoreML). Weights are byte-identical to the source; see the original repo for the model details. Licensed mit from the source.

Use with ANEForge

import aneforge as af

model = af.load_gpt2("aneforge/gpt2")
print(model.generate_text("The Apple Neural Engine is", max_new_tokens=20))

ANEForge compiles the model's graph into a single ANE program and streams the weights from this repo via huggingface_hub. See the docs and the paper.