Nitral-Archive
/

Pinecone-Rune-12b-Token-Surgery-Chatml

Model card Files Files and versions

Pinecone-Rune-12b-Token-Surgery-Chatml / README.md

Nitral-AI's picture

Update README.md

242d313 verified 5 months ago

|

history blame contribute delete

531 Bytes

metadata

license: other
language:
  - en
base_model:
  - Entropicengine/Pinecone-Rune-12b

Base model: Pinecone-Rune-12b

Donor model: Nitral-AI/Irixxed-Magcap-12B-0.1a

Arcees tokensurgery using (-v -k 64 --cosine-similarity --cuda --low-cpu-memory) on a colab l4 for brevity.

Example Notebook using l4: https://huggingface.co/Nitral-AI/Pinecone-Rune-12b-Token-Surgery-Chatml/tree/main/TokenSurgeon-Example