NeuralHermes-11b / README.md
athirdpath's picture
Create README.md
f17e749
metadata
license: apache-2.0

A 11b Mistral model, based on the NeverSleep recipe.

Recipe

slices

  • sources:

    • model: Intel/neural-chat-7b-v3-1
    • layer_range: [0, 24]
  • sources:

    • model: teknium/OpenHermes-2.5-Mistral-7B
    • layer_range: [8, 32]

merge_method: passthrough

dtype: bfloat16