Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
13B-BlueMethod-GGML

Transformers
llama
alpaca
cot
vicuna
uncensored
Merge
mix
Model card Files Files and versions
xet
Community

Instructions to use TheBloke/13B-BlueMethod-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use TheBloke/13B-BlueMethod-GGML with Transformers:

    # Load model directly
    from transformers import AutoModel
    model = AutoModel.from_pretrained("TheBloke/13B-BlueMethod-GGML", dtype="auto")
  • Notebooks
  • Google Colab
  • Kaggle
13B-BlueMethod-GGML
92 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 16 commits
TheBloke's picture
TheBloke
Initial GGML model commit
5c8a47d almost 3 years ago
  • .gitattributes
    1.52 kB
    initial commit almost 3 years ago
  • 13b-bluemethod.ggmlv3.q2_K.bin
    5.51 GB
    xet
    Initial GGML model commit almost 3 years ago
  • 13b-bluemethod.ggmlv3.q3_K_L.bin
    6.93 GB
    xet
    Initial GGML model commit almost 3 years ago
  • 13b-bluemethod.ggmlv3.q3_K_M.bin
    6.31 GB
    xet
    Initial GGML model commit almost 3 years ago
  • 13b-bluemethod.ggmlv3.q3_K_S.bin
    5.66 GB
    xet
    Initial GGML model commit almost 3 years ago
  • 13b-bluemethod.ggmlv3.q4_0.bin
    7.32 GB
    xet
    Initial GGML model commit almost 3 years ago
  • 13b-bluemethod.ggmlv3.q4_1.bin
    8.14 GB
    xet
    Initial GGML model commit almost 3 years ago
  • 13b-bluemethod.ggmlv3.q4_K_M.bin
    7.87 GB
    xet
    Initial GGML model commit almost 3 years ago
  • 13b-bluemethod.ggmlv3.q4_K_S.bin
    7.37 GB
    xet
    Initial GGML model commit almost 3 years ago
  • 13b-bluemethod.ggmlv3.q5_0.bin
    8.95 GB
    xet
    Initial GGML model commit almost 3 years ago
  • 13b-bluemethod.ggmlv3.q5_1.bin
    9.76 GB
    xet
    Initial GGML model commit almost 3 years ago
  • 13b-bluemethod.ggmlv3.q5_K_M.bin
    9.23 GB
    xet
    Initial GGML model commit almost 3 years ago
  • 13b-bluemethod.ggmlv3.q5_K_S.bin
    8.97 GB
    xet
    Initial GGML model commit almost 3 years ago