Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

emrd95
/
nemo-gguf

Transformers
GGUF
English
mistral
text-generation-inference
unsloth
Model card Files Files and versions
xet
Community

Instructions to use emrd95/nemo-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use emrd95/nemo-gguf with Transformers:

    # Load model directly
    from transformers import AutoModel
    model = AutoModel.from_pretrained("emrd95/nemo-gguf", dtype="auto")
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps
  • Unsloth Studio new

    How to use emrd95/nemo-gguf with Unsloth Studio:

    Install Unsloth Studio (macOS, Linux, WSL)
    curl -fsSL https://unsloth.ai/install.sh | sh
    # Run unsloth studio
    unsloth studio -H 0.0.0.0 -p 8888
    # Then open http://localhost:8888 in your browser
    # Search for emrd95/nemo-gguf to start chatting
    Install Unsloth Studio (Windows)
    irm https://unsloth.ai/install.ps1 | iex
    # Run unsloth studio
    unsloth studio -H 0.0.0.0 -p 8888
    # Then open http://localhost:8888 in your browser
    # Search for emrd95/nemo-gguf to start chatting
    Using HuggingFace Spaces for Unsloth
    # No setup required
    # Open https://huggingface.co/spaces/unsloth/studio in your browser
    # Search for emrd95/nemo-gguf to start chatting
    Load model with FastModel
    pip install unsloth
    from unsloth import FastModel
    model, tokenizer = FastModel.from_pretrained(
        model_name="emrd95/nemo-gguf",
        max_seq_length=2048,
    )
nemo-gguf
Ctrl+K
Ctrl+K
  • 1 contributor
History: 9 commits
emrd95's picture
emrd95
(Trained with Unsloth)
039f428 verified over 1 year ago
  • .gitattributes
    1.68 kB
    (Trained with Unsloth) over 1 year ago
  • Modelfile
    351 Bytes
    (Trained with Unsloth) over 1 year ago
  • README.md
    610 Bytes
    Upload README.md with huggingface_hub over 1 year ago
  • config.json
    31 Bytes
    (Trained with Unsloth) over 1 year ago
  • unsloth.F16.gguf
    24.5 GB
    xet
    (Trained with Unsloth) over 1 year ago
  • unsloth.Q4_K_M.gguf
    7.48 GB
    xet
    (Trained with Unsloth) over 1 year ago
  • unsloth.Q8_0.gguf
    13 GB
    xet
    (Trained with Unsloth) over 1 year ago