Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

ayushg-20
/
ondevicellm-benchmark-converted-models

Core ML
ONNX
Safetensors
ExecuTorch
MLX
LiteRT
ondevicellm
on-device-llm
ios
onnxruntime-genai
Model card Files Files and versions
xet
Community

Instructions to use ayushg-20/ondevicellm-benchmark-converted-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • MLX

    How to use ayushg-20/ondevicellm-benchmark-converted-models with MLX:

    # Download the model from the Hub
    pip install huggingface_hub[hf_xet]
    
    huggingface-cli download --local-dir ondevicellm-benchmark-converted-models ayushg-20/ondevicellm-benchmark-converted-models
  • LiteRT

    How to use ayushg-20/ondevicellm-benchmark-converted-models with LiteRT:

    # No code snippets available yet for this library.
    
    # To use this model, check the repository files and the library's documentation.
    
    # Want to help? PRs adding snippets are welcome at:
    # https://github.com/huggingface/huggingface.js
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps Settings
  • LM Studio
ondevicellm-benchmark-converted-models
3.02 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 2 commits
ayushg-20's picture
ayushg-20
Add files using upload-large-folder tool
ee1a43a verified 11 days ago
  • Qwen3-0.6B-CoreML-LLM
    Add files using upload-large-folder tool 11 days ago
  • Qwen3-0.6B-coreml-int4.mlmodelc
    Add files using upload-large-folder tool 11 days ago
  • Qwen3.5-0.8B-onnx-cpu-int4
    Add files using upload-large-folder tool 11 days ago
  • SmolLM2-135M-MLX-8bit
    Add files using upload-large-folder tool 11 days ago
  • SmolLM2-135M-executorch-int8
    Add files using upload-large-folder tool 11 days ago
  • SmolLM2-135M-onnx-cpu-int8
    Add files using upload-large-folder tool 11 days ago
  • .gitattributes
    2 kB
    Add files using upload-large-folder tool 11 days ago
  • README.md
    1.92 kB
    Add files using upload-large-folder tool 11 days ago
  • SmolLM2-135M-litert-dynamic-wi8-afp32.litertlm
    143 MB
    xet
    Add files using upload-large-folder tool 11 days ago