Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

Spaces:
eldiablo92
/
GPU_memory_sizer_for_LLM_inference
Sleeping

App Files Files Community
Fetching metadata from the HF Docker repository...
GPU_memory_sizer_for_LLM_inference
376 kB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 57 commits
eldiablo92's picture
eldiablo92
Front modif
bac0396 15 days ago
  • .github
    fix: CD pipeline about 2 months ago
  • app
    feat(front): offloading front about 2 months ago
  • tests
    After ruff format about 2 months ago
  • ui
    Front modif 15 days ago
  • .dockerignore
    97 Bytes
    feat: makefile new commands + CD pipeline about 2 months ago
  • .gitattributes
    84 Bytes
    Init commit 11 months ago
  • .gitignore
    124 Bytes
    feat: makefile new commands + CD pipeline about 2 months ago
  • .python-version
    5 Bytes
    cleaning dependencies about 2 months ago
  • Dockerfile
    476 Bytes
    Preparing deployment : docker completed ready about 2 months ago
  • Makefile
    438 Bytes
    feat(kv-cache): add model weight reduction per quantization level and total about 2 months ago
  • README.md
    2.45 kB
    feat: makefile new commands + CD pipeline about 2 months ago
  • conftest.py
    126 Bytes
    After ruff format about 2 months ago
  • pyproject.toml
    646 Bytes
    feat: Add option to include model weights in max conctext compute + enhance front + fix when model do not fit + add models about 2 months ago
  • start.sh
    1.18 kB
    feat: optim uv --no-sync about 2 months ago
  • uv.lock
    329 kB
    feat: Add option to include model weights in max conctext compute + enhance front + fix when model do not fit + add models about 2 months ago