Spaces:

Alovestocode
/

ZeroGPU-LLM-Inference

Sleeping

App Files Files Community

ZeroGPU-LLM-Inference

135 kB

Ctrl+K

Ctrl+K

1 contributor

History: 56 commits

Alikestocode's picture

Fix cell 7: convert markdown note to Python comment

4001f22 6 months ago

.dockerignore

104 Bytes
Add Google Cloud Platform deployment configurations 6 months ago
.gitattributes

1.52 kB
Initial commit: ZeroGPU LLM Inference Space 6 months ago
.gitignore

27 Bytes
Add .gitignore and remove cache files 6 months ago
DEPLOYMENT_STATUS.md

2.21 kB
Add deployment status document after re-authentication 6 months ago
Dockerfile

1.02 kB
Fix delete_revisions import with fallback cache cleanup 6 months ago
FIX_PERMISSIONS.md

2.05 kB
Add permission fix guide for spherical-gate-477614-q7 project 6 months ago
LLM_COMPRESSOR_FEATURES.md

6.24 kB
Fix AWQModifier import path: use modifiers.awq instead of modifiers.quantization 6 months ago
MANUAL_DEPLOY.md

1.59 kB
Fix delete_revisions import with fallback cache cleanup 6 months ago
QUANTIZE_AWQ.md

3.21 kB
Fix AWQModifier import path: use modifiers.awq instead of modifiers.quantization 6 months ago
README.md

4.23 kB
Implement vLLM with LLM Compressor and performance optimizations 6 months ago
app.py

40.7 kB
Fix AWQModifier import path: use modifiers.awq instead of modifiers.quantization 6 months ago
apt.txt

11 Bytes
Initial commit: ZeroGPU LLM Inference Space 6 months ago
cloudbuild.yaml

1.36 kB
Add Cloud Build deployment script and permission setup helper 6 months ago
deploy-cloud-build.sh

3.31 kB
Add Cloud Build deployment script and permission setup helper 6 months ago
deploy-compute-engine.sh

4.23 kB
Add Google Cloud Platform deployment configurations 6 months ago
deploy-gcp.sh

2.67 kB
Add Google Cloud Platform deployment configurations 6 months ago
gcp-deployment.md

5.32 kB
Add Google Cloud Platform deployment configurations 6 months ago
quantize_to_awq_colab.ipynb

29.1 kB
Fix cell 7: convert markdown note to Python comment 6 months ago
requirements.txt

397 Bytes
Clarify LLM Compressor optional status - vLLM has native AWQ support 6 months ago
setup-gcp-permissions.sh

1.8 kB
Add Cloud Build deployment script and permission setup helper 6 months ago
style.css

2.84 kB
Initial commit: ZeroGPU LLM Inference Space 6 months ago
test_api.py

3.43 kB
Migrate to AWQ quantization with FlashAttention-2 6 months ago
test_api_gradio_client.py

7.2 kB
Implement vLLM with LLM Compressor and performance optimizations 6 months ago
test_quantization_notebook.py

9.11 kB
Add local test script for quantization notebook validation 6 months ago
test_space_simple.sh

1.68 kB
Fix delete_revisions import with fallback cache cleanup 6 months ago