Spaces:

yusufs
/

llama32-3b-instruct

Paused

App Files Files Community

llama32-3b-instruct

495 kB

Ctrl+K

Ctrl+K

1 contributor

History: 131 commits

yusufs's picture

fix(triton): downgrade to 3.2

564baa2 12 months ago

.gitignore

19 Bytes
feat(download_model.py): remove download_model.py during build, it causing big image size over 1 year ago
Dockerfile

18.8 kB
fix(triton): downgrade to 3.2 12 months ago
README.md

1.74 kB
feat(llama32-3b-instruct): change llama32-3b-instruct over 1 year ago
download_model.py

700 Bytes
feat(add-model): always download model during build, it will be cached in the consecutive builds over 1 year ago
main.py

6.7 kB
feat(parse): parse output over 1 year ago
openai_compatible_api_server.py

24.4 kB
feat(dep_sizes.txt): removes dep_sizes.txt during build, it not needed over 1 year ago
poetry.lock

426 kB
feat(refactor): move the files to root over 1 year ago
pyproject.toml

416 Bytes
feat(refactor): move the files to root over 1 year ago
requirements.txt

9.99 kB
feat(first-commit): follow examples and tutorials over 1 year ago
run-llama.sh

1.51 kB
fix(runner.sh): --enforce-eager not support values over 1 year ago
run-sailor.sh

1.83 kB
fix(runner.sh): --enforce-eager not support values over 1 year ago
runner.sh

2.46 kB
fix(float16): Bfloat16 is only supported on GPUs with compute capability of at least 8.0. Your Tesla T4 GPU has compute capability 7.5. You can use float16 instead by explicitly setting the`dtype` flag in CLI, for example: --dtype=half. over 1 year ago