Daggr 3d
š
4
Not Lain PRO
not-lain
AI & ML interests
custom AI models with HF integration, HuggingFace fellow š¤
Recent Activity
liked
a Space
about 17 hours ago
abidlabs/daggr-3d
reacted
to
alvarobartt's
post
with š
2 days ago
š„ `hf-mem` v0.4.1 now also estimates KV cache memory requirements for any context length and batch size with the `--experimental` flag!
`uvx hf-mem --model-id ... --experimental` will automatically pull the required information from the Hugging Face Hub to include the KV cache estimation, when applicable.
š” Alternatively, you can also set the `--max-model-len`, `--batch-size` and `--kv-cache-dtype` arguments (Ć la vLLM) manually if preferred.
reacted
to
alvarobartt's
post
with š„
2 days ago
š„ `hf-mem` v0.4.1 now also estimates KV cache memory requirements for any context length and batch size with the `--experimental` flag!
`uvx hf-mem --model-id ... --experimental` will automatically pull the required information from the Hugging Face Hub to include the KV cache estimation, when applicable.
š” Alternatively, you can also set the `--max-model-len`, `--batch-size` and `--kv-cache-dtype` arguments (Ć la vLLM) manually if preferred.
Organizations
liked
a
Space
about 17 hours ago
liked
a
model
2 days ago
liked
2
Spaces
4 days ago
liked
a
Space
about 2 months ago
liked
3
models
2 months ago
liked
a
Space
2 months ago
liked
a
model
2 months ago
liked
4
models
3 months ago
liked
2
Spaces
3 months ago
liked
2
models
3 months ago
liked
2
models
4 months ago
