BentoUniAcc's picture
drop llama-cpp-python (unbuildable on Spaces); explain MiMo-over-Gemma choice
0e69d49 verified
Raw
History Blame Contribute Delete
2.08 kB
# torch is deliberately NOT pinned or listed.
#
# On ZeroGPU the CUDA build must match the platform's driver, and the Space image already provides
# a matching one; asking pip for a different torch - in particular the cpu-only wheel that keeps a
# non-GPU Space small - is the usual way a Space that works in a notebook fails on hardware.
#
# gradio is absent for the same class of reason: the Space installs the version pinned as
# `sdk_version` in README.md, and listing it here as well is how the two end up disagreeing.
# Leaving it unpinned in both places is what broke the first deploy - HF fell back to a gradio 3.x
# default with no `show_copy_button`.
#
# llama-cpp-python is deliberately ABSENT, and the CPU runtime in `mimo.py` is therefore dormant
# on this Space. Both ways of installing it were tried and both fail here:
#
# 1. abetlen's prebuilt wheel index. Those wheels are tagged plain `linux_x86_64` rather than
# `manylinux`, and they are linked against musl. pip installs one happily and then every
# import dies with `libc.musl-x86_64.so.1: cannot open shared object file`, because a Space
# runs on glibc.
# 2. the PyPI sdist, which is the only other option since PyPI publishes no binary wheel at all.
# Compiling llama.cpp from source exceeded the Space build limit outright: `Job timeout`.
#
# The code path stays in `mimo.py` so the app still runs on a machine that does have a working
# llama.cpp, but nothing here installs one. On this Space the GPU path is the only runtime, which
# is also the one that reproduces Part B exactly - so the loss is a fallback, not a capability.
spaces # the @spaces.GPU decorator; ZeroGPU refuses to serve a Space without one
transformers>=4.45
accelerate # device_map for the 4-bit load
bitsandbytes # the NF4 quantisation Part B measured
sentencepiece
einops # nomic-embed-v1.5's remote code imports it
sentence-transformers>=3.0
huggingface_hub>=0.23
numpy
pandas
pyarrow # read the Part A embedding index