Instructions to use litert-community/InternVL3_5-2B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT-LM
How to use litert-community/InternVL3_5-2B with LiteRT-LM:
# LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM) # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter). # For platform-specific integration guides, please refer to the official developer website: # https://ai.google.dev/edge/litert-lm # To try LiteRT-LM, the easiest way is to use our CLI tool. # 1. Install the LiteRT-LM CLI tool: pip install -U litert-lm # 2. Download and run this model locally: # See: https://ai.google.dev/edge/litert-lm/cli litert-lm run \ --from-huggingface-repo=litert-community/InternVL3_5-2B \ --prompt="Write me a poem"
- LiteRT
How to use litert-community/InternVL3_5-2B with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Card: correct the start_token note — measured numbers do not carry over
Browse files
README.md
CHANGED
|
@@ -144,5 +144,5 @@ import `.litertlm` directly from Hugging Face), download `model.litertlm`, impor
|
|
| 144 |
|
| 145 |
The bundle's `LlmMetadata start_token` held the literal string `"None"`. This tokenizer has no BOS, and the LiteRT-LM engine resolved that string to a real vocabulary token — so every prompt began with the word `None`, which the model was never trained on. The start token has been removed.
|
| 146 |
|
| 147 |
-
**Metadata-only change**: every
|
| 148 |
|
|
|
|
| 144 |
|
| 145 |
The bundle's `LlmMetadata start_token` held the literal string `"None"`. This tokenizer has no BOS, and the LiteRT-LM engine resolved that string to a real vocabulary token — so every prompt began with the word `None`, which the model was never trained on. The start token has been removed.
|
| 146 |
|
| 147 |
+
**Metadata-only change**: every section of the bundle except the `LlmMetadata` block is byte-identical to the previous file (verified by sha256 per section), so the weights, the graph and the tokenizer are unchanged and the speed and memory numbers on this card still describe exactly this file — only the file's own sha256 differs. What changed is the input: the token stream the model reads for a given conversation can differ from the previous file's, and it now matches this model's own reference chat stream. Greedy decoding can turn on a single token, so an individual answer can differ from the previous file in either direction. Unless a row says otherwise, the accuracy figures on this card were measured on the previous file and have not been re-measured on this one. If you downloaded before 2026-08-28, re-download.
|
| 148 |
|