Instructions to use jetson-models/internlm2-7b-4-bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jetson-models/internlm2-7b-4-bit with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="jetson-models/internlm2-7b-4-bit", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("jetson-models/internlm2-7b-4-bit", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 131 Bytes
41620cb | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:196f168b3c2ac3a340d787a09908b78fa6d8702237ab190adb51314d55301161
size 223622
|