Instructions to use jetson-models/internlm2-7b-4-bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jetson-models/internlm2-7b-4-bit with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="jetson-models/internlm2-7b-4-bit", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("jetson-models/internlm2-7b-4-bit", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 24adc40c6034994d3a0dd39a28a6ad62ad37d9042b20e710a2896839a097da64
- Size of remote file:
- 223 kB
- SHA256:
- 8fc44f54b3305b543a174f7948f4a0b473f4fa08a2bd64e1ee34a19bd656e469
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.