Instructions to use jetson-models/internlm2-1_8b-4-bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jetson-models/internlm2-1_8b-4-bit with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="jetson-models/internlm2-1_8b-4-bit", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("jetson-models/internlm2-1_8b-4-bit", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 746bde35865e26874e04f0fd6a6da154e542f9bfc8e689fe2bf7c05b2604453b
- Size of remote file:
- 4.1 MB
- SHA256:
- 7bf0f5adb1241746df502c33bfdcc3743ebb4d4d5311fcb8e0a89353b0dddb9a
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.