Instructions to use OpenTransformer/AGILLM4.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OpenTransformer/AGILLM4.1 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("OpenTransformer/AGILLM4.1", dtype="auto") - Notebooks
- Google Colab
- Kaggle
| param( | |
| [string]$CoordinatorUrl = $env:AGILLM41_COORDINATOR_URL, | |
| [string]$JoinCode = $env:AGILLM41_JOIN_CODE, | |
| [string]$Device = "cpu", | |
| [int]$Threads = [Math]::Max(1, [Environment]::ProcessorCount / 2) | |
| ) | |
| if (-not $CoordinatorUrl) { | |
| throw "Set AGILLM41_COORDINATOR_URL or pass -CoordinatorUrl" | |
| } | |
| python public_join/agillm41_join_worker.py ` | |
| --coordinator-url $CoordinatorUrl ` | |
| --join-code $JoinCode ` | |
| --device $Device ` | |
| --threads $Threads ` | |
| --loop | |