Instructions to use OpenTransformer/AGILLM4.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OpenTransformer/AGILLM4.1 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("OpenTransformer/AGILLM4.1", dtype="auto") - Notebooks
- Google Colab
- Kaggle
AGILLM4.1 Public Join Layer
This folder has two public network modes.
Join Scott's Network
Untrusted helpers should run only the outbound worker. It never opens SSH, never receives coordinator credentials, verifies every downloaded lease artifact by SHA-256, and submits results into quarantine on the coordinator.
python public_join/agillm41_join_worker.py \
--coordinator-url https://your-agillm41-domain.example \
--join-code "$AGILLM41_JOIN_CODE" \
--device cpu \
--threads 2 \
--loop
The coordinator decides whether a quarantined result is accepted. Public helper
updates must never be merged into master.pt without a separate validator.
Start Your Own Network
Run the coordinator on a machine that can prepare lease packages, preferably behind a real domain and TLS certificate:
python public_join/agillm41_network_host.py serve \
--host 0.0.0.0 \
--port 8787 \
--public-base-url https://your-agillm41-domain.example \
--tls-cert /etc/letsencrypt/live/your-agillm41-domain.example/fullchain.pem \
--tls-key /etc/letsencrypt/live/your-agillm41-domain.example/privkey.pem \
--join-code-file ./join_code.txt
Add an AGILLM4.1 side-worker lease:
python public_join/agillm41_network_host.py add-lease \
--package /path/to/lease_worker_block0_agillm4bench.pt \
--frozen /path/to/shared_frozen.pt \
--copy-artifacts \
--ttl-sec 900 \
--worker-arg device=cpu \
--worker-arg threads=2 \
--metadata network=agillm41-public \
--max-result-bytes 500000000
Security model:
- lease tokens are short-lived HMAC signatures bound to the package hash;
- public helpers can only download their lease package and submit one result;
- submitted results go to
quarantine/; - SSH and coordinator filesystem paths are not exposed to helpers;
- HTTPS is required for public binds unless
--allow-httpis used for local tests.
Local Test
Terminal 1:
printf "test-code" > join_code.txt
python public_join/agillm41_network_host.py serve \
--host 127.0.0.1 \
--port 8787 \
--public-base-url http://127.0.0.1:8787 \
--join-code-file join_code.txt
Terminal 2:
python public_join/agillm41_network_host.py add-lease \
--package /path/to/lease.pt \
--frozen /path/to/shared_frozen.pt
Terminal 3:
python public_join/agillm41_join_worker.py \
--coordinator-url http://127.0.0.1:8787 \
--join-code test-code \
--device cpu