Piccolo
Collection
12 items β’ Updated
How to use agentscope-ai/Piccolo-27B with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-classification", model="agentscope-ai/Piccolo-27B") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM
processor = AutoProcessor.from_pretrained("agentscope-ai/Piccolo-27B")
model = AutoModelForMultimodalLM.from_pretrained("agentscope-ai/Piccolo-27B", device_map="auto")Piccolo-27B is a decision model for tool review and context selection. This repository contains the complete Safetensors checkpoint.
hf download agentscope-ai/Piccolo-27B --local-dir Piccolo-27B
Use the included reference implementation for bidirectional attention and candidate scoring.
python -m pip install -r Piccolo-27B/requirements.txt
python Piccolo-27B/piccolo_inference.py --model Piccolo-27B --request request.json --device cuda:0
Use the request example to prepare request.json.
Use Piccolo locally for tool review and context selection with the QwenPaw setup guide.
| HarnessJevBench Hard β | DataJevBench β | JevBench Public β | Decision Index Public β |
|---|---|---|---|
| 84.41% | 82.60% | 92.21% | 68.59 |
Benchmark results are for the full checkpoint.
This model is also available on ModelScope.