IDEA-Research

/

grounding-dino-tiny

like 101

Follow

IDEA-Research 212

I am trying to the model on my local machine, but for some reason the code gets stuck on the pipeline
" object_detector = pipeline(model=detector_id, task="zero-shot-object-detection", device=device)"

def detect(
    image: Image.Image,
    labels: List[str],
    threshold: float = 0.3,
    detector_id: Optional[str] = None
) -> List[Dict[str, Any]]:
    """
    Use Grounding DINO to detect a set of labels in an image in a zero-shot fashion.
    """
   device = "cuda" if torch.cuda.is_available() else "cpu"

    detector_id = detector_id if detector_id is not None else "IDEA-Research/grounding-dino-tiny"
    object_detector = pipeline(model=detector_id, task="zero-shot-object-detection", device=device)
    labels = [label if label.endswith(".") else label+"." for label in labels]

    results = object_detector(image,  candidate_labels=labels, threshold=threshold)
    results = [DetectionResult.from_dict(result) for result in results]s]

    return results

any idea why? On colab it works.

I am using Windows