Inferencing on GPU cluster.
#3
by
RanjuBiswas
- opened
Hi, i have tried to infer this weight on GPU cluster. But the pipeline only works with single GPU. How to use full potential of multiple GPU for inferencing? I tried device map.it does not work.