google-cloud/pr_162/en/containers/available.md

Available DLCs on Google Cloud

Below you can find a listing of all the Deep Learning Containers (DLCs) available on Google Cloud.

The listing below only contains the latest version of each one of the Hugging Face DLCs, the full listing of the available published containers in Google Cloud can be found either in the Google Cloud Deep Learning Containers Documentation, in the Google Cloud Artifact Registry or via the gcloud container images list --repository="us-docker.pkg.dev/deeplearning-platform-release/gcr.io" | grep "huggingface-" command.

Text Generation Inference (TGI)

Container URI	Path	Accelerator
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-text-generation-inference-cu124.2-4.ubuntu2204.py311	text-generation-inference-gpu.2.4.0	GPU

Text Embeddings Inference (TEI)

Container URI	Path	Accelerator
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-text-embeddings-inference-cu122.1-6.ubuntu2204	text-embeddings-inference-gpu.1.6.0	GPU
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-text-embeddings-inference-cpu.1-6	text-embeddings-inference-cpu.1.6.0	CPU

PyTorch Inference

Container URI	Path	Accelerator
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-pytorch-inference-cu121.2-3.transformers.4-48.ubuntu2204.py311	huggingface-pytorch-inference-gpu.2.3.1.transformers.4.48.0.py311	GPU
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-pytorch-inference-cpu.2-3.transformers.4-48.ubuntu2204.py311	huggingface-pytorch-inference-cpu.2.3.1.transformers.4.48.0.py311	CPU

PyTorch Training

Container URI	Path	Accelerator
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-pytorch-training-cu121.2-3.transformers.4-48.ubuntu2204.py311	huggingface-pytorch-training-gpu.2.3.1.transformers.4.48.0.py311	GPU