#
Available DLCs on Google Cloud

Below you can find a listing of all the Deep Learning Containers (DLCs) available on Google Cloud.

> The listing below only contains the latest version of each one of the Hugging Face DLCs, the full listing of the available published containers in Google Cloud can be found either in the Google Cloud Deep Learning Containers Documentation, in the Google Cloud Artifact Registry or via the `gcloud container images list --repository="us-docker.pkg.dev/deeplearning-platform-release/gcr.io" | grep "huggingface-"` command.

##
Text Generation Inference (TGI)

Container URI | Path | Accelerator
--- | --- | ---
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-text-generation-inference-cu124.2-4.ubuntu2204.py311 | text-generation-inference-gpu.2.4.0 | GPU

##
Text Embeddings Inference (TEI)

Container URI | Path | Accelerator
--- | --- | ---
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-text-embeddings-inference-cu122.1-6.ubuntu2204 | text-embeddings-inference-gpu.1.6.0 | GPU
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-text-embeddings-inference-cpu.1-6 | text-embeddings-inference-cpu.1.6.0 | CPU

##
PyTorch Inference

Container URI | Path | Accelerator
--- | --- | ---
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-pytorch-inference-cu121.2-3.transformers.4-48.ubuntu2204.py311 | huggingface-pytorch-inference-gpu.2.3.1.transformers.4.48.0.py311 | GPU
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-pytorch-inference-cpu.2-3.transformers.4-48.ubuntu2204.py311 | huggingface-pytorch-inference-cpu.2.3.1.transformers.4.48.0.py311 | CPU

##
PyTorch Training

Container URI | Path | Accelerator
--- | --- | ---
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-pytorch-training-cu121.2-3.transformers.4-48.ubuntu2204.py311 | huggingface-pytorch-training-gpu.2.3.1.transformers.4.48.0.py311 | GPU

Update on GitHub