Google Cloud documentation
Available DLCs on Google Cloud
Available DLCs on Google Cloud
Below you can find a listing of all the Deep Learning Containers (DLCs) available on Google Cloud.
The listing below only contains the latest version of each one of the Hugging Face DLCs, the full listing of the available published containers in Google Cloud can be found either in the Google Cloud Deep Learning Containers Documentation, in the Google Cloud Artifact Registry or via the
gcloud container images list --repository="us-docker.pkg.dev/deeplearning-platform-release/gcr.io" | grep "huggingface-"command.
Text Generation Inference (TGI)
| Container URI | Path | Accelerator |
|---|---|---|
| us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-text-generation-inference-cu124.2-4.ubuntu2204.py311 | text-generation-inference-gpu.2.4.0 | GPU |
Text Embeddings Inference (TEI)
| Container URI | Path | Accelerator |
|---|---|---|
| us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-text-embeddings-inference-cu122.1-6.ubuntu2204 | text-embeddings-inference-gpu.1.6.0 | GPU |
| us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-text-embeddings-inference-cpu.1-6 | text-embeddings-inference-cpu.1.6.0 | CPU |
PyTorch Inference
| Container URI | Path | Accelerator |
|---|---|---|
| us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-pytorch-inference-cu121.2-3.transformers.4-48.ubuntu2204.py311 | huggingface-pytorch-inference-gpu.2.3.1.transformers.4.48.0.py311 | GPU |
| us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-pytorch-inference-cpu.2-3.transformers.4-48.ubuntu2204.py311 | huggingface-pytorch-inference-cpu.2.3.1.transformers.4.48.0.py311 | CPU |
PyTorch Training
| Container URI | Path | Accelerator |
|---|---|---|
| us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-pytorch-training-cu121.2-3.transformers.4-48.ubuntu2204.py311 | huggingface-pytorch-training-gpu.2.3.1.transformers.4.48.0.py311 | GPU |