44 Pull requests merged by 7 people

• feat: Add sample for Vertex distributed training

  #4163 merged Jul 23, 2025

• Add Qwen3-235B-A22B-Instruct-2507 models to Qwen3 deployment notebook.

  #4172 merged Jul 23, 2025

• Wan Deployment Notebook

  #4166 merged Jul 23, 2025

• Update ray_cluster_management.ipynb

  #4171 merged Jul 22, 2025

• dedicated endpoints enabled

  #4168 merged Jul 22, 2025

• Update the hf-pytorch-inference notebook using the newly built in-house container hf-inference-toolkit.

  #4169 merged Jul 21, 2025

• Updates to Flux.1 Schnell and CogVideoX-2b notebook

  #4165 merged Jul 21, 2025

• Update auto-scaling documentation link in Model Garden notebooks.

  #4167 merged Jul 21, 2025

• Update SGLang version in Qwen3 deployment notebook.

  #4164 merged Jul 18, 2025

• Update OpenCLIP and BiomedCLIP serving container URI

  #4154 merged Jul 18, 2025

• Fix Gemma3 vllm deployment for 1b model

  #4161 merged Jul 18, 2025

• Refactoring the notebook

  #4159 merged Jul 18, 2025

• Add DeepSeek-R1-Distill a4x-highgpu-4g GB200 sample notebook.

  #4160 merged Jul 17, 2025

• Refactor axolotl notebook.

  #4094 merged Jul 17, 2025

• Update nllb notebook to use new container that is FedRamp compliant.

  #4155 merged Jul 16, 2025

• Update owl-vit notebook to use new container that is FedRamp compliant.

  #4153 merged Jul 16, 2025

• Update notebook_template_review.py

  #4158 merged Jul 15, 2025

• clean up section is added at the end of the every deployment section

  #4145 merged Jul 15, 2025

• Refactoring the notebook

  #4157 merged Jul 15, 2025

• Add support for multiple regions in Hex Deployment

  #4156 merged Jul 15, 2025

• Migrate pytorch-inference docker from 0.1 to 0.4 in notebooks

  #4152 merged Jul 14, 2025

• Migrate Blip and Blip2 notebooks to use the pytorch-inference container

  #4150 merged Jul 14, 2025

• Update SAM notebook to use new container that is FedRamp compliant.

  #4151 merged Jul 13, 2025

• In Hugging Face TEI notebook, add example to download hf model artifacts and upload to gcs.

  #4149 merged Jul 11, 2025

• Upgrade google-cloud-aiplatform to 1.103.0

  #4147 merged Jul 11, 2025

• Add link to timesfm serving docker source code.

  #4146 merged Jul 10, 2025

• delete mediapipe training container source codes and notebooks.

  #4144 merged Jul 10, 2025

• TimesFM 2.0 notebook demonstrating how to

  #4143 merged Jul 10, 2025

• request timeout set to 30 minutes

  #4137 merged Jul 10, 2025

• Remove TIMM notebook

  #4142 merged Jul 9, 2025

• Create T5Gemma local inference notebook

  #4141 merged Jul 9, 2025

• update the training docker image

  #4140 merged Jul 9, 2025

• Update notebook_template_review.py

  #4138 merged Jul 7, 2025

• delete eval and train job if the job was triggered

  #4135 merged Jul 4, 2025

• Update vLLM container version in QwQ deployment notebook.

  #4134 merged Jul 2, 2025

• Remove JAX Keras TPU train related contents from Gemma finetuning notebook. This path has been deprecated.

  #4133 merged Jul 1, 2025

• marking opus 3 as deprecated

  #4132 merged Jul 1, 2025

• Update SGLang container URI in Gemma 3n deployment notebook.

  #4126 merged Jun 27, 2025

• global endpoint opus4

  #4128 merged Jun 27, 2025

• chore(deps): update dependency pyupgrade to v3.20.0

  #4071 merged Jun 26, 2025

• Bump torch from 2.2.0 to 2.7.0 in /community-content/pytorch_image_classification_single_gpu_with_vertex_sdk_and_torchserve/trainer

  #4083 merged Jun 26, 2025

• Update dependency flake8 to v7.3.0

  #4117 merged Jun 26, 2025

• Add vLLM + TPU Llama 3.1 and Qwen3 deployment notebook.

  #4119 merged Jun 26, 2025

• Add Gemma 3n deployment notebook.

  #4125 merged Jun 26, 2025

9 Pull requests opened by 3 people

• Add SGLang build files.

  #4124 opened Jun 26, 2025

• add batch prediction

  #4127 opened Jun 27, 2025

• Publish timesfm serving docker code.

  #4129 opened Jun 27, 2025

• added notebooks and dockerfiles for serving open models on vertexai using vllm custom containers

  #4148 opened Jul 11, 2025

• Fix custom dataset input for axolotl notebooks.

  #4162 opened Jul 18, 2025

• Bump urllib3 from 2.0.7 to 2.5.0 in /community-content/vertex-distributed-training/a3mega/llama-3-8b-nemo-pretraining/docker

  #4173 opened Jul 23, 2025

• Bump requests from 2.32.3 to 2.32.4 in /community-content/vertex-distributed-training/a3mega/llama-3-8b-nemo-pretraining

  #4174 opened Jul 23, 2025

• Bump protobuf from 3.20.3 to 4.25.8 in /community-content/vertex-distributed-training/a3mega/llama-3-8b-nemo-pretraining/docker

  #4175 opened Jul 23, 2025

• Fix pad tokens for custom weights.

  #4176 opened Jul 25, 2025

2 Issues opened by 2 people

• mda@anowarr.com

  #4170 opened Jul 22, 2025

• S

  #4130 opened Jun 28, 2025

2 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Dependency Dashboard

  #2632 commented on Jun 26, 2025 • 0 new comments

• Cannot Finetune Gemma3-13b in model_garden_gemma3_finetuning_on_vertex.ipynb

  #4068 commented on Jun 28, 2025 • 0 new comments