xiaohei/model_garden
1
0
Fork 0
mirror of https://github.com/GoogleCloudPlatform/vertex-ai-samples.git synced 2026-09-26 14:42:04 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add qwen3 specific instruction to runtime creation.

Browse Source 
PiperOrigin-RevId: 758737197
This commit is contained in:
Vertex MG Team
2025-05-14 10:21:56 -07:00
committed by Copybara-Service
parent d53aa0c816
commit 4aafcfb40f
1 changed files with 6 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
notebooks/community/model_garden/model_garden_axolotl_finetuning.ipynb
+6 -4
View File
@@ -75,14 +75,16 @@
{
"cell_type": "markdown",
"metadata": {
"id": "K-YsE6oUoxjY"
"id": "Xq8JgAE4BQTj"
},
"source": [
"## [Optional] Setup Colab Runtime\n",
"**You need to setup the Colab Runtime with L4 GPU or A100 GPU if you want to run local finetuning. The following sections perform the setup for L4 GPU.**\n",
"To learn more about creating runtime, you can optionally read [this](https://cloud.google.com/colab/docs/create-runtime).\n",
"\n",
"**Note: make sure to create a runtime with appropriate machine type and gpu type to avoid out of memory issues. [Refer this](https://huggingface.co/spaces/hf-accelerate/model-memory-usage) to decide which machine type and gpu type to select.**"
"**Note: make sure to create a runtime with appropriate machine type and gpu type to avoid out of memory issues. [Refer this](https://huggingface.co/spaces/hf-accelerate/model-memory-usage) to decide which machine type and gpu type to select.**\n",
"\n",
"**Note: We recommend using a runtime environment configured with NVIDIA_TESLA_A100 with 4 GPUs or any other multi-GPU machine with higher GPU memory.**"
]
},
{
@@ -107,8 +109,8 @@
"RUNTIME_PROJECT_ID = os.environ[\"GOOGLE_CLOUD_PROJECT\"]\n",
"RUNTIME_REGION = os.environ[\"GOOGLE_CLOUD_REGION\"]\n",
"\n",
"RUNTIME_ACCELERATOR_TYPE = \"\" # @param [\"\", \"NVIDIA_L4\", \"NVIDIA_TESLA_A100\", \"NVIDIA_A100_80GB\"]\n",
"RUNTIME_ACCELERATOR_COUNT = \"1\" # @param [1, 2, 4, 8, 16]\n",
"RUNTIME_ACCELERATOR_TYPE = \"NVIDIA_TESLA_A100\" # @param [\"\", \"NVIDIA_L4\", \"NVIDIA_TESLA_A100\", \"NVIDIA_A100_80GB\"]\n",
"RUNTIME_ACCELERATOR_COUNT = \"4\" # @param [1, 2, 4, 8, 16]\n",
"RUNTIME_ACCELERATOR_COUNT = int(RUNTIME_ACCELERATOR_COUNT)\n",
"\n",
"if not RUNTIME_ACCELERATOR_TYPE:\n",