xiaohei/model_garden
1
0
Fork 0
mirror of https://github.com/GoogleCloudPlatform/vertex-ai-samples.git synced 2026-09-26 14:42:04 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update axolotl notebook with latest successful configs.

Browse Source 
PiperOrigin-RevId: 764071402
This commit is contained in:
Vertex MG Team
2025-05-27 20:51:00 -07:00
committed by Copybara-Service
parent 655634c236
commit fcbb01480b
1 changed files with 12 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
notebooks/community/model_garden/model_garden_axolotl_finetuning.ipynb
+12 -4
View File
@@ -367,34 +367,42 @@
"# @markdown | falcon | tiiuae/falcon-7b | examples/falcon/config-7b-lora.yml |\n",
"# @markdown | falcon | tiiuae/falcon-7b | examples/falcon/config-7b.yml |\n",
"# @markdown | gemma | google/gemma-7b | examples/gemma/qlora.yml |\n",
"# @markdown | gemma2 | google/gemma-7b | examples/gemma2/qlora.yml |\n",
"# @markdown | gemma3 | google/gemma-3-1b-it | examples/gemma3/gemma-3-1b-qlora.yml |\n",
"# @markdown | gemma3 | google/gemma-3-4b-it | examples/gemma3/gemma-3-4b-qlora.yml |\n",
"# @markdown | llama-2 | NousResearch/Llama-2-7b-hf | examples/llama-2/fft_optimized.yml |\n",
"# @markdown | llama-2 | NousResearch/Llama-2-7b-hf | examples/llama-2/loftq.yml |\n",
"# @markdown | llama-2 | NousResearch/Llama-2-7b-hf | examples/llama-2/lora.yml |\n",
"# @markdown | llama-2 | NousResearch/Llama-2-7b-hf | examples/llama-2/qlora-fsdp.yml |\n",
"# @markdown | llama-2 | NousResearch/Llama-2-7b-hf | examples/llama-2/qlora.yml |\n",
"# @markdown | llama-3 | hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16 | examples/llama-3/qlora-fsdp-405b.yaml |\n",
"# @markdown | llama-3 | NousResearch/Llama-3.2-1B | examples/llama-3/lora-1b-kernels.yml |\n",
"# @markdown | llama-3 | NousResearch/Meta-Llama-3.1-8B | examples/llama-3/fft-8b.yaml |\n",
"# @markdown | llama-3 | NousResearch/Meta-Llama-3-8B-Instruct | examples/llama-3/instruct-lora-8b.yml |\n",
"# @markdown | llama-3 | NousResearch/Meta-Llama-3-8B | examples/llama-3/lora-8b.yml |\n",
"# @markdown | llama-3 | NousResearch/Llama-3.2-1B | examples/llama-3/qlora-1b.yml |\n",
"# @markdown | llama-3 | NousResearch/Llama-3.2-1B | examples/llama-3/lora-1b.yml |\n",
"# @markdown | llama-3 | casperhansen/llama-3-70b-fp16 | examples/llama-3/qlora-fsdp-70b.yaml |\n",
"# @markdown | llama-3 | meta-llama/Llama-3.2-1B | examples/llama-3/lora-1b-deduplicate-dpo.yml |\n",
"# @markdown | llama-3 | meta-llama/Llama-3.2-1B | examples/llama-3/lora-1b-deduplicate-sft.yml |\n",
"# @markdown | llama-3 | meta-llama/Llama-3.2-1B | examples/llama-3/lora-1b-sample-packing-sequentially.yml |\n",
"# @markdown | mistral | mistralai/Mistral-7B-v0.1 | examples/mistral/config.yml |\n",
"# @markdown | mistral | mistralai/Mistral-7B-v0.1 | examples/mistral/lora-mps.yml |\n",
"# @markdown | mistral | mistralai/Mistral-7B-v0.1 | examples/mistral/lora.yml |\n",
"# @markdown | mistral | mistralai/Mistral-7B-v0.1 | examples/mistral/mistral-qlora-orpo.yml |\n",
"# @markdown | mistral | mistralai/Mistral-7B-Instruct-v0.2 | examples/mistral/mistral-dpo-qlora.yml |\n",
"# @markdown | mistral | mistral-community/Mixtral-8x22B-v0.1 | examples/mistral/mixtral-8x22b-qlora-fsdp.yml |\n",
"# @markdown | mistral | mistralai/Mixtral-8x7B-v0.1 | examples/mistral/mixtral.yml |\n",
"# @markdown | mistral | mistralai/Mixtral-8x7B-v0.1 | examples/mistral/mixtral-qlora-fsdp.yml |\n",
"# @markdown | mistral | mistralai/Mistral-7B-v0.1 | examples/mistral/qlora.yml |\n",
"# @markdown | openllama-3b | openlm-research/open_llama_3b_v2 | examples/openllama-3b/config.yml |\n",
"# @markdown | openllama-3b | openlm-research/open_llama_3b_v2 | examples/openllama-3b/lora.yml |\n",
"# @markdown | openllama-3b | openlm-research/open_llama_3b_v2 | examples/openllama-3b/qlora.yml |\n",
"# @markdown | phi | microsoft/Phi-3.5-mini-instruct | examples/phi/lora-3.5.yaml |\n",
"# @markdown | phi | microsoft/phi-1_5 | examples/phi/phi-ft.yml |\n",
"# @markdown | phi | microsoft/phi-1_5 | examples/phi/phi-qlora.yml |\n",
"# @markdown | phi | microsoft/phi-2 | examples/phi/phi2-ft.yml |\n",
"# @markdown | phi | microsoft/Phi-3-mini-4k-instruct | examples/phi/phi3-ft.yml |\n",
"# @markdown | qwen | Qwen/Qwen1.5-MoE-A2.7B | examples/qwen/qwen2-moe-lora.yaml |\n",
"# @markdown | qwen | Qwen/Qwen1.5-MoE-A2.7B | examples/qwen/qwen2-moe-qlora.yaml |\n",
"# @markdown | qwen2 | Qwen/Qwen2.5-0.5B | examples/qwen2/dpo.yaml |\n",
"# @markdown | qwen2 | Qwen/Qwen2.5-3B | examples/qwen2/prm.yaml |\n",
"# @markdown | qwen2 | Qwen/Qwen2-7B | examples/qwen2/qlora-fsdp.yaml |\n",
"# @markdown | qwen3 | Qwen/Qwen3-8B | examples/qwen3/qlora-fsdp.yaml |\n",
"# @markdown | qwen3 | Qwen/Qwen3-32B | examples/qwen3/32b-qlora.yaml |\n",