xiaohei/model_garden
1
0
Fork 0
mirror of https://github.com/GoogleCloudPlatform/vertex-ai-samples.git synced 2026-09-26 14:42:04 +00:00
Code Issues Packages Projects Releases Wiki Activity

minor updates for peft notebooks with BERT supports (#2089)

Browse Source 
* fix typos in keras model deployment

* minor updates for peft notebooks with BERT supports
This commit is contained in:
genquan9
2023-07-14 18:05:45 +00:00
committed by GitHub
parent d963893088
commit b945549ec4
1 changed files with 7 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
notebooks/community/model_garden/model_garden_pytorch_peft.ipynb
+7 -6
View File
@@ -60,7 +60,7 @@
"source": [
"## Overview\n",
"\n",
"This notebook demonstrates finetuning models with performance efficient finetuning libaries ([PEFT](https://github.com/huggingface/peft)), and running inferences with containers in Vertex AI. There are various models supported in [PEFT](https://github.com/huggingface/peft). This notebook shows examples with some models, such as OpenLLaMA, Falcon-instruct, RoBERTa-large, and XLM-RoBERTa-large, etc.\n",
"This notebook demonstrates finetuning models with performance efficient finetuning libaries ([PEFT](https://github.com/huggingface/peft)), and running inferences with containers in Vertex AI. There are various models supported in [PEFT](https://github.com/huggingface/peft). This notebook shows examples with some models, such as OpenLLaMA, Falcon-instruct, BERT, RoBERTa-large, and XLM-RoBERTa-large, etc.\n",
"\n",
"### Objective\n",
"\n",
@@ -84,6 +84,7 @@
"\n",
"| Models | LoRA |\n",
"| :- | :- |\n",
"| [bert-base-uncase](https://huggingface.co/bert-base-uncased) | Y |\n",
"| [RoBERTa-large](https://huggingface.co/roberta-large) | Y |\n",
"| [XLM-RoBERTa-large](https://huggingface.co/xlm-roberta-large) | Y |\n",
"\n",
@@ -320,7 +321,7 @@
"id": "e70e3519ff8b"
},
"source": [
"## OpenLLaMA + PEFT\n",
"## Casual Language Modeling + PEFT\n",
"\n",
"This section demonstrates how to finetune OpenLLaMA with PEFT LoRA, including [openlm-research/open_llama_3b](https://huggingface.co/openlm-research/open_llama_3b), [openlm-research/open_llama_7b](https://huggingface.co/openlm-research/open_llama_7b), and [openlm-research/open_llama_13b](https://huggingface.co/openlm-research/open_llama_13b)."
]
@@ -517,7 +518,7 @@
"id": "W2USaHtQbE-l"
},
"source": [
"## Falcon-instruct + PEFT\n",
"## Instruct + PEFT\n",
"\n",
"This section demonstrates how to finetune Falcon-instruct with PEFT LoRA, including [tiiuae/falcon-7b-instruct](https://huggingface.co/tiiuae/falcon-7b-instruct), and [tiiuae/falcon-40b-instruct](https://huggingface.co/tiiuae/falcon-40b-instruct)."
]
@@ -738,9 +739,9 @@
"id": "og_s64QVmJDb"
},
"source": [
"## RoBERTa-large/XLM-RoBERTa-large + PEFT\n",
"## Sequence Classification + PEFT\n",
"\n",
"This section demonstrates how to finetune sequence classification models with PEFT LoRA, including [RoBERTa-large](https://huggingface.co/roberta-large), and [XLM-RoBERTa-large](https://huggingface.co/xlm-roberta-large)."
"This section demonstrates how to finetune sequence classification models with PEFT LoRA, including [bert-base-uncased](https://huggingface.co/bert-base-uncased), [RoBERTa-large](https://huggingface.co/roberta-large), and [XLM-RoBERTa-large](https://huggingface.co/xlm-roberta-large)."
]
},
{
@@ -769,7 +770,7 @@
},
"outputs": [],
"source": [
"base_model_id = \"xlm-roberta-large\" # @param [\"roberta-large\", \"xlm-roberta-large\"]"
"base_model_id = \"xlm-roberta-large\" # @param [\"bert-base-uncased\", \"roberta-large\", \"xlm-roberta-large\"]"
]
},
{