Compare commits

...
1 Commits
Author SHA1 Message Date
Andrew Ferlitsch 6b05f4749a update: post-Next 2023-09-18 20:06:50 +00:00
@@ -34,18 +34,18 @@
"\n",
"<table align=\"left\">\n",
" <td>\n",
" <a href=\"https://colab.sandbox.google.com/github/GoogleCloudPlatform/vertex-ai-samples/blob/main/notebooks/official/gen_ai/batch_eval_llm.ipynb\">\n",
" <a href=\"https://colab.sandbox.google.com/github/GoogleCloudPlatform/vertex-ai-samples/blob/main/notebooks/official/generative_ai/batch_eval_llm.ipynb\">\n",
" <img src=\"https://cloud.google.com/ml-engine/images/colab-logo-32px.png\" alt=\"Colab logo\"> Run in Colab\n",
" </a>\n",
" </td>\n",
" <td>\n",
" <a href=\"https://github.com/GoogleCloudPlatform/vertex-ai-samples/blob/main/notebooks/official/gen_ai/batch_eval_llm.ipynb\">\n",
" <a href=\"https://github.com/GoogleCloudPlatform/vertex-ai-samples/blob/main/notebooks/official/generative_ai/batch_eval_llm.ipynb\">\n",
" <img src=\"https://cloud.google.com/ml-engine/images/github-logo-32px.png\" alt=\"GitHub logo\">\n",
" View on GitHub\n",
" </a>\n",
" </td>\n",
" <td>\n",
" <a href=\"https://console.cloud.google.com/vertex-ai/workbench/deploy-notebook?download_url=https://raw.githubusercontent.com/GoogleCloudPlatform/vertex-ai-samples/main/notebooks/community/official/gen_ai/batch_eval_llm.ipynb\">\n",
" <a href=\"https://console.cloud.google.com/vertex-ai/workbench/deploy-notebook?download_url=https://raw.githubusercontent.com/GoogleCloudPlatform/vertex-ai-samples/main/notebooks/official/generative_ai/batch_eval_llm.ipynb\">\n",
" <img src=\"https://www.gstatic.com/cloud/images/navigation/vertex-ai.svg\" alt=\"Vertex AI logo\">Open in Vertex AI Workbench\n",
" </a>\n",
"</table>"
@@ -61,7 +61,9 @@
"\n",
"This tutorial demonstrates how to evaluate a large-language model (LLM) end-to-end with Vertex AI.\n",
"\n",
"*Preview releases are covered by the Pre-GA Offerings Terms of the Google Cloud Platform Terms of Service. They are not intended for production use or covered by any SLA, support obligation, or deprecation policy and might be subject to backward-incompatible changes.*\n"
"*Preview releases are covered by the Pre-GA Offerings Terms of the Google Cloud Platform Terms of Service. They are not intended for production use or covered by any SLA, support obligation, or deprecation policy and might be subject to backward-incompatible changes.*\n",
"\n",
"Learn more about [Overview of Generative AI support on Vertex AI](https://cloud.google.com/vertex-ai/docs/generative-ai/learn/overview)."
]
},
{
@@ -99,7 +101,7 @@
"\n",
"| large_model_reference | supported accelerator_type | supported region |\n",
"|---|---|---|\n",
"| `BISON` | `TPU_V3`, `NVIDIA_TESLA_A100` | europe-west4, us-central1 |\n",
"| `text-bison@001` | `TPU_V3`, `NVIDIA_TESLA_A100` | europe-west4, us-central1 |\n",
"| `t5-small` | `TPU_V3`, `NVIDIA_TESLA_A100` | europe-west4, us-central1 |\n",
"| `t5-large` | `TPU_V3` | europe-west4 |\n",
"| `t5-xl` | `TPU_V3` | europe-west4 |\n",
@@ -538,9 +540,9 @@
" pipeline_root=PIPELINE_ROOT,\n",
" template_path=INFER_PIPELINE_PKG_PATH,\n",
" parameter_values={\n",
" \"large_model_reference\": \"BISON\", # see Table 1 for valid values.\n",
" \"large_model_reference\": \"text-bison@001\", # see Table 1 for valid values.\n",
" \"model_checkpoint\": MODEL_CHECKPOINT,\n",
" \"prompt_dataset\": \"gs://vertex-ai/generative-ai/rlhf/text_small/reddit_tfds/val/*.jsonl\",\n",
" \"prompt_dataset\": \"gs://cloud-samples-data/vertex-ai/llm/rlhf/text_small/reddit_tfds/val/*.jsonl\",\n",
" \"instruction\": \"Summarize in less than 50 words.\",\n",
" },\n",
")"