Compare commits

...
Author SHA1 Message Date
Andrew Ferlitsch 07c0f3710f fix: linkback 2023-03-10 17:16:00 +00:00
Andrew FerlitschandGitHub dcfc30edab Merge pull request #1576 from GoogleCloudPlatform/imkc--matching-engine-clip
Added matching engine CLIP notebook
2023-03-07 18:41:46 +00:00
Andrew FerlitschandGitHub 03fea0608d Merge pull request #1575 from GoogleCloudPlatform/imkc--matching-engine-stackoverflow
Added stackoverflow embeddings notebook
2023-03-07 18:03:52 +00:00
Andrew FerlitschandGitHub 6c15941242 Merge pull request #1577 from kthytang/fs-integration
fix: copy CPR model server to users project before using
2023-03-07 17:58:47 +00:00
kthytang 1bd5c364f5 fix: copy CPR model server to users project before using 2023-03-07 09:49:36 -08:00
ivanmkc@google.com 080d1819ed Addressed TW comments 2023-03-07 12:07:46 -05:00
ivanmkc@google.com 6a2d06f8f4 Fixed sigfig 2023-03-07 10:23:12 -05:00
ivanmkc@google.com 38a37ae8b9 Added plots 2023-03-07 10:14:40 -05:00
ivanmkc@google.com db06465158 Added matching engine CLIP notebook 2023-03-07 08:40:49 -05:00
Andrew FerlitschandGitHub 01575ae76d Merge pull request #1570 from GoogleCloudPlatform/blessed_vs_challenger
feat: challenger vs blessed deployment method
2023-03-06 20:04:40 +00:00
Andrew Ferlitsch d795b6e1f5 fix:missing install 2023-03-06 19:11:08 +00:00
Andrew FerlitschandGitHub 34eaf50f2c Merge pull request #1573 from kthytang/fs-integration
fix: update the cpr image used in the feature store prediction integr…
2023-03-06 17:57:14 +00:00
Andrew Ferlitsch 08ffe85ddf fix:missing install 2023-03-06 17:19:30 +00:00
kthytang 3ca5d6cad6 fix: update the cpr image used in the feature store prediction integration notebook 2023-03-05 20:09:05 -08:00
Andrew Ferlitsch 9117fbbb71 fix:missing install 2023-03-04 01:57:32 +00:00
Andrew Ferlitsch 607c2605fa fix:missing install 2023-03-03 23:10:37 +00:00
Andrew Ferlitsch 3509bbc383 fix:missing install 2023-03-03 22:31:34 +00:00
Andrew Ferlitsch a1b1ff9a6b feat: challenger vs blessed deployment method 2023-03-03 21:05:35 +00:00
4 changed files with 2592 additions and 17 deletions
@@ -1445,7 +1445,7 @@
"source": [
"We have provided a Identity model server, built using [CPR](https://cloud.google.com/vertex-ai/docs/predictions/custom-prediction-routines) to help with debugging your feature fetch config. The CPR built Identity model server simply returns the request body as the response. This will allow you to explore how the Feature Store/Prediction integration formats the prediction request to the model server.\n",
"\n",
"The server has been published here - `us-docker.pkg.dev/vertex-prediction-samples/model-servers/cpr-identity`, and uses the following `Predictor`.\n",
"The server has been published here - `us-docker.pkg.dev/vertex-ai/sample-model-servers/cpr-identity-server:latest`, and uses the following `Predictor`.\n",
"```\n",
"from google.cloud.aiplatform.prediction.predictor import Predictor\n",
"\n",
@@ -1470,7 +1470,79 @@
"id": "46c332abbe7a"
},
"source": [
"Using the same feature fetch config file as in the previous example, let's now use it with the Identity model server to debug it."
"Using the same feature fetch config file as in the previous example, deploy it with the Identity model server to debug.\n",
"\n",
"First copy the image to Artifacts Registry."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "962c1cfe1588"
},
"outputs": [],
"source": [
"!gcloud services enable artifactregistry.googleapis.com"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "639b2d067827"
},
"outputs": [],
"source": [
"REPOSITORY = \"feature-store-prediction-sample\"\n",
"IMAGE = \"cpr-identity-server\"\n",
"CONTAINER_URI = f\"{REGION}-docker.pkg.dev/{PROJECT_ID}/{REPOSITORY}/{IMAGE}\""
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "6523af67c1ab"
},
"outputs": [],
"source": [
"!gcloud artifacts repositories create {REPOSITORY} \\\n",
" --repository-format=docker \\\n",
" --location=$REGION"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "b3b939dc0b25"
},
"outputs": [],
"source": [
"!gcloud auth configure-docker {REGION}-docker.pkg.dev --quiet"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "34c1cec95124"
},
"outputs": [],
"source": [
"!docker pull us-docker.pkg.dev/vertex-ai/sample-model-servers/cpr-identity-server:latest\n",
"!docker tag us-docker.pkg.dev/vertex-ai/sample-model-servers/cpr-identity-server:latest $CONTAINER_URI\n",
"!docker push $CONTAINER_URI"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "d4c81e1eb726"
},
"source": [
"Now upload and deploy the identity model to Vertex Prediction for debugging."
]
},
{
@@ -1486,7 +1558,7 @@
"identity_model = aiplatform.Model.upload(\n",
" display_name=IDENTITY_MODEL_DISPLAY_NAME,\n",
" artifact_uri=ARTIFACT_URI,\n",
" serving_container_image_uri=\"us-docker.pkg.dev/vertex-prediction-samples/model-servers/cpr-identity\",\n",
" serving_container_image_uri=CONTAINER_URI,\n",
" sync=False,\n",
")\n",
"\n",
@@ -62,21 +62,9 @@
"## Overview\n",
"\n",
"\n",
"This tutorial demonstrates how to use Vertex AI for E2E MLOps on Google Cloud in production. This tutorial covers: get started with Endpoints and shared VM for co-hosting models."
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "dataset:flowers,icn"
},
"source": [
"### Pre-trained Models\n",
"This tutorial demonstrates how to use Vertex AI for E2E MLOps on Google Cloud in production. This tutorial covers: get started with Endpoints and shared VM for co-hosting models.\n",
"\n",
"The pre-trained models used for this tutorial are from the [TensorFlow Hub](https://tfhub.dev/) repository:\n",
"\n",
"- [image classification](https://tfhub.dev/google/imagenet/inception_v3/classification/5): trained with ImageNet.\n",
"- [text sentence encoder](https://tfhub.dev/google/universal-sentence-encoder/4): Google's universal sentence encoder"
"Learn more about [Shared resources across deployments](https://cloud.google.com/vertex-ai/docs/predictions/model-co-hosting)."
]
},
{
@@ -110,6 +98,20 @@
"- Make a prediction request with second deployed model (model B)."
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "dataset:flowers,icn"
},
"source": [
"### Model\n",
"\n",
"The pre-trained models used for this tutorial are from the [TensorFlow Hub](https://tfhub.dev/) repository:\n",
"\n",
"- [image classification](https://tfhub.dev/google/imagenet/inception_v3/classification/5): trained with ImageNet.\n",
"- [text sentence encoder](https://tfhub.dev/google/universal-sentence-encoder/4): Google's universal sentence encoder"
]
},
{
"cell_type": "markdown",
"metadata": {
File diff suppressed because one or more lines are too long
File diff suppressed because it is too large Load Diff