Compare commits

...
@@ -3,7 +3,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "ed0fca3f",
"metadata": {
"id": "ur8xi4C7S06n"
},
@@ -26,21 +25,12 @@
},
{
"cell_type": "markdown",
"id": "6e92def7-b4f0-4100-b981-82972665d19d",
"metadata": {
"id": "847715f095b5"
},
"source": [
"# Vertex AI: Comparing Pipeline Runs"
]
},
{
"cell_type": "markdown",
"id": "ffada1ce",
"metadata": {
"id": "JAPoU8Sm5E6e"
},
"source": [
"# Compare pipeline runs with Vertex AI Experiments\n",
"\n",
"<table align=\"left\">\n",
"\n",
" <td>\n",
@@ -55,7 +45,7 @@
" </a>\n",
" </td>\n",
" <td>\n",
" <a href=\"https://console.cloud.google.com/vertex-ai/workbench/deploy-notebook?download_url=https://raw.githubusercontent.com/GoogleCloudPlatform/vertex-ai-samples/main/notebooks/official/experiments/comparing_pipeline_runs.ipynb\">\n",
" <a href=\"https://console.cloud.google.com/vertex-ai/workbench/deploy-notebook?download_url=https://raw.githubusercontent.com/GoogleCloudPlatform/vertex-ai-samples/notebooks/official/experiments/comparing_pipeline_runs.ipynb\">\n",
" <img src=\"https://lh3.googleusercontent.com/UiNooY4LUgW_oTvpsNhPpQzsstV5W8F7rYgxgGBD85cWJoLmrOzhVs_ksK_vgx40SHs7jCqkTkCk=e14-rj-sc0xffffff-h130-w32\" alt=\"Vertex AI logo\">\n",
" Open in Vertex AI Workbench\n",
" </a>\n",
@@ -65,13 +55,10 @@
},
{
"cell_type": "markdown",
"id": "d118d181",
"metadata": {
"id": "tvgnzT1CKxrO"
},
"source": [
"# Compare pipeline runs with Vertex AI Experiments\n",
"\n",
"## Overview\n",
"\n",
"Depending on the model life cycle of your data science team, you would like to experiment and track training Pipeline runs and its associated parameters. Then, you would to compare runs of these Pipelines to each others in order to figure out which is the best configuration generates the model you will register in the Vertex AI Model Registry."
@@ -79,7 +66,6 @@
},
{
"cell_type": "markdown",
"id": "b6201ad0-af42-48fd-b03d-403fd235e268",
"metadata": {
"id": "d220917f1302"
},
@@ -101,7 +87,6 @@
},
{
"cell_type": "markdown",
"id": "cffa7608-f550-4913-8f88-30cbcd525685",
"metadata": {
"id": "263933842022"
},
@@ -113,7 +98,6 @@
},
{
"cell_type": "markdown",
"id": "b46c0eb6-e65d-4b28-b17d-dc9bf9b08120",
"metadata": {
"id": "de76bb18c85b"
},
@@ -134,7 +118,6 @@
},
{
"cell_type": "markdown",
"id": "ee1e6851",
"metadata": {
"id": "gCuSR8GkAgzl"
},
@@ -177,7 +160,6 @@
},
{
"cell_type": "markdown",
"id": "97e5b386",
"metadata": {
"id": "i7EUnXsZhAGF"
},
@@ -190,7 +172,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "5b01540f",
"metadata": {
"id": "2b4ef9b72d43"
},
@@ -215,7 +196,6 @@
},
{
"cell_type": "markdown",
"id": "c6806ee8",
"metadata": {
"id": "hhq5zEbGg0XX"
},
@@ -228,7 +208,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "584f0887",
"metadata": {
"id": "EzrelQZ22IZj"
},
@@ -247,7 +226,6 @@
},
{
"cell_type": "markdown",
"id": "bb098c06",
"metadata": {
"id": "lWEdiXsJg0XY"
},
@@ -257,7 +235,6 @@
},
{
"cell_type": "markdown",
"id": "3706598b",
"metadata": {
"id": "BF1j6f9HApxa"
},
@@ -282,7 +259,6 @@
},
{
"cell_type": "markdown",
"id": "c7f6a1ea",
"metadata": {
"id": "WReHDGG5g0XY"
},
@@ -295,7 +271,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "6984e874-ae15-4094-9c5b-8d12661645c9",
"metadata": {
"id": "3c8049930470"
},
@@ -307,7 +282,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "ebaef2f9",
"metadata": {
"id": "oM1iC_MfAts1"
},
@@ -325,7 +299,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "d9745b2b-cd37-4a1c-aae7-4cd75a3c126c",
"metadata": {
"id": "f2e3c0f2cbfb"
},
@@ -336,7 +309,6 @@
},
{
"cell_type": "markdown",
"id": "fff3c4af",
"metadata": {
"id": "qJYoRfYng0XZ"
},
@@ -347,7 +319,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "89a05131",
"metadata": {
"id": "riG_qUokg0XZ"
},
@@ -359,7 +330,6 @@
},
{
"cell_type": "markdown",
"id": "9aa4ad5f",
"metadata": {
"id": "2aa333eca058"
},
@@ -381,7 +351,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "244d416e",
"metadata": {
"id": "d8b34ef9a3d0"
},
@@ -395,7 +364,6 @@
},
{
"cell_type": "markdown",
"id": "eed6c3ba",
"metadata": {
"id": "126548a06aa1"
},
@@ -408,7 +376,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "6ef7c7b1",
"metadata": {
"id": "e660b8504e63"
},
@@ -428,7 +395,6 @@
},
{
"cell_type": "markdown",
"id": "5763da2c",
"metadata": {
"id": "sBCra4QMA2wR"
},
@@ -470,7 +436,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "85b826d2",
"metadata": {
"id": "PyQmSRbKA8r-"
},
@@ -503,7 +468,6 @@
},
{
"cell_type": "markdown",
"id": "3d31b8b8",
"metadata": {
"id": "zgPO1eR3CYjk"
},
@@ -520,7 +484,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "95a18950",
"metadata": {
"id": "MzGDU7TWdts_"
},
@@ -533,7 +496,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "379d758a",
"metadata": {
"id": "cf221059d072"
},
@@ -546,7 +508,6 @@
},
{
"cell_type": "markdown",
"id": "50b86adc",
"metadata": {
"id": "-EcIXiGsCePi"
},
@@ -557,7 +518,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "564ce38f",
"metadata": {
"id": "NIq7R4HZCfIc"
},
@@ -568,7 +528,6 @@
},
{
"cell_type": "markdown",
"id": "a4324d2e",
"metadata": {
"id": "ucvCsknMCims"
},
@@ -579,7 +538,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "df030498-f6e7-4e45-96f4-0d36590865aa",
"metadata": {
"id": "vhOb7YnwClBb"
},
@@ -590,7 +548,6 @@
},
{
"cell_type": "markdown",
"id": "49d12f54",
"metadata": {
"id": "b7e24e522bee"
},
@@ -603,7 +560,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "8da829a1",
"metadata": {
"id": "77b01a1fdbb4"
},
@@ -615,7 +571,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "f2c8c41d",
"metadata": {
"id": "121d7ca29426"
},
@@ -645,7 +600,6 @@
},
{
"cell_type": "markdown",
"id": "f0552e61",
"metadata": {
"id": "aa175e2960ac"
},
@@ -658,7 +612,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "abbfcad3",
"metadata": {
"id": "f88cb0488c08"
},
@@ -671,7 +624,6 @@
},
{
"cell_type": "markdown",
"id": "2689f52b",
"metadata": {
"id": "fXUqOdIaLbjf"
},
@@ -682,7 +634,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "754e5f7b",
"metadata": {
"id": "9fYX14c0LfmU"
},
@@ -695,7 +646,6 @@
},
{
"cell_type": "markdown",
"id": "231e5499",
"metadata": {
"id": "XoEqT2Y4DJmf"
},
@@ -706,7 +656,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "884b2d31",
"metadata": {
"id": "pRUOFELefqf1"
},
@@ -732,7 +681,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "20e96b6b",
"metadata": {
"id": "OAY0QKZD8qNP"
},
@@ -753,7 +701,6 @@
},
{
"cell_type": "markdown",
"id": "3fb7c387",
"metadata": {
"id": "inR70nh38PeK"
},
@@ -766,7 +713,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "6eb614be",
"metadata": {
"id": "Nz0nasrh8T3c"
},
@@ -777,7 +723,6 @@
},
{
"cell_type": "markdown",
"id": "01448e2a",
"metadata": {
"id": "container:training,prediction,xgboost"
},
@@ -796,7 +741,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "ece742dc",
"metadata": {
"id": "XujRA5ueox9U"
},
@@ -809,7 +753,6 @@
},
{
"cell_type": "markdown",
"id": "32a2397a",
"metadata": {
"id": "t1NLYz1R-KWv"
},
@@ -819,7 +762,6 @@
},
{
"cell_type": "markdown",
"id": "64570881",
"metadata": {
"id": "jnfKxpj0-Z0H"
},
@@ -832,7 +774,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "f612dbf2",
"metadata": {
"id": "jv_-vU46_eFN"
},
@@ -971,7 +912,6 @@
},
{
"cell_type": "markdown",
"id": "bf048b2a",
"metadata": {
"id": "U1UiTZhkVoFM"
},
@@ -984,7 +924,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "7684850a",
"metadata": {
"id": "9Gfr6pNLU-dB"
},
@@ -1007,7 +946,6 @@
},
{
"cell_type": "markdown",
"id": "cb6cae0b",
"metadata": {
"id": "RkfZ7qVAVjBO"
},
@@ -1018,7 +956,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "c6b9ec3f",
"metadata": {
"id": "oYlLBGUSVibG"
},
@@ -1029,7 +966,6 @@
},
{
"cell_type": "markdown",
"id": "cc940f17",
"metadata": {
"id": "95vG4-zPWc0B"
},
@@ -1039,7 +975,6 @@
},
{
"cell_type": "markdown",
"id": "bb2b2eb4",
"metadata": {
"id": "ZNb6kZ2l5t-O"
},
@@ -1052,7 +987,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "77314a6f",
"metadata": {
"id": "XPy0Jc8xXgpa"
},
@@ -1070,7 +1004,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "aee97ebf",
"metadata": {
"id": "G0hm1no_WY8o"
},
@@ -1094,7 +1027,6 @@
},
{
"cell_type": "markdown",
"id": "0ca08588",
"metadata": {
"id": "O8TV4q535c2M"
},
@@ -1107,7 +1039,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "a65f2574",
"metadata": {
"id": "dlCEJKfH5xR7"
},
@@ -1119,7 +1050,6 @@
},
{
"cell_type": "markdown",
"id": "f605666a-9f2a-479f-9948-6f2f29e4e76b",
"metadata": {
"id": "98c022ca36b4"
},
@@ -1130,7 +1060,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "dc6661c5",
"metadata": {
"id": "FA9W85vs7LLD"
},
@@ -1157,7 +1086,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "ef041ba2",
"metadata": {
"id": "ISsK9Msi-Kqs"
},
@@ -1172,7 +1100,6 @@
},
{
"cell_type": "markdown",
"id": "02a718ab",
"metadata": {
"id": "TpV-iwP9qw9c"
},
@@ -1188,7 +1115,6 @@
{
"cell_type": "code",
"execution_count": null,
"id": "e90fb0b1",
"metadata": {
"id": "6xbYQn5t5Noe"
},